2023-11-06T07:15:35.428 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-06T07:15:35.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:15:35.577 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3733a01b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f37344ea670>, signals=[15])
2023-11-06T07:15:35.579 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging
2023-11-06T07:15:35.580 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T07:15:35.580 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-11-06T07:15:35.606 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2023-11-06T07:15:35.606 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2023-11-06T07:15:35.607 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-06T07:15:35.609 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"}
2023-11-06T07:15:35.630 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"}
2023-11-06T07:15:35.684 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T07:15:35.697 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-06T07:15:35.734 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T07:15:35.735 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 3}
2023-11-06T07:15:35.739 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3)
2023-11-06T07:15:35.739 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 3}
2023-11-06T07:15:35.784 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2023-11-06T07:15:35.785 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:15:35.788 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream
2023-11-06T07:15:35.788 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:15:35.846 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T07:15:35.847 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"}
2023-11-06T07:15:35.895 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1}
2023-11-06T07:15:35.898 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1}
2023-11-06T07:15:35.951 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:15:35.954 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:15:36.045 INFO:teuthology.orchestra.console.smithi133:Power off
2023-11-06T07:15:36.046 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T07:15:36.059 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-06T07:15:36.060 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T07:15:36.069 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-11-06T07:15:36.070 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:36.083 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-06T07:15:36.084 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:36.092 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-11-06T07:15:36.107 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-06T07:15:40.097 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:40.108 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:40.206 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-11-06T07:15:40.217 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-06T07:15:44.210 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:44.218 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:44.319 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-11-06T07:15:44.329 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-06T07:15:44.421 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-11-06T07:15:44.522 INFO:teuthology.orchestra.console.smithi133:Power on
2023-11-06T07:15:44.522 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T07:15:44.543 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On
2023-11-06T07:15:44.543 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:44.564 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-11-06T07:15:48.334 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:48.443 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-06T07:15:48.544 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-06T07:15:48.565 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:48.645 INFO:teuthology.orchestra.console.smithi154:Power on
2023-11-06T07:15:48.645 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-06T07:15:48.668 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2023-11-06T07:15:48.668 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:48.677 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-11-06T07:15:48.689 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-06T07:15:52.678 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:52.691 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:15:52.787 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on
2023-11-06T07:15:52.801 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-06T07:15:52.889 INFO:teuthology.orchestra.console.smithi133:Power on completed
2023-11-06T07:15:52.902 INFO:teuthology.orchestra.console.smithi154:Power on completed
2023-11-06T07:15:52.991 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish
2023-11-06T07:15:52.991 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:15:53.003 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2023-11-06T07:15:53.004 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:16:08.078 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:16:08.081 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:16:23.166 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:16:23.169 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:16:38.250 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:16:38.252 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:16:53.327 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:16:53.328 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:17:08.398 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:17:08.400 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:17:23.467 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:17:23.468 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:17:38.538 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:17:38.540 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:17:53.619 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:17:53.620 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:18:08.688 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:18:08.694 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:18:23.782 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None
2023-11-06T07:18:23.784 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:18:23.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:18:38.875 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:18:42.302 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:18:48.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:18:51.390 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:18:53.942 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-06T07:18:53.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:18:57.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:00.474 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:19:06.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:09.530 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:19:12.506 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-06T07:19:15.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:18.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:18.590 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:19:21.562 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-06T07:19:24.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:27.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:30.618 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-06T07:19:36.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:39.678 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-06T07:19:42.971 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:19:45.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:48.766 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-06T07:19:48.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:52.026 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133
2023-11-06T07:19:54.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:58.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:19:58.696 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-06T07:19:58.696 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-06T07:20:23.642 INFO:teuthology.provision.fog.smithi133:Node is ready
2023-11-06T07:20:23.643 DEBUG:teuthology.orchestra.run.smithi133:> hostname
2023-11-06T07:20:23.667 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com
2023-11-06T07:20:23.668 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts
2023-11-06T07:20:23.728 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133
2023-11-06T07:20:23.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-11-06T07:20:23.860 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts
2023-11-06T07:20:23.892 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts
2023-11-06T07:20:23.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname
2023-11-06T07:20:24.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133
2023-11-06T07:20:24.099 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-11-06T07:20:24.159 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream"
2023-11-06T07:20:24.159 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8"
2023-11-06T07:20:24.159 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos"
2023-11-06T07:20:24.160 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora"
2023-11-06T07:20:24.160 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8"
2023-11-06T07:20:24.160 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2023-11-06T07:20:24.160 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-06T07:20:24.160 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2023-11-06T07:20:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-06T07:20:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/"
2023-11-06T07:20:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T07:20:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T07:20:24.161 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-06T07:20:24.162 INFO:teuthology.provision.fog.smithi133:Deploy complete!
2023-11-06T07:20:24.164 DEBUG:teuthology.parallel:result is None
2023-11-06T07:20:54.796 WARNING:teuthology.provision.fog.smithi154:timed out
2023-11-06T07:21:00.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:21:01.091 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-06T07:21:01.092 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-06T07:21:01.320 INFO:teuthology.provision.fog.smithi154:Node is ready
2023-11-06T07:21:01.321 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2023-11-06T07:21:01.379 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2023-11-06T07:21:01.379 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2023-11-06T07:21:01.438 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2023-11-06T07:21:01.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-06T07:21:01.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2023-11-06T07:21:01.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2023-11-06T07:21:01.647 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2023-11-06T07:21:01.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-06T07:21:01.783 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-06T07:21:01.841 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-06T07:21:01.841 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2023-11-06T07:21:01.841 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-06T07:21:01.842 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-06T07:21:01.842 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2023-11-06T07:21:01.842 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2023-11-06T07:21:01.842 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-06T07:21:01.843 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-06T07:21:01.843 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-06T07:21:01.843 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-06T07:21:01.843 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T07:21:01.843 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T07:21:01.844 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-06T07:21:01.844 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2023-11-06T07:21:01.845 DEBUG:teuthology.parallel:result is None
2023-11-06T07:21:01.992 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com
2023-11-06T07:21:01.993 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-06T07:21:02.014 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2023-11-06T07:21:02.014 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-06T07:21:02.031 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server
2023-11-06T07:21:02.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-11-06T07:21:02.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:21:02.101 DEBUG:teuthology.orchestra.run.smithi133:> true
2023-11-06T07:21:02.232 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com'
2023-11-06T07:21:02.233 DEBUG:teuthology.orchestra.run.smithi133:> uname -m
2023-11-06T07:21:02.290 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64
2023-11-06T07:21:02.291 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release
2023-11-06T07:21:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream"
2023-11-06T07:21:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8"
2023-11-06T07:21:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos"
2023-11-06T07:21:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora"
2023-11-06T07:21:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8"
2023-11-06T07:21:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8"
2023-11-06T07:21:02.351 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-06T07:21:02.351 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31"
2023-11-06T07:21:02.351 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-06T07:21:02.351 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/"
2023-11-06T07:21:02.351 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T07:21:02.352 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T07:21:02.352 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-06T07:21:02.352 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server
2023-11-06T07:21:02.371 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2023-11-06T07:21:02.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-06T07:21:02.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-06T07:21:02.437 DEBUG:teuthology.orchestra.run.smithi154:> true
2023-11-06T07:21:02.505 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-06T07:21:02.506 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2023-11-06T07:21:02.565 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2023-11-06T07:21:02.566 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-06T07:21:02.624 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-06T07:21:02.625 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2023-11-06T07:21:02.625 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-06T07:21:02.625 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-06T07:21:02.625 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2023-11-06T07:21:02.625 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2023-11-06T07:21:02.626 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-06T07:21:02.626 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-06T07:21:02.626 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-06T07:21:02.626 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-06T07:21:02.626 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-06T07:21:02.627 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-06T07:21:02.627 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-06T07:21:02.627 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-06T07:21:02.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:21:02.758 INFO:teuthology.dispatcher.supervisor:Running job 7449239
2023-11-06T07:21:02.758 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi/7449239 --name dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/kernel_untar_build}}} -- /home/teuthworker/archive/dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi/7449239/orig.config.yaml
2023-11-06T07:21:02.762 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi/7449239
2023-11-06T07:21:02.762 INFO:teuthology.dispatcher.supervisor:Job PID: 3840653
2023-11-06T07:21:02.763 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-06T07:23:02.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:25:03.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:27:03.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:29:03.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:31:03.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:33:03.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:35:03.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:37:04.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:39:04.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:41:04.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:43:04.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-06T07:43:04.602 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-06T07:43:04.725 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-06T07:43:04.726 INFO:teuthology.nuke:Checking targets against current locks
2023-11-06T07:43:04.774 DEBUG:teuthology.nuke:shortname: smithi133
2023-11-06T07:43:04.774 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-06T07:43:04.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi/7449239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 07:15:34.606829', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP8UtPLnBA6nxxbkhifHRwSuMHcld6bCmr9ptfHyO0kZ5IEvnEtBJ77G2vvBg2/U+Nb69B3iQAMZH/YjTbFyPPQ='}
2023-11-06T07:43:04.801 DEBUG:teuthology.nuke:shortname: smithi154
2023-11-06T07:43:04.802 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-06T07:43:04.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-11-06_07:09:32-fs:upgrade-main-distro-default-smithi/7449239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 07:15:34.604919', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJwcDH29Xy0LVy9PD45C8fA8bxWB3LhjiEEXXcggV7sVtQ0JEMQszCaw9It6zxEPwnq1HbCVC0B2j5mGQXfEu38='}
2023-11-06T07:43:04.852 INFO:teuthology.orchestra.console.smithi133:Power off
2023-11-06T07:43:04.853 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T07:43:04.874 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off
2023-11-06T07:43:04.875 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:43:04.888 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-06T07:43:04.888 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-06T07:43:04.898 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off
2023-11-06T07:43:04.911 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-06T07:43:04.911 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-06T07:43:04.931 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-06T07:43:04.999 INFO:teuthology.orchestra.console.smithi133:Power off completed
2023-11-06T07:43:05.033 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-06T07:43:05.151 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com
2023-11-06T07:43:05.184 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com