2023-11-09T23:51:56.564 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T23:51:56.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:51:56.705 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1e0f5e3ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1e100d5670>, signals=[15])
2023-11-09T23:51:56.706 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-11-09T23:51:56.707 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T23:51:56.707 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-11-09T23:51:56.734 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-11-09T23:51:56.734 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T23:51:56.734 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-09T23:51:56.736 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-11-09T23:51:56.759 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-11-09T23:51:56.811 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T23:51:56.825 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-09T23:51:56.862 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T23:51:56.863 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3}
2023-11-09T23:51:56.867 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3)
2023-11-09T23:51:56.867 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3}
2023-11-09T23:51:56.904 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream
2023-11-09T23:51:56.905 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:51:56.908 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-11-09T23:51:56.908 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:51:56.959 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T23:51:56.963 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T23:51:57.010 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-11-09T23:51:57.016 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-11-09T23:51:57.072 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:51:57.120 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:51:57.175 INFO:teuthology.orchestra.console.smithi062:Power off
2023-11-09T23:51:57.177 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T23:51:57.200 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-11-09T23:51:57.200 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:51:57.215 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-09T23:51:57.216 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T23:51:57.224 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-09T23:51:57.237 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-09T23:51:57.237 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:51:57.262 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-09T23:51:57.363 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-09T23:51:57.463 INFO:teuthology.orchestra.console.smithi203:Power on
2023-11-09T23:51:57.464 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T23:51:57.485 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-11-09T23:51:57.486 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:51:57.508 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-09T23:52:01.228 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:01.337 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-09T23:52:01.510 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:01.619 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-11-09T23:52:01.720 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-11-09T23:52:01.821 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-11-09T23:52:01.821 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:52:05.342 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:05.452 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-09T23:52:09.456 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:09.565 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-09T23:52:09.666 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-11-09T23:52:09.767 INFO:teuthology.orchestra.console.smithi062:Power on
2023-11-09T23:52:09.767 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T23:52:09.790 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2023-11-09T23:52:09.790 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:09.814 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-09T23:52:13.818 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:13.928 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-09T23:52:16.895 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:52:17.930 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T23:52:18.038 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-11-09T23:52:18.140 INFO:teuthology.orchestra.console.smithi062:Power on completed
2023-11-09T23:52:18.240 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-11-09T23:52:18.241 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:52:31.978 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:52:33.313 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:52:47.078 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:52:48.394 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:53:02.170 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:53:03.464 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:53:17.242 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:53:18.536 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:53:32.327 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:53:33.606 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:53:47.406 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:53:48.672 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:54:02.482 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:54:03.740 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:54:17.550 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:54:18.814 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:54:32.626 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:54:33.893 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:54:47.706 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-11-09T23:54:47.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:54:48.966 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:54:50.846 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:54:56.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:54:59.930 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:04.034 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-11-09T23:55:04.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:05.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:07.166 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-09T23:55:08.986 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:13.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:14.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:16.254 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-09T23:55:18.042 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:22.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:24.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:25.342 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-09T23:55:27.098 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:31.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:33.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:34.430 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-09T23:55:36.154 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:40.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:42.157 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:43.518 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-11-09T23:55:45.210 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-11-09T23:55:49.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:55:51.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:56:49.582 WARNING:teuthology.provision.fog.smithi062:timed out
2023-11-09T23:56:51.218 WARNING:teuthology.provision.fog.smithi203:timed out
2023-11-09T23:56:55.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:56:55.819 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T23:56:55.820 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T23:56:56.126 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-11-09T23:56:56.126 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-11-09T23:56:56.148 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-11-09T23:56:56.149 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-11-09T23:56:56.210 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-11-09T23:56:56.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-11-09T23:56:56.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-11-09T23:56:56.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-11-09T23:56:56.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-11-09T23:56:56.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-11-09T23:56:56.573 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-11-09T23:56:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-11-09T23:56:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-11-09T23:56:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-11-09T23:56:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-11-09T23:56:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-11-09T23:56:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-11-09T23:56:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T23:56:56.634 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-11-09T23:56:56.635 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T23:56:56.635 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-11-09T23:56:56.635 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T23:56:56.635 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T23:56:56.636 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T23:56:56.636 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-11-09T23:56:56.638 DEBUG:teuthology.parallel:result is None
2023-11-09T23:56:57.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:56:57.518 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T23:56:57.519 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T23:56:57.767 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-11-09T23:56:57.768 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-11-09T23:56:57.786 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-11-09T23:56:57.787 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-11-09T23:56:57.845 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-11-09T23:56:57.846 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-09T23:56:57.948 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-11-09T23:56:57.978 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-11-09T23:56:58.047 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-11-09T23:56:58.115 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-11-09T23:56:58.182 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-09T23:56:58.240 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-11-09T23:56:58.240 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-11-09T23:56:58.241 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-11-09T23:56:58.241 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-11-09T23:56:58.241 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-11-09T23:56:58.241 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-09T23:56:58.241 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T23:56:58.242 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-09T23:56:58.242 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T23:56:58.242 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-11-09T23:56:58.243 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T23:56:58.243 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T23:56:58.243 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T23:56:58.243 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-11-09T23:56:58.244 DEBUG:teuthology.parallel:result is None
2023-11-09T23:56:58.393 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-11-09T23:56:58.394 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T23:56:58.413 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-11-09T23:56:58.414 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T23:56:58.439 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-11-09T23:56:58.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-11-09T23:56:58.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:56:58.509 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-11-09T23:56:58.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-11-09T23:56:58.585 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-11-09T23:56:58.647 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-11-09T23:56:58.648 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-11-09T23:56:58.709 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-11-09T23:56:58.710 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-11-09T23:56:58.710 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-11-09T23:56:58.710 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-11-09T23:56:58.710 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-11-09T23:56:58.711 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-11-09T23:56:58.711 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T23:56:58.711 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-11-09T23:56:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T23:56:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-11-09T23:56:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T23:56:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T23:56:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T23:56:58.713 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-11-09T23:56:58.739 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-11-09T23:56:58.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-09T23:56:58.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T23:56:58.808 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-11-09T23:56:58.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-11-09T23:56:58.878 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-11-09T23:56:58.935 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-11-09T23:56:58.936 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-11-09T23:56:58.993 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-11-09T23:56:58.993 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-11-09T23:56:58.994 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-11-09T23:56:58.994 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-11-09T23:56:58.994 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-11-09T23:56:58.994 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-11-09T23:56:58.995 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-09T23:56:58.995 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-11-09T23:56:58.995 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-09T23:56:58.995 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-11-09T23:56:58.995 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T23:56:58.996 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-09T23:56:58.996 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T23:56:58.996 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-11-09T23:56:59.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T23:56:59.138 INFO:teuthology.dispatcher.supervisor:Running job 7453332
2023-11-09T23:56:59.138 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453332 --name yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description fs/verify/{begin clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/fsstress validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453332/orig.config.yaml
2023-11-09T23:56:59.148 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453332
2023-11-09T23:56:59.149 INFO:teuthology.dispatcher.supervisor:Job PID: 1068360
2023-11-09T23:56:59.149 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T23:58:59.246 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:00:59.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:02:59.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:04:59.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:06:59.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:09:00.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:11:00.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:13:00.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:15:00.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:17:00.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:19:00.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:21:01.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:23:01.243 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:25:01.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:27:01.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:29:01.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:31:01.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:33:02.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:35:02.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:37:02.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:39:02.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:41:02.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:43:02.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:45:03.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:47:03.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:49:03.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:51:03.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:53:03.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:55:03.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:57:04.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:59:04.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:01:04.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:03:04.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:05:04.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:07:04.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:09:05.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:11:05.239 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:13:05.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:15:05.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T01:15:05.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-10T01:15:05.806 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-10T01:15:05.807 INFO:teuthology.nuke:Checking targets against current locks
2023-11-10T01:15:05.860 DEBUG:teuthology.nuke:shortname: smithi062
2023-11-10T01:15:05.861 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-10T01:15:05.883 DEBUG:teuthology.nuke:shortname: smithi203
2023-11-10T01:15:05.883 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-10T01:15:05.887 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 23:51:55.729485', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOoTU0PhmUH155wtQHusatO0VfVaPW3k2hNmaNWkF16sw4clK+lbwhXs9mTR6iNR1yZaRzoMPMXTnrpW2nYptGg='}
2023-11-10T01:15:05.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-fs-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 23:51:55.728089', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDHe12j9qwS7csshoatFvvMqm2wAcJhFOoWGMfrMc7krBL8m/xQIltVBMbUMkTMDe3jCPMhT2201kYRjQA0l2zE='}
2023-11-10T01:15:05.936 INFO:teuthology.orchestra.console.smithi062:Power off
2023-11-10T01:15:05.937 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T01:15:05.958 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-11-10T01:15:05.959 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T01:15:05.972 INFO:teuthology.orchestra.console.smithi203:Power off
2023-11-10T01:15:05.973 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T01:15:05.980 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-11-10T01:15:05.993 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-11-10T01:15:05.994 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T01:15:06.014 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-11-10T01:15:06.082 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-11-10T01:15:06.116 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-11-10T01:15:06.234 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-11-10T01:15:06.258 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com