2023-10-05T08:38:30.135 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-05T08:38:30.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:38:30.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc80beb5bb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc80c9b0670>, signals=[15])
2023-10-05T08:38:30.275 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging
2023-10-05T08:38:30.275 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server
2023-10-05T08:38:30.276 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-10-05T08:38:30.297 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-10-05T08:38:30.297 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-10-05T08:38:30.297 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-10-05T08:38:30.299 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"}
2023-10-05T08:38:30.322 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"}
2023-10-05T08:38:30.374 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-05T08:38:30.390 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-05T08:38:30.413 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_centos_8.stream (ID 3)
2023-10-05T08:38:30.413 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 3}
2023-10-05T08:38:30.429 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_centos_8.stream (ID 3)
2023-10-05T08:38:30.429 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 3}
2023-10-05T08:38:30.451 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of centos 8.stream
2023-10-05T08:38:30.451 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:38:30.475 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream
2023-10-05T08:38:30.475 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:38:30.500 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"}
2023-10-05T08:38:30.515 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"}
2023-10-05T08:38:30.530 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1}
2023-10-05T08:38:30.548 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1}
2023-10-05T08:38:30.662 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:38:30.678 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:38:30.745 INFO:teuthology.orchestra.console.smithi062:Power off
2023-10-05T08:38:30.745 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-05T08:38:30.758 INFO:teuthology.orchestra.console.smithi138:Power off
2023-10-05T08:38:30.758 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-05T08:38:30.766 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-10-05T08:38:30.767 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:30.778 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-10-05T08:38:30.778 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:30.789 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-10-05T08:38:30.797 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-10-05T08:38:30.897 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-10-05T08:38:30.998 INFO:teuthology.orchestra.console.smithi138:Power on
2023-10-05T08:38:30.998 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-05T08:38:31.019 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-10-05T08:38:31.019 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:31.039 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-10-05T08:38:34.790 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:34.898 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-10-05T08:38:35.040 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:35.150 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-10-05T08:38:38.903 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:39.012 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-10-05T08:38:39.151 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:39.259 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-10-05T08:38:39.361 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-10-05T08:38:39.462 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-10-05T08:38:39.462 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:38:43.016 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:43.125 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-10-05T08:38:43.225 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-10-05T08:38:43.326 INFO:teuthology.orchestra.console.smithi062:Power on
2023-10-05T08:38:43.326 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-05T08:38:43.349 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On
2023-10-05T08:38:43.349 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:43.372 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-10-05T08:38:47.374 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:47.482 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-10-05T08:38:51.487 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T08:38:51.595 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on
2023-10-05T08:38:51.696 INFO:teuthology.orchestra.console.smithi062:Power on completed
2023-10-05T08:38:51.796 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish
2023-10-05T08:38:51.796 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:38:54.518 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:39:06.862 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:39:09.578 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:39:21.931 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:39:24.631 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:39:36.994 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:39:39.684 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:39:52.070 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:39:54.738 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:40:07.145 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:40:09.801 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:40:22.222 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:40:24.874 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:40:37.286 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:40:39.938 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:40:52.361 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:40:55.010 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:41:07.435 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:41:10.082 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:41:22.513 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:41:25.154 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-10-05T08:41:25.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:41:37.590 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None
2023-10-05T08:41:37.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:41:43.546 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-10-05T08:41:49.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:41:52.606 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-10-05T08:41:56.094 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-10-05T08:41:58.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:01.690 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-10-05T08:42:02.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:05.178 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-10-05T08:42:07.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:10.750 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-10-05T08:42:11.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:14.234 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-10-05T08:42:16.754 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:20.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:42:23.290 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62
2023-10-05T08:42:29.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:43:16.804 WARNING:teuthology.provision.fog.smithi138:timed out
2023-10-05T08:43:22.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:43:23.037 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-05T08:43:23.038 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-05T08:43:23.276 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-10-05T08:43:23.276 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-10-05T08:43:23.295 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com
2023-10-05T08:43:23.295 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138.front.sepia.ceph.com /etc/hosts
2023-10-05T08:43:23.354 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-10-05T08:43:23.354 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-10-05T08:43:23.455 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hosts
2023-10-05T08:43:23.485 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-10-05T08:43:23.555 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138.front.sepia.ceph.com/smithi138/g' /etc/hostname
2023-10-05T08:43:23.623 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-10-05T08:43:23.691 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-10-05T08:43:23.749 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream"
2023-10-05T08:43:23.749 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8"
2023-10-05T08:43:23.749 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos"
2023-10-05T08:43:23.749 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora"
2023-10-05T08:43:23.749 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-05T08:43:23.750 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-05T08:43:23.751 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-10-05T08:43:23.752 DEBUG:teuthology.parallel:result is None
2023-10-05T08:43:29.298 WARNING:teuthology.provision.fog.smithi062:timed out
2023-10-05T08:43:35.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:43:35.567 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-05T08:43:35.567 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-05T08:43:35.843 INFO:teuthology.provision.fog.smithi062:Node is ready
2023-10-05T08:43:35.843 DEBUG:teuthology.orchestra.run.smithi062:> hostname
2023-10-05T08:43:35.864 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com
2023-10-05T08:43:35.864 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts
2023-10-05T08:43:35.925 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062
2023-10-05T08:43:35.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-10-05T08:43:36.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts
2023-10-05T08:43:36.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts
2023-10-05T08:43:36.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname
2023-10-05T08:43:36.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062
2023-10-05T08:43:36.281 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-10-05T08:43:36.339 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-05T08:43:36.340 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-05T08:43:36.340 INFO:teuthology.provision.fog.smithi062:Deploy complete!
2023-10-05T08:43:36.341 DEBUG:teuthology.parallel:result is None
2023-10-05T08:43:36.516 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com
2023-10-05T08:43:36.516 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-05T08:43:36.543 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-10-05T08:43:36.543 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-05T08:43:36.560 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server
2023-10-05T08:43:36.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-10-05T08:43:36.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:43:36.628 DEBUG:teuthology.orchestra.run.smithi062:> true
2023-10-05T08:43:36.654 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com'
2023-10-05T08:43:36.654 DEBUG:teuthology.orchestra.run.smithi062:> uname -m
2023-10-05T08:43:36.712 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64
2023-10-05T08:43:36.713 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8"
2023-10-05T08:43:36.771 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-05T08:43:36.772 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-05T08:43:36.772 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server
2023-10-05T08:43:36.793 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-10-05T08:43:36.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-10-05T08:43:36.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-05T08:43:36.860 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-10-05T08:43:36.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-10-05T08:43:36.993 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-10-05T08:43:37.051 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-10-05T08:43:37.052 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-10-05T08:43:37.110 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-05T08:43:37.111 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-05T08:43:37.111 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-10-05T08:43:37.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:43:37.224 INFO:teuthology.dispatcher.supervisor:Running job 7411151
2023-10-05T08:43:37.225 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411151 --name yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411151/orig.config.yaml
2023-10-05T08:43:37.227 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411151
2023-10-05T08:43:37.228 INFO:teuthology.dispatcher.supervisor:Job PID: 3809094
2023-10-05T08:43:37.228 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-05T08:45:37.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:47:37.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:49:37.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:51:37.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:53:38.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:55:38.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:57:38.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T08:59:38.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:01:38.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:03:38.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:05:39.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:07:39.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:09:39.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-05T09:09:39.435 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-05T09:09:39.603 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-05T09:09:39.604 INFO:teuthology.nuke:Checking targets against current locks
2023-10-05T09:09:39.661 DEBUG:teuthology.nuke:shortname: smithi062
2023-10-05T09:09:39.661 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-05T09:09:39.685 DEBUG:teuthology.nuke:shortname: smithi138
2023-10-05T09:09:39.686 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-05T09:09:39.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411151', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:38:29.289253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOKXLkpyR9A+xBbmQrHRERJnifTEp+7Q2CNIerHsEuO0SvJLVXJY1Dah14xmbCkfoQ2/U9lAUuwgaAOhvOp8gRo='}
2023-10-05T09:09:39.712 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-04_19:57:46-fs-wip-yuri3-testing-2023-10-04-0852-quincy-distro-default-smithi/7411151', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-05 08:38:29.292034', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOxdtNwoRrRfSHwti43mPJIJ3sdSXowDS1mewKVVzgZcYt4dW4nvOs7R2tBlPzyemENgKRDDC2vc7ofbMyqzAaI='}
2023-10-05T09:09:39.737 INFO:teuthology.orchestra.console.smithi062:Power off
2023-10-05T09:09:39.737 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-05T09:09:39.757 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off
2023-10-05T09:09:39.757 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T09:09:39.773 INFO:teuthology.orchestra.console.smithi138:Power off
2023-10-05T09:09:39.774 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-05T09:09:39.782 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off
2023-10-05T09:09:39.794 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-10-05T09:09:39.795 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-05T09:09:39.816 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-10-05T09:09:39.883 INFO:teuthology.orchestra.console.smithi062:Power off completed
2023-10-05T09:09:39.917 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-10-05T09:09:40.035 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com
2023-10-05T09:09:40.058 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com