2023-11-07T11:15:27.709 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-07T11:15:27.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:15:27.852 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1c4664fa90>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1c47143670>, signals=[15])
2023-11-07T11:15:27.853 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging
2023-11-07T11:15:27.854 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server
2023-11-07T11:15:27.854 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-11-07T11:15:27.875 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging
2023-11-07T11:15:27.875 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server
2023-11-07T11:15:27.876 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-07T11:15:27.877 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"}
2023-11-07T11:15:27.900 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"}
2023-11-07T11:15:27.969 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-07T11:15:28.011 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_8.stream (ID 3)
2023-11-07T11:15:28.011 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 3}
2023-11-07T11:15:28.016 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-07T11:15:28.054 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3)
2023-11-07T11:15:28.055 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 3}
2023-11-07T11:15:28.063 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 8.stream
2023-11-07T11:15:28.063 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:15:28.096 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream
2023-11-07T11:15:28.096 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:15:28.123 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"}
2023-11-07T11:15:28.147 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"}
2023-11-07T11:15:28.153 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1}
2023-11-07T11:15:28.183 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1}
2023-11-07T11:15:28.236 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:15:28.265 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:15:28.328 INFO:teuthology.orchestra.console.smithi131:Power off
2023-11-07T11:15:28.328 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-07T11:15:28.341 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-07T11:15:28.342 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-07T11:15:28.350 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2023-11-07T11:15:28.351 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:28.362 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-07T11:15:28.363 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:28.372 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-11-07T11:15:28.382 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-07T11:15:28.474 INFO:teuthology.orchestra.console.smithi131:Power off completed
2023-11-07T11:15:28.484 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-07T11:15:28.575 INFO:teuthology.orchestra.console.smithi131:Power on
2023-11-07T11:15:28.576 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-07T11:15:28.584 INFO:teuthology.orchestra.console.smithi154:Power on
2023-11-07T11:15:28.585 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-07T11:15:28.598 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On
2023-11-07T11:15:28.599 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:28.608 DEBUG:teuthology.orchestra.console.smithi154:power on output: Chassis Power Control: Up/On
2023-11-07T11:15:28.608 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:28.620 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-11-07T11:15:28.628 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-07T11:15:32.626 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:34.770 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T11:15:34.872 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on
2023-11-07T11:15:34.879 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is on
2023-11-07T11:15:34.974 INFO:teuthology.orchestra.console.smithi131:Power on completed
2023-11-07T11:15:34.980 INFO:teuthology.orchestra.console.smithi154:Power on completed
2023-11-07T11:15:35.075 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish
2023-11-07T11:15:35.076 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:15:35.081 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish
2023-11-07T11:15:35.081 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:15:50.150 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:15:50.152 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:16:05.222 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:16:05.224 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:16:20.300 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:16:20.301 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:16:35.376 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:16:35.377 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:16:50.450 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:16:50.452 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:17:05.529 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:17:05.531 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:17:20.622 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:17:20.623 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:17:35.710 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:17:35.711 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:17:50.790 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:17:50.792 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:18:05.881 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None
2023-11-07T11:18:05.883 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:18:05.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:20.958 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None
2023-11-07T11:18:21.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:24.094 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:18:24.380 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-11-07T11:18:30.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:30.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:33.179 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:18:33.438 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-11-07T11:18:39.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:39.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:42.234 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:18:42.490 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-11-07T11:18:48.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:48.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:51.322 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:18:51.546 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131
2023-11-07T11:18:57.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:18:57.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:19:00.410 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:19:06.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:19:09.466 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:19:15.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:19:18.522 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:19:24.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:19:27.610 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:19:33.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:19:52.186 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:19:57.556 WARNING:teuthology.provision.fog.smithi131:timed out
2023-11-07T11:19:58.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:20:01.242 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154
2023-11-07T11:20:03.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:20:03.813 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-07T11:20:03.814 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-07T11:20:04.054 INFO:teuthology.provision.fog.smithi131:Node is ready
2023-11-07T11:20:04.054 DEBUG:teuthology.orchestra.run.smithi131:> hostname
2023-11-07T11:20:04.074 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com
2023-11-07T11:20:04.074 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts
2023-11-07T11:20:04.133 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131
2023-11-07T11:20:04.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-11-07T11:20:04.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts
2023-11-07T11:20:04.269 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts
2023-11-07T11:20:04.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname
2023-11-07T11:20:04.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131
2023-11-07T11:20:04.470 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-11-07T11:20:04.529 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2023-11-07T11:20:04.529 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2023-11-07T11:20:04.529 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2023-11-07T11:20:04.529 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2023-11-07T11:20:04.530 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2023-11-07T11:20:04.530 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2023-11-07T11:20:04.530 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-07T11:20:04.530 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-11-07T11:20:04.530 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-07T11:20:04.531 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2023-11-07T11:20:04.531 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-07T11:20:04.531 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-07T11:20:04.531 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-07T11:20:04.532 INFO:teuthology.provision.fog.smithi131:Deploy complete!
2023-11-07T11:20:04.533 DEBUG:teuthology.parallel:result is None
2023-11-07T11:20:07.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:20:07.944 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-07T11:20:07.945 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-07T11:20:33.537 INFO:teuthology.provision.fog.smithi154:Node is ready
2023-11-07T11:20:33.538 DEBUG:teuthology.orchestra.run.smithi154:> hostname
2023-11-07T11:20:33.562 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com
2023-11-07T11:20:33.563 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts
2023-11-07T11:20:33.624 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154
2023-11-07T11:20:33.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-07T11:20:33.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts
2023-11-07T11:20:33.796 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts
2023-11-07T11:20:33.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname
2023-11-07T11:20:33.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154
2023-11-07T11:20:34.005 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-07T11:20:34.063 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-07T11:20:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2023-11-07T11:20:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-07T11:20:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-07T11:20:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2023-11-07T11:20:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2023-11-07T11:20:34.065 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-07T11:20:34.065 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-07T11:20:34.065 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-07T11:20:34.065 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-07T11:20:34.065 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-07T11:20:34.066 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-07T11:20:34.066 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-07T11:20:34.066 INFO:teuthology.provision.fog.smithi154:Deploy complete!
2023-11-07T11:20:34.067 DEBUG:teuthology.parallel:result is None
2023-11-07T11:20:34.219 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com
2023-11-07T11:20:34.220 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-07T11:20:34.247 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com
2023-11-07T11:20:34.248 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-07T11:20:34.273 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server
2023-11-07T11:20:34.273 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-11-07T11:20:34.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:20:34.343 DEBUG:teuthology.orchestra.run.smithi131:> true
2023-11-07T11:20:34.476 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com'
2023-11-07T11:20:34.477 DEBUG:teuthology.orchestra.run.smithi131:> uname -m
2023-11-07T11:20:34.535 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64
2023-11-07T11:20:34.536 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release
2023-11-07T11:20:34.594 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream"
2023-11-07T11:20:34.595 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8"
2023-11-07T11:20:34.595 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos"
2023-11-07T11:20:34.595 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora"
2023-11-07T11:20:34.595 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8"
2023-11-07T11:20:34.595 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-07T11:20:34.596 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-07T11:20:34.597 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-07T11:20:34.597 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server
2023-11-07T11:20:34.631 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server
2023-11-07T11:20:34.631 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-07T11:20:34.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-07T11:20:34.698 DEBUG:teuthology.orchestra.run.smithi154:> true
2023-11-07T11:20:34.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com'
2023-11-07T11:20:34.769 DEBUG:teuthology.orchestra.run.smithi154:> uname -m
2023-11-07T11:20:34.827 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64
2023-11-07T11:20:34.827 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release
2023-11-07T11:20:34.884 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream"
2023-11-07T11:20:34.885 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8"
2023-11-07T11:20:34.885 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos"
2023-11-07T11:20:34.885 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora"
2023-11-07T11:20:34.885 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8"
2023-11-07T11:20:34.885 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8"
2023-11-07T11:20:34.886 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-07T11:20:34.886 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31"
2023-11-07T11:20:34.886 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-07T11:20:34.886 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/"
2023-11-07T11:20:34.887 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-07T11:20:34.887 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-07T11:20:34.887 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-07T11:20:34.887 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server
2023-11-07T11:20:34.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:20:34.996 INFO:teuthology.dispatcher.supervisor:Running job 7450709
2023-11-07T11:20:34.997 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709 --name mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709/orig.config.yaml
2023-11-07T11:20:35.000 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709
2023-11-07T11:20:35.001 INFO:teuthology.dispatcher.supervisor:Job PID: 2345422
2023-11-07T11:20:35.001 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-07T11:22:35.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:24:35.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:26:35.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:28:35.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:30:35.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:32:35.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:34:36.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:36:36.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:38:36.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:40:36.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:42:36.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:44:36.910 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:46:37.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:48:37.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:50:37.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:52:37.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:54:37.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:56:37.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T11:58:38.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:00:38.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:02:38.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:04:38.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:06:38.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:08:38.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:10:38.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:12:39.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:14:39.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:16:39.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:18:39.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:20:39.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:22:39.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:24:40.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:26:40.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:28:40.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:30:40.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:32:40.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:34:40.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:36:41.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:38:41.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:40:41.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:42:41.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:44:42.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:46:42.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:48:42.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:50:42.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:52:42.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:54:43.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:56:43.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T12:58:43.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:00:43.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:02:43.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:04:43.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:06:44.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:08:44.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:10:44.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:12:44.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:14:44.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:16:44.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:18:45.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:20:45.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-07T13:20:45.378 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-07T13:20:45.809 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-07T13:20:45.810 INFO:teuthology.nuke:Checking targets against current locks
2023-11-07T13:20:45.863 DEBUG:teuthology.nuke:shortname: smithi131
2023-11-07T13:20:45.863 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-07T13:20:45.884 DEBUG:teuthology.nuke:shortname: smithi154
2023-11-07T13:20:45.885 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-07T13:20:45.890 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-07 11:15:26.884483', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMPHksqAWYAO2S+CJ4P4ysk+rtYfmOb+t81Vv7G66BkmdvLNcVosD3qwlCDnFb/ab6lX0vPcQKi3VFtB0OJDAWM='}
2023-11-07T13:20:45.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-07_11:13:41-fs-wip-mchangir-testing1-2023-11-07-1353-quincy-distro-default-smithi/7450709', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-07 11:15:26.883292', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPjXYxQqWH/cL4pt1SG7x/4qs9IdJC/0ubCpV3FJ/Tpyym3FfE9fKIjLK4659NochFbBVKPftb741IrjcqKBP2I='}
2023-11-07T13:20:45.939 INFO:teuthology.orchestra.console.smithi131:Power off
2023-11-07T13:20:45.940 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-07T13:20:45.956 INFO:teuthology.orchestra.console.smithi154:Power off
2023-11-07T13:20:45.957 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-07T13:20:45.969 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off
2023-11-07T13:20:45.970 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T13:20:45.984 DEBUG:teuthology.orchestra.console.smithi154:power off output: Chassis Power Control: Down/Off
2023-11-07T13:20:45.985 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-07T13:20:46.003 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off
2023-11-07T13:20:46.013 DEBUG:teuthology.orchestra.console.smithi154:check power output: Chassis Power is off
2023-11-07T13:20:46.104 INFO:teuthology.orchestra.console.smithi131:Power off completed
2023-11-07T13:20:46.115 INFO:teuthology.orchestra.console.smithi154:Power off completed
2023-11-07T13:20:46.252 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com
2023-11-07T13:20:46.261 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com