2023-09-01T10:35:29.275 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-01T10:35:29.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:35:29.408 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1df2763670>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1df3253670>, signals=[15])
2023-09-01T10:35:29.409 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-09-01T10:35:29.409 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-09-01T10:35:29.410 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-01T10:35:29.431 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging
2023-09-01T10:35:29.431 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server
2023-09-01T10:35:29.432 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-09-01T10:35:29.433 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-09-01T10:35:29.456 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"}
2023-09-01T10:35:29.505 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-01T10:35:29.520 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-01T10:35:29.548 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3)
2023-09-01T10:35:29.548 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3}
2023-09-01T10:35:29.566 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3)
2023-09-01T10:35:29.566 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 3}
2023-09-01T10:35:29.594 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-09-01T10:35:29.594 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:35:29.604 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream
2023-09-01T10:35:29.605 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:35:29.716 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-09-01T10:35:29.721 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"}
2023-09-01T10:35:29.757 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-09-01T10:35:29.760 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1}
2023-09-01T10:35:29.823 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:35:29.826 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:35:29.982 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-01T10:35:29.982 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-01T10:35:29.993 INFO:teuthology.orchestra.console.smithi192:Power off
2023-09-01T10:35:29.994 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-01T10:35:30.004 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-01T10:35:30.005 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:30.014 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-09-01T10:35:30.015 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:30.025 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-01T10:35:30.034 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-09-01T10:35:34.030 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:34.036 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:34.138 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-01T10:35:34.145 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-09-01T10:35:38.144 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:38.152 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:38.254 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-01T10:35:38.260 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-09-01T10:35:42.258 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:42.264 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:42.367 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-01T10:35:42.372 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-09-01T10:35:42.468 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-01T10:35:42.473 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-09-01T10:35:42.570 INFO:teuthology.orchestra.console.smithi098:Power on
2023-09-01T10:35:42.570 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-01T10:35:42.577 INFO:teuthology.orchestra.console.smithi192:Power on
2023-09-01T10:35:42.577 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-01T10:35:42.590 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2023-09-01T10:35:42.590 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:42.598 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On
2023-09-01T10:35:42.599 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:42.612 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-01T10:35:42.618 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-09-01T10:35:46.617 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:46.624 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T10:35:46.727 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-01T10:35:46.733 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on
2023-09-01T10:35:46.828 INFO:teuthology.orchestra.console.smithi098:Power on completed
2023-09-01T10:35:46.834 INFO:teuthology.orchestra.console.smithi192:Power on completed
2023-09-01T10:35:46.930 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-09-01T10:35:46.930 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:35:46.935 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2023-09-01T10:35:46.935 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:36:02.143 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:36:02.155 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:36:17.372 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:36:17.373 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:36:32.607 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:36:32.609 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:36:47.824 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:36:47.828 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:37:03.142 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:37:03.143 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:37:18.450 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:37:18.452 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:37:33.818 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:37:33.819 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:37:49.275 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:37:49.280 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:38:04.950 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:38:05.016 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:38:20.300 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:38:20.324 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:38:35.738 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:38:35.739 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:38:51.118 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:38:51.119 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:39:06.398 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:39:06.399 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:39:21.658 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:39:21.660 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:39:36.908 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:39:36.911 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:39:52.142 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:39:52.146 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:40:07.354 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-01T10:40:07.356 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:40:07.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:10.618 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:16.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:19.706 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:22.555 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None
2023-09-01T10:40:22.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:25.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:25.786 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:40:28.766 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:31.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:34.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:34.842 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:40:37.850 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:40.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:43.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:43.898 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:40:46.906 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:49.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:52.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:40:52.954 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:40:55.995 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-01T10:40:58.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:41:02.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:41:02.014 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:41:08.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:41:11.102 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:41:17.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:41:20.186 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192
2023-09-01T10:41:26.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:42:02.010 WARNING:teuthology.provision.fog.smithi098:timed out
2023-09-01T10:42:08.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:42:08.315 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-01T10:42:08.316 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-01T10:42:08.563 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-09-01T10:42:08.563 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-09-01T10:42:08.583 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2023-09-01T10:42:08.583 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2023-09-01T10:42:08.642 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2023-09-01T10:42:08.642 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-01T10:42:08.741 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2023-09-01T10:42:08.770 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2023-09-01T10:42:08.837 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2023-09-01T10:42:08.904 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-01T10:42:08.970 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-01T10:42:09.028 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-09-01T10:42:09.029 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-09-01T10:42:09.029 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-09-01T10:42:09.029 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-09-01T10:42:09.029 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-09-01T10:42:09.030 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-09-01T10:42:09.030 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-01T10:42:09.030 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-09-01T10:42:09.030 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-01T10:42:09.030 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-09-01T10:42:09.031 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-01T10:42:09.031 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-01T10:42:09.031 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-01T10:42:09.032 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-09-01T10:42:09.033 DEBUG:teuthology.parallel:result is None
2023-09-01T10:42:26.213 WARNING:teuthology.provision.fog.smithi192:timed out
2023-09-01T10:42:32.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:42:32.450 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-01T10:42:32.450 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-01T10:42:32.710 INFO:teuthology.provision.fog.smithi192:Node is ready
2023-09-01T10:42:32.711 DEBUG:teuthology.orchestra.run.smithi192:> hostname
2023-09-01T10:42:32.729 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2023-09-01T10:42:32.730 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts
2023-09-01T10:42:32.788 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2023-09-01T10:42:32.788 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-09-01T10:42:32.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts
2023-09-01T10:42:32.935 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts
2023-09-01T10:42:33.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname
2023-09-01T10:42:33.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192
2023-09-01T10:42:33.136 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-09-01T10:42:33.193 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2023-09-01T10:42:33.194 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8"
2023-09-01T10:42:33.194 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2023-09-01T10:42:33.194 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2023-09-01T10:42:33.194 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2023-09-01T10:42:33.195 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-01T10:42:33.196 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-01T10:42:33.196 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-01T10:42:33.196 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2023-09-01T10:42:33.197 DEBUG:teuthology.parallel:result is None
2023-09-01T10:42:33.341 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-09-01T10:42:33.342 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-01T10:42:33.360 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2023-09-01T10:42:33.360 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-01T10:42:33.377 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-09-01T10:42:33.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-01T10:42:33.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:42:33.444 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-09-01T10:42:33.576 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-01T10:42:33.577 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-09-01T10:42:33.635 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-09-01T10:42:33.635 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-01T10:42:33.693 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-09-01T10:42:33.693 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-09-01T10:42:33.693 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-09-01T10:42:33.693 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-09-01T10:42:33.694 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-09-01T10:42:33.694 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-09-01T10:42:33.694 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-01T10:42:33.694 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-09-01T10:42:33.694 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-01T10:42:33.695 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-09-01T10:42:33.695 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-01T10:42:33.695 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-01T10:42:33.695 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-01T10:42:33.696 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-01T10:42:33.718 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2023-09-01T10:42:33.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-09-01T10:42:33.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-01T10:42:33.784 DEBUG:teuthology.orchestra.run.smithi192:> true
2023-09-01T10:42:33.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com'
2023-09-01T10:42:33.852 DEBUG:teuthology.orchestra.run.smithi192:> uname -m
2023-09-01T10:42:33.909 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2023-09-01T10:42:33.910 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release
2023-09-01T10:42:33.967 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2023-09-01T10:42:33.968 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-01T10:42:33.969 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2023-09-01T10:42:33.969 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-01T10:42:33.969 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2023-09-01T10:42:33.969 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-01T10:42:33.969 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-01T10:42:33.970 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-01T10:42:33.970 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2023-09-01T10:42:33.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:42:34.085 INFO:teuthology.dispatcher.supervisor:Running job 7386028
2023-09-01T10:42:34.086 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi/7386028 --name dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} -- /home/teuthworker/archive/dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi/7386028/orig.config.yaml
2023-09-01T10:42:34.089 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi/7386028
2023-09-01T10:42:34.089 INFO:teuthology.dispatcher.supervisor:Job PID: 3105644
2023-09-01T10:42:34.090 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-01T10:44:34.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:46:34.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:48:34.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:50:34.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:52:34.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:54:34.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:56:34.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T10:58:35.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:00:35.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:02:35.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:04:35.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:06:35.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:08:35.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:10:35.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:12:35.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:14:36.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:16:36.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:18:36.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:20:36.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:22:36.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:24:36.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:26:36.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:28:36.907 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:30:37.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:32:37.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:34:37.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:36:37.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:38:37.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:40:37.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-01T11:40:37.999 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-01T11:40:38.107 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-01T11:40:38.107 INFO:teuthology.nuke:Checking targets against current locks
2023-09-01T11:40:38.159 DEBUG:teuthology.nuke:shortname: smithi098
2023-09-01T11:40:38.160 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-01T11:40:38.184 DEBUG:teuthology.nuke:shortname: smithi192
2023-09-01T11:40:38.184 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-01T11:40:38.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi/7386028', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 10:35:28.523959', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDWpAgK3fxDPAD8a4JK++lVri6Fl7Y7Wg6s5XA0cm07CS2B3SkBfreJvA4Ne+2s2dYw+RzO4+R7Xj64bsi6/jlkMUqOrt2IkQs6LcJ/C1s5EMYxaJ+78MywiMTJcBsopdmrmx9BeZjjZErLWQJjNATeAQ+bk37ZzaCGCrNY+w7MT0kUXfs1rG1Ur5ddZcxqB22Pa5KYygPXiUaGVImKM55vWRH02dpy/yj5K2wCw/iN8LbAj/F7dWISEhTIQNdKYUpJaCx6/CJzZaM05r7UEdawaxdUSsMySEU6uVNXBzCtqmIyTilVEC2oZf/GXzYHTrdZooIniIMVDk36JknyalPiLN5A9zlZNCeW1FvMuYsh1tPqzBAwrjxIc81ewDrXMLxgUD2cg6aHQ0Mv4N7YE1GyKTstv5F1fFZ5TjgDqlkBLlWnG0RhpKtrTTr8iZVd1QoXa0vgM1xcFbu1aSG/wmuJD92uRREmuaDBrjAYUTphkdrekJoU2n9Lng4Yxu6cQLc='}
2023-09-01T11:40:38.205 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2023-09-01_10:35:05-rbd-wip-dis-testing-distro-default-smithi/7386028', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 10:35:28.522040', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/zqSWzK/5SxykREtua6AASCKakaJK/LIMXRr6DLN+xLQaMOVC5pVz7SGVhCMIyq0wtHtF41KQL5pw2HRx2KWjjbR06iTep4NdIo+gUIKqcfkCdmoErCVYziNyg7a1Rsp5GnfmspvCFrRKD5TmsZ9EKeyPmN8PtMGCaOFzeLASfrJLROO0Rk9S8xuS5v6GH9NCDWogj6WJGVVkfbODiW4Dwg6uHOT4+rJ+aSjeYg/700TG1leGpymz3dHG1ljBRldYpeuneYmFzXfas8tnp/imKRSf9poBm+CF5p0NzQeCDWnfrtAXMsK8uaYrpv3QBrU5QT3VxQCeDv5CmHbQAsxd98siPip/11aalCLd3GGrnuQi5AZVZmtdOaAcoP4E4RWlg2oX0eTtn/cDKs+VZ4cbhnVribEJlW/c/NnfWWJ4h680zZgIBFhWdRkWrcy3LXccRKouXNzXo9K6+q12ruoIxiaWyLxiXnKSMFh75Xg4sY9LnPS0lilf+H/5E82/QDM='}
2023-09-01T11:40:38.237 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-01T11:40:38.238 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-01T11:40:38.254 INFO:teuthology.orchestra.console.smithi192:Power off
2023-09-01T11:40:38.255 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-01T11:40:38.275 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-01T11:40:38.276 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T11:40:38.284 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off
2023-09-01T11:40:38.284 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-01T11:40:38.296 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-01T11:40:38.304 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off
2023-09-01T11:40:38.397 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-01T11:40:38.406 INFO:teuthology.orchestra.console.smithi192:Power off completed
2023-09-01T11:40:38.551 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-09-01T11:40:38.558 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com