2023-07-28T18:59:40.827 INFO:root:teuthology version: 0.0.1.dev165+g3117e89
2023-07-28T18:59:40.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T18:59:40.829 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:00:06.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1797740dc0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1796e36310>, signals=[15])
2023-07-28T19:00:06.009 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2023-07-28T19:00:06.009 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2023-07-28T19:00:06.010 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2023-07-28T19:00:11.044 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-07-28T19:00:11.044 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-07-28T19:00:11.045 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-07-28T19:00:11.046 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"}
2023-07-28T19:00:21.103 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-07-28T19:00:28.440 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-28T19:00:35.503 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-28T19:00:40.510 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_8.stream (ID 3)
2023-07-28T19:00:40.510 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 3}
2023-07-28T19:00:45.559 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3)
2023-07-28T19:00:45.559 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3}
2023-07-28T19:00:50.566 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream
2023-07-28T19:00:50.566 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None
2023-07-28T19:00:55.593 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-07-28T19:00:55.593 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-28T19:00:55.617 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"}
2023-07-28T19:00:55.657 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1}
2023-07-28T19:00:55.663 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-07-28T19:00:55.698 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-07-28T19:00:55.709 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None
2023-07-28T19:00:55.762 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-28T19:01:05.809 INFO:teuthology.orchestra.console.smithi017:Power off
2023-07-28T19:01:05.810 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T19:01:10.880 INFO:teuthology.orchestra.console.smithi098:Power off
2023-07-28T19:01:10.881 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T19:01:10.903 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-07-28T19:01:10.905 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:10.928 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-07-28T19:01:14.932 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:15.844 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2023-07-28T19:01:15.845 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:16.041 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:16.855 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:20.043 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:20.856 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:21.153 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:21.968 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:25.154 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:25.264 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-07-28T19:01:25.365 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-07-28T19:01:25.465 INFO:teuthology.orchestra.console.smithi098:Power on
2023-07-28T19:01:25.466 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-28T19:01:25.487 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2023-07-28T19:01:25.488 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:25.509 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-07-28T19:01:25.969 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:27.079 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:29.512 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:29.622 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-07-28T19:01:31.081 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:32.192 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:33.624 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:34.735 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:36.196 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:37.306 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:38.736 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:39.847 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:41.308 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:41.419 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-07-28T19:01:41.520 INFO:teuthology.orchestra.console.smithi017:Power off completed
2023-07-28T19:01:41.621 INFO:teuthology.orchestra.console.smithi017:Power on
2023-07-28T19:01:41.621 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-28T19:01:43.851 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:44.962 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:46.647 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2023-07-28T19:01:46.648 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:47.656 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:48.964 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:50.076 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:51.660 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:52.772 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:54.079 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:55.192 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:01:56.775 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:01:57.887 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:01:59.195 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:00.309 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:02:01.888 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:02.999 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:02:04.311 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:05.422 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:02:07.002 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:08.116 DEBUG:teuthology.orchestra.console.smithi017:check power output: 
2023-07-28T19:02:09.424 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:10.535 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:02:12.117 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:12.229 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2023-07-28T19:02:12.330 INFO:teuthology.orchestra.console.smithi017:Power on completed
2023-07-28T19:02:12.431 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2023-07-28T19:02:12.432 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None
2023-07-28T19:02:12.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:14.539 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:15.568 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-07-28T19:02:15.648 DEBUG:teuthology.orchestra.console.smithi098:check power output: 
2023-07-28T19:02:19.649 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:02:19.760 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-07-28T19:02:19.861 INFO:teuthology.orchestra.console.smithi098:Power on completed
2023-07-28T19:02:19.962 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-07-28T19:02:19.963 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-07-28T19:02:24.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:25.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:28.052 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-07-28T19:02:28.080 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-28T19:02:34.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:39.061 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:44.065 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-07-28T19:02:47.120 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-28T19:02:50.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:53.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:02:58.131 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2023-07-28T19:03:01.201 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-07-28T19:03:04.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:03:07.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:03:12.582 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-28T19:03:12.583 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-28T19:03:13.049 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-07-28T19:03:13.049 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-07-28T19:03:13.067 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098
2023-07-28T19:03:13.067 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098 /etc/hosts
2023-07-28T19:03:13.125 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2023-07-28T19:03:13.125 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098 smithi098
2023-07-28T19:03:13.126 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-07-28T19:03:13.235 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098/smithi098/g' /etc/hosts
2023-07-28T19:03:13.281 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2023-07-28T19:03:13.352 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098/smithi098/g' /etc/hostname
2023-07-28T19:03:13.382 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-07-28T19:03:13.448 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-07-28T19:03:13.505 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-28T19:03:13.506 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-07-28T19:03:13.507 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-28T19:03:13.507 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-07-28T19:03:13.507 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-28T19:03:13.507 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-28T19:03:13.507 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-28T19:03:13.508 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-07-28T19:03:13.509 DEBUG:teuthology.parallel:result is None
2023-07-28T19:03:36.931 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-28T19:03:36.931 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-28T19:03:37.392 INFO:teuthology.provision.fog.smithi017:Node is ready
2023-07-28T19:03:37.393 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2023-07-28T19:03:37.413 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2023-07-28T19:03:37.414 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2023-07-28T19:03:37.474 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2023-07-28T19:03:37.475 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2023-07-28T19:03:37.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2023-07-28T19:03:37.635 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2023-07-28T19:03:37.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2023-07-28T19:03:37.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2023-07-28T19:03:37.850 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2023-07-28T19:03:37.911 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2023-07-28T19:03:37.912 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2023-07-28T19:03:37.912 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2023-07-28T19:03:37.912 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2023-07-28T19:03:37.913 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2023-07-28T19:03:37.913 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2023-07-28T19:03:37.913 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-28T19:03:37.914 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2023-07-28T19:03:37.914 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-28T19:03:37.914 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2023-07-28T19:03:37.915 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-28T19:03:37.915 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-28T19:03:37.915 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-28T19:03:37.916 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2023-07-28T19:03:37.917 DEBUG:teuthology.parallel:result is None
2023-07-28T19:03:43.106 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2023-07-28T19:03:43.107 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-28T19:03:48.138 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-07-28T19:03:48.141 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2023-07-28T19:03:48.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2023-07-28T19:03:48.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:03:48.222 DEBUG:teuthology.orchestra.run.smithi017:> true
2023-07-28T19:03:48.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com'
2023-07-28T19:03:48.291 DEBUG:teuthology.orchestra.run.smithi017:> uname -m
2023-07-28T19:03:48.351 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2023-07-28T19:03:48.352 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2023-07-28T19:03:48.412 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2023-07-28T19:03:48.413 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8"
2023-07-28T19:03:48.413 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2023-07-28T19:03:48.413 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2023-07-28T19:03:48.413 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8"
2023-07-28T19:03:48.413 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-28T19:03:48.414 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-28T19:03:48.415 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2023-07-28T19:03:53.447 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-07-28T19:03:53.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-28T19:03:53.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-28T19:03:58.525 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-07-28T19:03:58.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-07-28T19:03:58.665 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-07-28T19:03:58.724 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-07-28T19:03:58.725 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-07-28T19:03:58.784 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-07-28T19:03:58.784 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-07-28T19:03:58.784 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-07-28T19:03:58.784 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-07-28T19:03:58.785 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-28T19:03:58.786 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-28T19:03:58.786 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-28T19:03:58.786 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-07-28T19:04:01.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T19:04:01.862 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:04:01.971 INFO:teuthology.dispatcher.supervisor:Running job 7355490
2023-07-28T19:04:01.972 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355490 --name yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi --description rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} -- /home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355490/orig.config.yaml
2023-07-28T19:04:01.976 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355490
2023-07-28T19:04:01.977 INFO:teuthology.dispatcher.supervisor:Job PID: 18837
2023-07-28T19:04:01.977 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-28T19:06:02.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T19:06:02.079 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:08:04.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T19:08:04.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:10:09.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T19:10:09.857 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:12:15.034 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-28T19:12:15.034 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-28T19:12:20.107 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-28T19:12:30.251 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-28T19:12:30.251 INFO:teuthology.nuke:Checking targets against current locks
2023-07-28T19:12:39.240 DEBUG:teuthology.nuke:shortname: smithi017
2023-07-28T19:12:39.241 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-28T19:12:39.268 DEBUG:teuthology.nuke:shortname: smithi098
2023-07-28T19:12:39.269 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-28T19:12:39.271 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355490', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 18:59:28.357214', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWT8uEHxESLNV+8JP3tbRY3bKqLfT5CeUUo6tqYjLaAKVEO74NmoRowZXFyVzLyK0jBS8BfC+N5029d4eFKyPg='}
2023-07-28T19:12:39.295 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-28_14:25:29-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7355490', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-28 18:59:28.356032', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKxl9tIHBVO8OIvWyCKTws5yCDkNQZUr/m7POwC8lWM+qT3vbvpji4aOC2CDASMyTTSiwwFvahUexlOzb6Zn1WQ='}
2023-07-28T19:12:39.321 INFO:teuthology.orchestra.console.smithi017:Power off
2023-07-28T19:12:39.321 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T19:12:39.343 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2023-07-28T19:12:39.344 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:12:39.360 INFO:teuthology.orchestra.console.smithi098:Power off
2023-07-28T19:12:39.361 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-28T19:12:39.370 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2023-07-28T19:12:39.382 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-07-28T19:12:39.383 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-28T19:12:39.406 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-07-28T19:12:39.472 INFO:teuthology.orchestra.console.smithi017:Power off completed
2023-07-28T19:12:39.507 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-07-28T19:12:39.626 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com
2023-07-28T19:12:39.651 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com