2024-01-18T18:54:06.360 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-18T18:54:06.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T18:54:06.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb8d8d6ef70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb8d9b53c10>, signals=[15])
2024-01-18T18:54:06.529 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging
2024-01-18T18:54:06.529 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server
2024-01-18T18:54:06.530 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-01-18T18:54:06.556 INFO:teuthology.lock.ops:Start node 'smithi089.front.sepia.ceph.com' reimaging
2024-01-18T18:54:06.556 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: reset os type and version on server
2024-01-18T18:54:06.556 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2024-01-18T18:54:06.581 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2024-01-18T18:54:06.581 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2024-01-18T18:54:06.581 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-01-18T18:54:06.678 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3)
2024-01-18T18:54:06.690 DEBUG:teuthology.provision.fog.smithi089:Requesting image smithi_centos_8.stream (ID 3)
2024-01-18T18:54:06.712 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_8.stream (ID 3)
2024-01-18T18:54:06.738 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream
2024-01-18T18:54:06.751 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream
2024-01-18T18:54:06.754 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream
2024-01-18T18:54:07.081 INFO:teuthology.orchestra.console.smithi089:Power off
2024-01-18T18:54:07.082 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T18:54:07.095 INFO:teuthology.orchestra.console.smithi107:Power off
2024-01-18T18:54:07.096 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T18:54:07.107 INFO:teuthology.orchestra.console.smithi049:Power off
2024-01-18T18:54:07.107 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T18:54:07.114 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2024-01-18T18:54:07.114 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:07.123 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-01-18T18:54:07.123 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:07.131 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2024-01-18T18:54:07.131 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:07.138 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2024-01-18T18:54:07.146 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-18T18:54:07.152 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2024-01-18T18:54:11.143 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:11.150 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:11.156 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:11.252 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2024-01-18T18:54:11.258 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-18T18:54:11.265 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2024-01-18T18:54:15.256 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:15.263 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:15.270 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:15.366 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-01-18T18:54:15.372 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-18T18:54:15.378 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-01-18T18:54:15.467 INFO:teuthology.orchestra.console.smithi089:Power off completed
2024-01-18T18:54:15.479 INFO:teuthology.orchestra.console.smithi049:Power off completed
2024-01-18T18:54:15.568 INFO:teuthology.orchestra.console.smithi089:Power on
2024-01-18T18:54:15.568 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-18T18:54:15.581 INFO:teuthology.orchestra.console.smithi049:Power on
2024-01-18T18:54:15.581 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-18T18:54:15.589 DEBUG:teuthology.orchestra.console.smithi089:power on output: Chassis Power Control: Up/On
2024-01-18T18:54:15.590 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:15.602 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On
2024-01-18T18:54:15.602 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:15.622 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-01-18T18:54:15.648 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-01-18T18:54:19.376 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:19.485 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-18T18:54:19.585 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-01-18T18:54:19.623 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:19.648 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:19.686 INFO:teuthology.orchestra.console.smithi107:Power on
2024-01-18T18:54:19.686 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-18T18:54:19.711 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2024-01-18T18:54:19.711 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:19.731 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-01-18T18:54:19.732 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-18T18:54:19.757 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-01-18T18:54:23.735 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:23.742 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:23.758 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T18:54:23.844 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on
2024-01-18T18:54:23.850 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2024-01-18T18:54:23.869 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is on
2024-01-18T18:54:23.946 INFO:teuthology.orchestra.console.smithi049:Power on completed
2024-01-18T18:54:23.951 INFO:teuthology.orchestra.console.smithi107:Power on completed
2024-01-18T18:54:23.971 INFO:teuthology.orchestra.console.smithi089:Power on completed
2024-01-18T18:54:24.047 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish
2024-01-18T18:54:24.051 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2024-01-18T18:54:24.071 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish
2024-01-18T18:57:09.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:09.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:28.380 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:57:28.380 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:57:34.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:34.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:37.436 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:57:37.468 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:57:40.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:43.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:43.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:46.496 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:57:46.528 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:57:52.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:52.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:57:55.580 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:57:55.580 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:57:58.588 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:01.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:01.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:04.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:04.636 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:58:07.644 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:10.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:13.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:13.696 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2024-01-18T18:58:16.700 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:19.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:20.092 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:58:22.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:25.756 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:26.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:29.152 WARNING:teuthology.provision.fog.smithi089:[Errno None] Unable to connect to port 22 on 172.21.15.89
2024-01-18T18:58:31.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:34.812 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:35.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:35.551 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-18T18:58:35.552 DEBUG:teuthology.orchestra.run.smithi089:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-18T18:58:40.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:43.868 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:49.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:58:52.924 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49
2024-01-18T18:58:58.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:59:01.004 INFO:teuthology.provision.fog.smithi089:Node is ready
2024-01-18T18:59:01.004 DEBUG:teuthology.orchestra.run.smithi089:> hostname
2024-01-18T18:59:01.028 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com
2024-01-18T18:59:01.028 DEBUG:teuthology.orchestra.run.smithi089:> grep smithi089.front.sepia.ceph.com /etc/hosts
2024-01-18T18:59:01.089 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089
2024-01-18T18:59:01.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2024-01-18T18:59:01.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hosts
2024-01-18T18:59:01.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/172.21.15.89/172.21.15.89/g' /etc/hosts
2024-01-18T18:59:01.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i -e 's/smithi089.front.sepia.ceph.com/smithi089/g' /etc/hostname
2024-01-18T18:59:01.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname smithi089
2024-01-18T18:59:01.475 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2024-01-18T18:59:01.534 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2024-01-18T18:59:01.534 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8"
2024-01-18T18:59:01.534 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T18:59:01.535 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T18:59:01.536 INFO:teuthology.provision.fog.smithi089:Deploy complete!
2024-01-18T18:59:01.537 DEBUG:teuthology.parallel:result is None
2024-01-18T18:59:19.721 WARNING:teuthology.provision.fog.smithi107:timed out
2024-01-18T18:59:25.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T18:59:25.987 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-18T18:59:25.988 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-18T18:59:26.240 INFO:teuthology.provision.fog.smithi107:Node is ready
2024-01-18T18:59:26.240 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2024-01-18T18:59:26.258 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2024-01-18T18:59:26.258 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2024-01-18T18:59:26.318 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2024-01-18T18:59:26.318 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-01-18T18:59:26.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2024-01-18T18:59:26.448 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2024-01-18T18:59:26.516 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2024-01-18T18:59:26.584 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2024-01-18T18:59:26.650 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-01-18T18:59:26.707 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-01-18T18:59:26.707 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8"
2024-01-18T18:59:26.707 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-01-18T18:59:26.707 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T18:59:26.708 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T18:59:26.708 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2024-01-18T18:59:26.709 DEBUG:teuthology.parallel:result is None
2024-01-18T18:59:58.960 WARNING:teuthology.provision.fog.smithi049:timed out
2024-01-18T19:00:04.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T19:00:05.219 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-18T19:00:05.219 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-18T19:00:05.475 INFO:teuthology.provision.fog.smithi049:Node is ready
2024-01-18T19:00:05.475 DEBUG:teuthology.orchestra.run.smithi049:> hostname
2024-01-18T19:00:05.492 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com
2024-01-18T19:00:05.492 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts
2024-01-18T19:00:05.551 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049
2024-01-18T19:00:05.551 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-01-18T19:00:05.645 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts
2024-01-18T19:00:05.673 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts
2024-01-18T19:00:05.743 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname
2024-01-18T19:00:05.813 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049
2024-01-18T19:00:05.882 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-01-18T19:00:05.941 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T19:00:05.942 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T19:00:05.943 INFO:teuthology.provision.fog.smithi049:Deploy complete!
2024-01-18T19:00:05.943 DEBUG:teuthology.parallel:result is None
2024-01-18T19:00:06.162 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com
2024-01-18T19:00:06.163 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-18T19:00:06.186 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com
2024-01-18T19:00:06.186 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-18T19:00:06.202 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2024-01-18T19:00:06.202 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-18T19:00:06.220 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server
2024-01-18T19:00:06.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-01-18T19:00:06.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T19:00:06.291 DEBUG:teuthology.orchestra.run.smithi049:> true
2024-01-18T19:00:06.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com'
2024-01-18T19:00:06.358 DEBUG:teuthology.orchestra.run.smithi049:> uname -m
2024-01-18T19:00:06.417 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64
2024-01-18T19:00:06.417 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/"
2024-01-18T19:00:06.476 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T19:00:06.477 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T19:00:06.477 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T19:00:06.477 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server
2024-01-18T19:00:06.502 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server
2024-01-18T19:00:06.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com'
2024-01-18T19:00:06.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T19:00:06.576 DEBUG:teuthology.orchestra.run.smithi089:> true
2024-01-18T19:00:06.716 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com'
2024-01-18T19:00:06.716 DEBUG:teuthology.orchestra.run.smithi089:> uname -m
2024-01-18T19:00:06.775 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64
2024-01-18T19:00:06.775 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T19:00:06.834 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T19:00:06.835 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server
2024-01-18T19:00:06.852 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2024-01-18T19:00:06.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-01-18T19:00:06.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-18T19:00:06.926 DEBUG:teuthology.orchestra.run.smithi107:> true
2024-01-18T19:00:07.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2024-01-18T19:00:07.063 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2024-01-18T19:00:07.122 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2024-01-18T19:00:07.122 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2024-01-18T19:00:07.180 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2024-01-18T19:00:07.180 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8"
2024-01-18T19:00:07.180 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-01-18T19:00:07.181 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-18T19:00:07.182 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2024-01-18T19:00:07.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:00:07.301 INFO:teuthology.dispatcher.supervisor:Running job 7520739
2024-01-18T19:00:07.301 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739 --name lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi --description rados:thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/read mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} -- /home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739/orig.config.yaml
2024-01-18T19:00:07.303 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739
2024-01-18T19:00:07.303 INFO:teuthology.dispatcher.supervisor:Job PID: 2559138
2024-01-18T19:00:07.304 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-18T19:02:07.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:04:07.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:06:07.724 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:08:07.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:10:08.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:12:08.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:14:08.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:16:08.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:18:08.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:20:08.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:22:08.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:24:09.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:26:09.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:28:09.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:30:09.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:32:09.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:34:09.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:36:09.940 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:38:10.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:40:10.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:42:10.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:44:10.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:46:10.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:48:10.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:50:11.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:52:11.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:54:11.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:56:11.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T19:58:11.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:00:11.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:02:12.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:04:12.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:06:12.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:08:12.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:10:12.676 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:12:12.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:14:13.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:16:13.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:18:13.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:20:13.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:22:13.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:24:13.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:26:13.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:28:13.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:30:14.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:32:14.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:34:14.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:36:14.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:38:14.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:40:15.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:42:15.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-18T20:42:15.330 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-18T20:42:15.518 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-18T20:42:15.518 INFO:teuthology.nuke:Checking targets against current locks
2024-01-18T20:42:15.566 DEBUG:teuthology.nuke:shortname: smithi049
2024-01-18T20:42:15.566 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-18T20:42:15.590 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 18:54:05.293261', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDlhEQN6e4EJFjxtyzNHtqy3nz7dT16ZLbNaVQo8bUnuI/YjdAGKLRLruDkjqPNBioFlmDFQZ3XfW07CsYUIoMU='}
2024-01-18T20:42:15.594 DEBUG:teuthology.nuke:shortname: smithi089
2024-01-18T20:42:15.594 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-18T20:42:15.616 DEBUG:teuthology.nuke:shortname: smithi107
2024-01-18T20:42:15.617 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-18T20:42:15.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 18:54:05.290576', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDrx6pL/3aJ1L36m+kwj/5+IMr5aP4dHPoKN9kko8S+uuuEvthgYJfDJ9JrCD1OFZ1Z25Xqjw3YZsFRrGq6lyO8='}
2024-01-18T20:42:15.636 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-18_18:42:27-rados:thrash-old-clients-wip-read-balancer-mgr-module-testing-distro-default-smithi/7520739', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-18 18:54:05.292147', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDKjIxR2EsfVvoSWt0+APOyWmUbzcWcVhSBZ9FxwLpTIbWklWtAkZksHFVIKWdG8MazoUYs7BJdghoB0AAqWArY='}
2024-01-18T20:42:15.652 INFO:teuthology.orchestra.console.smithi049:Power off
2024-01-18T20:42:15.652 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T20:42:15.666 INFO:teuthology.orchestra.console.smithi089:Power off
2024-01-18T20:42:15.667 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T20:42:15.677 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off
2024-01-18T20:42:15.678 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T20:42:15.686 DEBUG:teuthology.orchestra.console.smithi089:power off output: Chassis Power Control: Down/Off
2024-01-18T20:42:15.687 DEBUG:teuthology.orchestra.console.smithi089:pexpect command: ipmitool -H smithi089.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T20:42:15.702 INFO:teuthology.orchestra.console.smithi107:Power off
2024-01-18T20:42:15.702 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-18T20:42:15.710 DEBUG:teuthology.orchestra.console.smithi089:check power output: Chassis Power is off
2024-01-18T20:42:15.711 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off
2024-01-18T20:42:15.724 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2024-01-18T20:42:15.724 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-18T20:42:15.744 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2024-01-18T20:42:15.811 INFO:teuthology.orchestra.console.smithi089:Power off completed
2024-01-18T20:42:15.812 INFO:teuthology.orchestra.console.smithi049:Power off completed
2024-01-18T20:42:15.845 INFO:teuthology.orchestra.console.smithi107:Power off completed
2024-01-18T20:42:15.961 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com
2024-01-18T20:42:15.969 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com
2024-01-18T20:42:15.987 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com