2023-11-01T04:27:28.634 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-01T04:27:28.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:27:28.769 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f98a4c5db80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f98a49f7c10>, signals=[15])
2023-11-01T04:27:28.771 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2023-11-01T04:27:28.771 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T04:27:28.771 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-11-01T04:27:28.794 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-11-01T04:27:28.795 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T04:27:28.795 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-11-01T04:27:28.796 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"}
2023-11-01T04:27:28.819 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"}
2023-11-01T04:27:28.871 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T04:27:28.898 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T04:27:28.916 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T04:27:28.917 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 10}
2023-11-01T04:27:28.934 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T04:27:28.935 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 10}
2023-11-01T04:27:28.963 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream
2023-11-01T04:27:28.963 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:27:28.980 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream
2023-11-01T04:27:28.980 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:27:29.000 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T04:27:29.022 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T04:27:29.041 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1}
2023-11-01T04:27:29.056 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1}
2023-11-01T04:27:29.169 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:27:29.177 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:27:29.253 INFO:teuthology.orchestra.console.smithi019:Power off
2023-11-01T04:27:29.253 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T04:27:29.264 INFO:teuthology.orchestra.console.smithi124:Power off
2023-11-01T04:27:29.265 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T04:27:29.273 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2023-11-01T04:27:29.274 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:29.284 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-11-01T04:27:29.285 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:29.296 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-11-01T04:27:29.304 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-01T04:27:29.397 INFO:teuthology.orchestra.console.smithi019:Power off completed
2023-11-01T04:27:29.405 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-11-01T04:27:29.498 INFO:teuthology.orchestra.console.smithi019:Power on
2023-11-01T04:27:29.499 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T04:27:29.506 INFO:teuthology.orchestra.console.smithi124:Power on
2023-11-01T04:27:29.507 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T04:27:29.520 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On
2023-11-01T04:27:29.520 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:29.528 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-11-01T04:27:29.528 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:29.544 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-11-01T04:27:29.549 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-01T04:27:33.547 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:33.554 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:33.657 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-11-01T04:27:33.662 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-01T04:27:37.659 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:37.666 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T04:27:37.768 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on
2023-11-01T04:27:37.804 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-11-01T04:27:37.870 INFO:teuthology.orchestra.console.smithi019:Power on completed
2023-11-01T04:27:37.905 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-11-01T04:27:37.971 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2023-11-01T04:27:37.972 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:27:38.006 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-11-01T04:27:38.007 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:27:53.042 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:27:53.056 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:28:08.114 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:28:08.116 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:28:23.182 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:28:23.184 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:28:38.239 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:28:38.240 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:28:53.306 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:28:53.307 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:29:08.377 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:29:08.378 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:29:23.434 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:29:23.437 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:29:38.504 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:29:38.505 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:29:53.585 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:29:53.587 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:30:08.658 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:30:08.660 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-11-01T04:30:08.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:23.730 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-11-01T04:30:23.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:27.194 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-11-01T04:30:33.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:36.282 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-11-01T04:30:42.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:42.298 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-01T04:30:45.370 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-11-01T04:30:48.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:51.354 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-01T04:30:51.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:30:54.426 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-11-01T04:30:57.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:31:00.410 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-01T04:31:00.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:31:06.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:31:09.498 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-11-01T04:31:15.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:32:00.460 WARNING:teuthology.provision.fog.smithi019:timed out
2023-11-01T04:32:06.469 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:32:06.786 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T04:32:06.786 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T04:32:07.101 INFO:teuthology.provision.fog.smithi019:Node is ready
2023-11-01T04:32:07.102 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2023-11-01T04:32:07.117 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2023-11-01T04:32:07.117 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2023-11-01T04:32:07.172 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2023-11-01T04:32:07.173 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-11-01T04:32:07.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2023-11-01T04:32:07.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2023-11-01T04:32:07.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2023-11-01T04:32:07.452 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-11-01T04:32:07.522 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2023-11-01T04:32:07.577 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2023-11-01T04:32:07.577 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2023-11-01T04:32:07.577 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2023-11-01T04:32:07.577 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2023-11-01T04:32:07.578 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2023-11-01T04:32:07.578 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2023-11-01T04:32:07.578 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T04:32:07.578 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2023-11-01T04:32:07.578 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2023-11-01T04:32:07.579 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T04:32:07.579 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2023-11-01T04:32:07.579 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T04:32:07.579 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T04:32:07.579 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T04:32:07.580 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2023-11-01T04:32:07.581 DEBUG:teuthology.parallel:result is None
2023-11-01T04:32:15.515 WARNING:teuthology.provision.fog.smithi124:timed out
2023-11-01T04:32:21.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:32:21.742 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T04:32:21.743 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T04:32:22.080 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-11-01T04:32:22.080 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-11-01T04:32:22.095 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-11-01T04:32:22.095 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-11-01T04:32:22.150 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-11-01T04:32:22.150 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-11-01T04:32:22.263 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-11-01T04:32:22.290 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-11-01T04:32:22.356 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-11-01T04:32:22.423 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-11-01T04:32:22.490 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-11-01T04:32:22.544 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-11-01T04:32:22.544 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-11-01T04:32:22.544 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-11-01T04:32:22.545 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-11-01T04:32:22.545 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-11-01T04:32:22.545 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-11-01T04:32:22.545 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T04:32:22.545 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-11-01T04:32:22.546 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-11-01T04:32:22.546 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T04:32:22.546 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-11-01T04:32:22.546 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T04:32:22.547 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T04:32:22.547 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T04:32:22.547 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-11-01T04:32:22.548 DEBUG:teuthology.parallel:result is None
2023-11-01T04:32:22.711 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2023-11-01T04:32:22.712 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T04:32:22.740 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-11-01T04:32:22.740 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T04:32:22.757 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2023-11-01T04:32:22.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2023-11-01T04:32:22.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:32:22.857 DEBUG:teuthology.orchestra.run.smithi019:> true
2023-11-01T04:32:23.032 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com'
2023-11-01T04:32:23.033 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2023-11-01T04:32:23.087 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2023-11-01T04:32:23.087 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2023-11-01T04:32:23.142 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2023-11-01T04:32:23.142 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2023-11-01T04:32:23.142 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2023-11-01T04:32:23.142 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2023-11-01T04:32:23.143 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T04:32:23.144 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2023-11-01T04:32:23.144 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T04:32:23.144 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T04:32:23.144 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T04:32:23.145 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-11-01T04:32:23.165 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-11-01T04:32:23.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-11-01T04:32:23.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T04:32:23.246 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-11-01T04:32:23.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-11-01T04:32:23.312 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-11-01T04:32:23.366 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-11-01T04:32:23.366 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-11-01T04:32:23.420 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-11-01T04:32:23.420 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-11-01T04:32:23.420 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-11-01T04:32:23.420 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-11-01T04:32:23.421 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T04:32:23.422 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-11-01T04:32:23.422 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T04:32:23.422 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T04:32:23.422 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T04:32:23.423 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-11-01T04:32:23.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:32:23.533 INFO:teuthology.dispatcher.supervisor:Running job 7442319
2023-11-01T04:32:23.533 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442319 --name benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442319/orig.config.yaml
2023-11-01T04:32:23.536 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442319
2023-11-01T04:32:23.537 INFO:teuthology.dispatcher.supervisor:Job PID: 4139746
2023-11-01T04:32:23.537 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-01T04:34:23.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:36:23.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:38:24.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:40:24.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:42:24.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:44:24.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:46:24.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:48:24.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:50:24.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:52:25.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:54:25.328 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:56:25.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T04:58:25.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:00:25.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:02:25.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:04:26.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:06:26.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:08:26.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:10:26.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:12:26.781 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:14:26.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:16:27.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:18:27.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:20:27.458 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:22:27.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:24:27.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:26:27.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:28:28.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:30:28.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:32:28.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:34:28.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:36:28.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:38:28.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:40:29.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:42:29.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:44:29.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:46:29.714 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:48:29.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:50:30.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:52:30.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:54:30.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:56:30.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T05:58:30.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:00:31.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:02:31.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:04:31.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:06:31.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:08:32.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:10:32.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:12:32.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:14:32.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:16:32.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:18:33.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T06:18:33.071 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-01T06:18:33.297 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-01T06:18:33.298 INFO:teuthology.nuke:Checking targets against current locks
2023-11-01T06:18:33.349 DEBUG:teuthology.nuke:shortname: smithi019
2023-11-01T06:18:33.350 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T06:18:33.370 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 04:27:27.869288', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGBf+Wnj7G71Amf1Y1GHRY1faoCPz6rlOv/ChDk+9UxxghfJey8MP5H7VDorBQN5DZKoSrRO18VyRv0HKfFPtew='}
2023-11-01T06:18:33.374 DEBUG:teuthology.nuke:shortname: smithi124
2023-11-01T06:18:33.375 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T06:18:33.394 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/benhanokh-2023-10-31_16:43:39-rados-DBG_maintain_prefix_itr_2-distro-default-smithi/7442319', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 04:27:27.867604', 'locked_by': 'scheduled_benhanokh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpGgs+kp2kyXsPeHIsJS76273rwj870zTD5qncZOfdZXajncHe0JhYohOnBrCCtaKGECl9WivC3reOzf/QdBWQ='}
2023-11-01T06:18:33.420 INFO:teuthology.orchestra.console.smithi019:Power off
2023-11-01T06:18:33.420 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T06:18:33.442 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off
2023-11-01T06:18:33.442 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T06:18:33.456 INFO:teuthology.orchestra.console.smithi124:Power off
2023-11-01T06:18:33.457 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T06:18:33.466 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off
2023-11-01T06:18:33.479 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-11-01T06:18:33.479 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T06:18:33.501 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-11-01T06:18:33.567 INFO:teuthology.orchestra.console.smithi019:Power off completed
2023-11-01T06:18:33.602 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-11-01T06:18:33.728 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2023-11-01T06:18:33.745 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com