2023-09-23T00:47:55.240 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-23T00:47:55.240 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T00:47:55.367 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7849f74b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f784aa79670>, signals=[15])
2023-09-23T00:47:55.368 INFO:teuthology.lock.ops:Start node 'smithi052.front.sepia.ceph.com' reimaging
2023-09-23T00:47:55.368 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T00:47:55.368 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-09-23T00:47:55.394 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging
2023-09-23T00:47:55.395 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server
2023-09-23T00:47:55.395 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2023-09-23T00:47:55.396 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /host {"name": "smithi052"}
2023-09-23T00:47:55.419 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"}
2023-09-23T00:47:55.488 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-23T00:47:55.508 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-23T00:47:55.536 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-23T00:47:55.536 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 5}
2023-09-23T00:47:55.553 DEBUG:teuthology.provision.fog.smithi052:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-23T00:47:55.553 DEBUG:teuthology.provision.fog.smithi052:FOG request: PUT /host/157 {"imageID": 5}
2023-09-23T00:47:55.591 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of rhel 8.6
2023-09-23T00:47:55.591 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:47:55.606 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of rhel 8.6
2023-09-23T00:47:55.606 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:47:55.670 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T00:47:55.674 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"}
2023-09-23T00:47:55.706 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1}
2023-09-23T00:47:55.709 DEBUG:teuthology.provision.fog.smithi052:FOG request: POST /host/157/task {"taskTypeID": 1}
2023-09-23T00:47:55.785 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:47:55.788 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:47:55.894 INFO:teuthology.orchestra.console.smithi052:Power off
2023-09-23T00:47:55.894 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T00:47:55.905 INFO:teuthology.orchestra.console.smithi059:Power off
2023-09-23T00:47:55.905 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T00:47:55.914 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-09-23T00:47:55.914 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:47:55.925 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2023-09-23T00:47:55.925 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:47:55.933 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-23T00:47:55.945 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-23T00:47:56.034 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-09-23T00:47:56.046 INFO:teuthology.orchestra.console.smithi059:Power off completed
2023-09-23T00:47:56.135 INFO:teuthology.orchestra.console.smithi052:Power on
2023-09-23T00:47:56.136 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T00:47:56.147 INFO:teuthology.orchestra.console.smithi059:Power on
2023-09-23T00:47:56.148 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-23T00:47:56.156 DEBUG:teuthology.orchestra.console.smithi052:power on output: Chassis Power Control: Up/On
2023-09-23T00:47:56.156 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:47:56.167 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On
2023-09-23T00:47:56.167 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:47:56.177 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-23T00:47:56.187 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-23T00:48:00.182 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:48:00.188 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T00:48:00.290 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is on
2023-09-23T00:48:00.296 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on
2023-09-23T00:48:00.392 INFO:teuthology.orchestra.console.smithi052:Power on completed
2023-09-23T00:48:00.454 INFO:teuthology.orchestra.console.smithi059:Power on completed
2023-09-23T00:48:00.555 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2023-09-23T00:48:00.555 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:48:00.557 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish
2023-09-23T00:48:00.557 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:48:15.642 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:48:15.643 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:48:30.726 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:48:30.727 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:48:45.818 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:48:45.819 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:49:00.914 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:49:00.916 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:49:16.014 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:49:16.015 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:49:31.104 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:49:31.105 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:49:46.194 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:49:46.195 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:50:01.279 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:50:01.280 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:50:16.354 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:50:16.355 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:50:31.434 DEBUG:teuthology.provision.fog.smithi052:FOG request: GET /task/active None
2023-09-23T00:50:31.437 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None
2023-09-23T00:50:31.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:50:31.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:50:32.499 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: Authentication failed.
2023-09-23T00:50:32.500 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T00:50:32.500 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T00:50:32.501 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-09-23T00:50:49.854 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2023-09-23T00:50:55.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:50:58.910 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2023-09-23T00:51:04.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:51:07.962 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2023-09-23T00:51:13.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:51:17.022 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2023-09-23T00:51:23.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:51:26.078 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59
2023-09-23T00:51:32.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:52:32.081 WARNING:teuthology.provision.fog.smithi059:timed out
2023-09-23T00:52:38.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:52:38.323 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T00:52:38.323 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T00:52:38.704 INFO:teuthology.provision.fog.smithi059:Node is ready
2023-09-23T00:52:38.705 DEBUG:teuthology.orchestra.run.smithi059:> hostname
2023-09-23T00:52:38.724 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com
2023-09-23T00:52:38.724 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts
2023-09-23T00:52:38.783 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059
2023-09-23T00:52:38.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2023-09-23T00:52:38.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts
2023-09-23T00:52:38.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts
2023-09-23T00:52:39.037 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname
2023-09-23T00:52:39.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059
2023-09-23T00:52:39.175 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2023-09-23T00:52:39.232 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-23T00:52:39.233 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T00:52:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:
2023-09-23T00:52:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T00:52:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-23T00:52:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-23T00:52:39.234 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-23T00:52:39.234 INFO:teuthology.provision.fog.smithi059:Deploy complete!
2023-09-23T00:52:39.235 DEBUG:teuthology.parallel:result is None
2023-09-23T00:52:45.306 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-09-23T00:52:45.307 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi052
2023-09-23T00:52:54.314 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-23T00:52:54.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:52:54.652 DEBUG:teuthology.orchestra.run.smithi052:> true
2023-09-23T00:52:54.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-23T00:52:54.971 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-23T00:52:54.971 DEBUG:teuthology.orchestra.run.smithi052:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-23T00:52:54.989 INFO:teuthology.provision.fog.smithi052:Node is ready
2023-09-23T00:52:54.989 DEBUG:teuthology.orchestra.run.smithi052:> hostname
2023-09-23T00:52:55.048 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2023-09-23T00:52:55.048 DEBUG:teuthology.orchestra.run.smithi052:> grep smithi052.front.sepia.ceph.com /etc/hosts
2023-09-23T00:52:55.107 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2023-09-23T00:52:55.107 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-09-23T00:52:55.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hosts
2023-09-23T00:52:55.251 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/172.21.15.52/172.21.15.52/g' /etc/hosts
2023-09-23T00:52:55.320 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i -e 's/smithi052.front.sepia.ceph.com/smithi052/g' /etc/hostname
2023-09-23T00:52:55.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo hostname smithi052
2023-09-23T00:52:55.457 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-09-23T00:52:55.513 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux"
2023-09-23T00:52:55.513 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-23T00:52:55.514 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T00:52:55.515 INFO:teuthology.orchestra.run.smithi052.stdout:
2023-09-23T00:52:55.515 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T00:52:55.515 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-23T00:52:55.515 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-23T00:52:55.515 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-23T00:52:55.515 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2023-09-23T00:52:55.515 DEBUG:teuthology.parallel:result is None
2023-09-23T00:52:55.664 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2023-09-23T00:52:55.665 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-23T00:52:55.693 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com
2023-09-23T00:52:55.693 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-23T00:52:55.719 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2023-09-23T00:52:55.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-23T00:52:55.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:52:55.786 DEBUG:teuthology.orchestra.run.smithi052:> true
2023-09-23T00:52:55.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com'
2023-09-23T00:52:55.851 DEBUG:teuthology.orchestra.run.smithi052:> uname -m
2023-09-23T00:52:55.909 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2023-09-23T00:52:55.909 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Red Hat Enterprise Linux"
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="8.6 (Ootpa)"
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:ID="rhel"
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE="fedora"
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="8.6"
2023-09-23T00:52:55.967 INFO:teuthology.orchestra.run.smithi052.stdout:PLATFORM_ID="platform:el8"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:ANSI_COLOR="0;31"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.redhat.com/"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-23T00:52:55.968 INFO:teuthology.orchestra.run.smithi052.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-23T00:52:55.969 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2023-09-23T00:52:55.993 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server
2023-09-23T00:52:55.993 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-23T00:52:55.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-23T00:52:56.061 DEBUG:teuthology.orchestra.run.smithi059:> true
2023-09-23T00:52:56.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com'
2023-09-23T00:52:56.197 DEBUG:teuthology.orchestra.run.smithi059:> uname -m
2023-09-23T00:52:56.255 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64
2023-09-23T00:52:56.255 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release
2023-09-23T00:52:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux"
2023-09-23T00:52:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.6 (Ootpa)"
2023-09-23T00:52:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel"
2023-09-23T00:52:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora"
2023-09-23T00:52:56.313 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.6"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:
2023-09-23T00:52:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-23T00:52:56.315 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-23T00:52:56.315 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-23T00:52:56.315 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-23T00:52:56.315 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server
2023-09-23T00:52:56.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T00:52:56.437 INFO:teuthology.dispatcher.supervisor:Running job 7401417
2023-09-23T00:52:56.437 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi/7401417 --name cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} -- /home/teuthworker/archive/cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi/7401417/orig.config.yaml
2023-09-23T00:52:56.440 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi/7401417
2023-09-23T00:52:56.440 INFO:teuthology.dispatcher.supervisor:Job PID: 124797
2023-09-23T00:52:56.440 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-23T00:54:56.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T00:56:56.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T00:58:56.578 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:00:56.644 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:02:56.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:04:56.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:06:56.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:08:56.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:10:56.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:12:57.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:14:57.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:16:57.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:18:57.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:20:57.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-23T01:20:57.532 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-23T01:20:57.633 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-23T01:20:57.633 INFO:teuthology.nuke:Checking targets against current locks
2023-09-23T01:20:57.678 DEBUG:teuthology.nuke:shortname: smithi052
2023-09-23T01:20:57.679 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T01:20:57.696 DEBUG:teuthology.nuke:shortname: smithi059
2023-09-23T01:20:57.696 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-23T01:20:57.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi/7401417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 00:47:54.453636', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-23T01:20:57.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-09-23_00:08:54-rgw-wip-58750-distro-default-smithi/7401417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-23 00:47:54.451745', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-23T01:20:57.745 INFO:teuthology.orchestra.console.smithi052:Power off
2023-09-23T01:20:57.746 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T01:20:57.765 DEBUG:teuthology.orchestra.console.smithi052:power off output: Chassis Power Control: Down/Off
2023-09-23T01:20:57.765 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: ipmitool -H smithi052.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T01:20:57.777 INFO:teuthology.orchestra.console.smithi059:Power off
2023-09-23T01:20:57.778 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-23T01:20:57.785 DEBUG:teuthology.orchestra.console.smithi052:check power output: Chassis Power is off
2023-09-23T01:20:57.797 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off
2023-09-23T01:20:57.797 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-23T01:20:57.815 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off
2023-09-23T01:20:57.886 INFO:teuthology.orchestra.console.smithi052:Power off completed
2023-09-23T01:20:57.916 INFO:teuthology.orchestra.console.smithi059:Power off completed
2023-09-23T01:20:58.040 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2023-09-23T01:20:58.065 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com