2023-10-01T09:26:47.137 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-01T09:26:47.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:26:47.275 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fc2e16c1af0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fc2e1401ee0>, signals=[15])
2023-10-01T09:26:47.275 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging
2023-10-01T09:26:47.276 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T09:26:47.276 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-10-01T09:26:47.296 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2023-10-01T09:26:47.296 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T09:26:47.296 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-10-01T09:26:47.297 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /host {"name": "smithi057"}
2023-10-01T09:26:47.321 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /host {"name": "smithi181"}
2023-10-01T09:26:47.368 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-01T09:26:47.391 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-01T09:26:47.411 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-01T09:26:47.411 DEBUG:teuthology.provision.fog.smithi057:FOG request: PUT /host/162 {"imageID": 5}
2023-10-01T09:26:47.432 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-01T09:26:47.432 DEBUG:teuthology.provision.fog.smithi181:FOG request: PUT /host/286 {"imageID": 5}
2023-10-01T09:26:47.450 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of rhel 8.6
2023-10-01T09:26:47.450 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:26:47.475 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6
2023-10-01T09:26:47.475 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:26:47.491 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T09:26:47.513 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T09:26:47.530 DEBUG:teuthology.provision.fog.smithi057:FOG request: POST /host/162/task {"taskTypeID": 1}
2023-10-01T09:26:47.552 DEBUG:teuthology.provision.fog.smithi181:FOG request: POST /host/286/task {"taskTypeID": 1}
2023-10-01T09:26:47.583 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:26:47.604 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:26:47.681 INFO:teuthology.orchestra.console.smithi057:Power off
2023-10-01T09:26:47.682 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T09:26:47.694 INFO:teuthology.orchestra.console.smithi181:Power off
2023-10-01T09:26:47.695 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T09:26:47.702 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-10-01T09:26:47.703 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:47.714 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-10-01T09:26:47.714 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:47.724 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-01T09:26:47.733 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-10-01T09:26:47.826 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-10-01T09:26:47.834 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-10-01T09:26:47.927 INFO:teuthology.orchestra.console.smithi057:Power on
2023-10-01T09:26:47.927 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T09:26:47.935 INFO:teuthology.orchestra.console.smithi181:Power on
2023-10-01T09:26:47.936 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T09:26:47.948 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On
2023-10-01T09:26:47.949 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:47.956 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2023-10-01T09:26:47.957 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:47.970 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-01T09:26:47.975 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-10-01T09:26:51.973 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:51.979 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:52.081 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-01T09:26:52.086 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-10-01T09:26:56.082 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:56.088 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T09:26:56.190 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-10-01T09:26:56.198 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2023-10-01T09:26:56.292 INFO:teuthology.orchestra.console.smithi057:Power on completed
2023-10-01T09:26:56.299 INFO:teuthology.orchestra.console.smithi181:Power on completed
2023-10-01T09:26:56.392 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2023-10-01T09:26:56.393 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:26:56.400 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2023-10-01T09:26:56.400 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:27:11.461 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:27:11.462 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:27:26.530 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:27:26.531 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:27:41.598 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:27:41.600 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:27:56.662 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:27:56.663 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:28:11.720 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:28:11.721 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:28:26.790 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:28:26.791 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:28:41.854 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:28:41.855 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:28:56.928 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:28:56.930 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:29:12.006 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:29:12.007 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:29:27.078 DEBUG:teuthology.provision.fog.smithi181:FOG request: GET /task/active None
2023-10-01T09:29:27.080 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:29:27.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:29:27.428 ERROR:teuthology.orchestra.connection:Error authenticating with smithi181.front.sepia.ceph.com: Authentication failed.
2023-10-01T09:29:27.428 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T09:29:27.429 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T09:29:27.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-01T09:29:42.139 DEBUG:teuthology.provision.fog.smithi057:FOG request: GET /task/active None
2023-10-01T09:29:42.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:29:42.282 ERROR:teuthology.orchestra.connection:Error authenticating with smithi057.front.sepia.ceph.com: Authentication failed.
2023-10-01T09:29:42.283 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T09:29:42.283 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T09:29:42.283 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-10-01T09:31:26.715 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-01T09:31:26.715 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi181
2023-10-01T09:31:32.858 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-10-01T09:31:33.068 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi057
2023-10-01T09:31:35.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-10-01T09:31:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:31:36.032 DEBUG:teuthology.orchestra.run.smithi181:> true
2023-10-01T09:31:36.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-10-01T09:31:36.312 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T09:31:36.312 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T09:31:36.329 INFO:teuthology.provision.fog.smithi181:Node is ready
2023-10-01T09:31:36.329 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2023-10-01T09:31:36.387 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2023-10-01T09:31:36.387 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2023-10-01T09:31:36.444 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2023-10-01T09:31:36.445 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-10-01T09:31:36.578 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2023-10-01T09:31:36.606 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2023-10-01T09:31:36.673 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2023-10-01T09:31:36.739 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2023-10-01T09:31:36.805 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-10-01T09:31:36.861 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux"
2023-10-01T09:31:36.861 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-01T09:31:36.862 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T09:31:36.863 INFO:teuthology.orchestra.run.smithi181.stdout:
2023-10-01T09:31:36.863 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T09:31:36.863 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-01T09:31:36.863 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-01T09:31:36.863 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-01T09:31:36.864 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2023-10-01T09:31:36.865 DEBUG:teuthology.parallel:result is None
2023-10-01T09:31:42.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-01T09:31:42.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:31:42.305 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-10-01T09:31:42.636 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-01T09:31:42.636 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T09:31:42.636 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T09:31:42.655 INFO:teuthology.provision.fog.smithi057:Node is ready
2023-10-01T09:31:42.655 DEBUG:teuthology.orchestra.run.smithi057:> hostname
2023-10-01T09:31:42.714 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2023-10-01T09:31:42.714 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts
2023-10-01T09:31:42.773 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2023-10-01T09:31:42.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-10-01T09:31:42.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts
2023-10-01T09:31:42.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts
2023-10-01T09:31:42.996 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname
2023-10-01T09:31:43.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-10-01T09:31:43.133 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-10-01T09:31:43.190 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-10-01T09:31:43.190 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)"
2023-10-01T09:31:43.190 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-10-01T09:31:43.190 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-10-01T09:31:43.190 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-01T09:31:43.191 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-01T09:31:43.192 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-01T09:31:43.192 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2023-10-01T09:31:43.192 DEBUG:teuthology.parallel:result is None
2023-10-01T09:31:43.346 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2023-10-01T09:31:43.347 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T09:31:43.369 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2023-10-01T09:31:43.369 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T09:31:43.386 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2023-10-01T09:31:43.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-01T09:31:43.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:31:43.452 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-10-01T09:31:43.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-10-01T09:31:43.519 DEBUG:teuthology.orchestra.run.smithi057:> uname -m
2023-10-01T09:31:43.576 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2023-10-01T09:31:43.576 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-10-01T09:31:43.632 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="Red Hat Enterprise Linux"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8.6 (Ootpa)"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:ID="rhel"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="fedora"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8.6"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://www.redhat.com/"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T09:31:43.633 INFO:teuthology.orchestra.run.smithi057.stdout:
2023-10-01T09:31:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T09:31:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-01T09:31:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-01T09:31:43.634 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-01T09:31:43.634 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-10-01T09:31:43.661 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2023-10-01T09:31:43.661 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-10-01T09:31:43.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T09:31:43.727 DEBUG:teuthology.orchestra.run.smithi181:> true
2023-10-01T09:31:43.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2023-10-01T09:31:43.755 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2023-10-01T09:31:43.812 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2023-10-01T09:31:43.813 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2023-10-01T09:31:43.870 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux"
2023-10-01T09:31:43.870 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)"
2023-10-01T09:31:43.870 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T09:31:43.871 INFO:teuthology.orchestra.run.smithi181.stdout:
2023-10-01T09:31:43.872 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T09:31:43.872 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-01T09:31:43.872 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-01T09:31:43.872 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-01T09:31:43.872 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2023-10-01T09:31:43.894 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:31:44.003 INFO:teuthology.dispatcher.supervisor:Running job 7407986
2023-10-01T09:31:44.003 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7407986 --name teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7407986/orig.config.yaml
2023-10-01T09:31:44.006 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7407986
2023-10-01T09:31:44.006 INFO:teuthology.dispatcher.supervisor:Job PID: 1400092
2023-10-01T09:31:44.006 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-01T09:33:44.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:35:44.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:37:44.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:39:44.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:41:44.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:43:44.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:45:45.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:47:45.257 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:49:45.422 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:51:45.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:53:45.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:55:46.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:57:46.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T09:59:46.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:01:46.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:03:46.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:05:46.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:07:47.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:09:47.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:11:47.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:13:47.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:15:47.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:17:47.843 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:19:47.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:21:48.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:23:48.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:25:48.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:27:48.622 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:29:48.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:31:48.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:33:49.119 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:35:49.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:37:49.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:39:49.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:41:49.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:43:49.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:45:50.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:47:50.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:49:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:51:50.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:53:50.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:55:50.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:57:51.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T10:59:51.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T11:01:51.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T11:03:51.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T11:05:51.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T11:05:51.839 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-01T11:05:52.055 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-01T11:05:52.055 INFO:teuthology.nuke:Checking targets against current locks
2023-10-01T11:05:52.100 DEBUG:teuthology.nuke:shortname: smithi057
2023-10-01T11:05:52.101 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T11:05:52.116 DEBUG:teuthology.nuke:shortname: smithi181
2023-10-01T11:05:52.117 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T11:05:52.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7407986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 09:26:46.239072', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-01T11:05:52.143 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-30_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7407986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 09:26:46.237168', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-01T11:05:52.170 INFO:teuthology.orchestra.console.smithi057:Power off
2023-10-01T11:05:52.170 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T11:05:52.191 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-10-01T11:05:52.191 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T11:05:52.207 INFO:teuthology.orchestra.console.smithi181:Power off
2023-10-01T11:05:52.207 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T11:05:52.216 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-10-01T11:05:52.229 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2023-10-01T11:05:52.229 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T11:05:52.251 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2023-10-01T11:05:52.317 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-10-01T11:05:52.352 INFO:teuthology.orchestra.console.smithi181:Power off completed
2023-10-01T11:05:52.472 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2023-10-01T11:05:52.496 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com