2023-11-23T02:56:35.864 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T02:56:35.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:56:35.999 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f914be4b8b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f914bb4bee0>, signals=[15])
2023-11-23T02:56:35.999 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2023-11-23T02:56:35.999 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:56:36.000 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2023-11-23T02:56:36.023 INFO:teuthology.lock.ops:Start node 'smithi193.front.sepia.ceph.com' reimaging
2023-11-23T02:56:36.023 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:56:36.023 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-11-23T02:56:36.139 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-23T02:56:36.164 DEBUG:teuthology.provision.fog.smithi193:Requesting image smithi_rhel_8.6 (ID 5)
2023-11-23T02:56:36.185 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of rhel 8.6
2023-11-23T02:56:36.208 INFO:teuthology.provision.fog.smithi193:Scheduling deploy of rhel 8.6
2023-11-23T02:56:36.398 INFO:teuthology.orchestra.console.smithi026:Power off
2023-11-23T02:56:36.398 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:56:36.413 INFO:teuthology.orchestra.console.smithi193:Power off
2023-11-23T02:56:36.414 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:56:36.422 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2023-11-23T02:56:36.422 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:36.435 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off
2023-11-23T02:56:36.436 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:36.442 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2023-11-23T02:56:36.456 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2023-11-23T02:56:36.544 INFO:teuthology.orchestra.console.smithi026:Power off completed
2023-11-23T02:56:36.557 INFO:teuthology.orchestra.console.smithi193:Power off completed
2023-11-23T02:56:36.645 INFO:teuthology.orchestra.console.smithi026:Power on
2023-11-23T02:56:36.645 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:56:36.658 INFO:teuthology.orchestra.console.smithi193:Power on
2023-11-23T02:56:36.658 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:56:36.667 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2023-11-23T02:56:36.667 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:36.678 DEBUG:teuthology.orchestra.console.smithi193:power on output: Chassis Power Control: Up/On
2023-11-23T02:56:36.679 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:36.688 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2023-11-23T02:56:36.698 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2023-11-23T02:56:40.691 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:40.699 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:40.799 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2023-11-23T02:56:40.807 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2023-11-23T02:56:40.901 INFO:teuthology.orchestra.console.smithi026:Power on completed
2023-11-23T02:56:41.001 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2023-11-23T02:56:44.811 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:56:44.919 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is on
2023-11-23T02:56:45.020 INFO:teuthology.orchestra.console.smithi193:Power on completed
2023-11-23T02:56:45.120 INFO:teuthology.provision.fog.smithi193:Waiting for deploy to finish
2023-11-23T02:59:11.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:14.818 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-11-23T02:59:20.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:23.874 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-11-23T02:59:29.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:30.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:32.930 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-11-23T02:59:33.986 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T02:59:38.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:39.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:41.986 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-11-23T02:59:43.042 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T02:59:47.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:49.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:51.042 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-11-23T02:59:52.098 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T02:59:57.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:59:58.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:01.154 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:07.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:10.210 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:16.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:19.270 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:25.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:28.998 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T03:00:28.999 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T03:00:29.414 INFO:teuthology.provision.fog.smithi026:Node is ready
2023-11-23T03:00:29.414 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2023-11-23T03:00:29.430 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2023-11-23T03:00:29.431 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2023-11-23T03:00:29.488 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2023-11-23T03:00:29.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2023-11-23T03:00:29.657 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2023-11-23T03:00:29.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2023-11-23T03:00:29.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2023-11-23T03:00:29.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2023-11-23T03:00:29.885 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2023-11-23T03:00:29.941 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T03:00:29.941 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T03:00:29.941 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T03:00:29.942 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T03:00:29.943 INFO:teuthology.orchestra.run.smithi026.stdout:
2023-11-23T03:00:29.943 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T03:00:29.943 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T03:00:29.943 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T03:00:29.943 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T03:00:29.943 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2023-11-23T03:00:29.945 DEBUG:teuthology.parallel:result is None
2023-11-23T03:00:31.394 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:37.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:40.450 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:46.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:49.506 WARNING:teuthology.provision.fog.smithi193:[Errno None] Unable to connect to port 22 on 172.21.15.193
2023-11-23T03:00:55.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:57.207 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T03:00:57.207 DEBUG:teuthology.orchestra.run.smithi193:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T03:00:57.476 INFO:teuthology.provision.fog.smithi193:Node is ready
2023-11-23T03:00:57.476 DEBUG:teuthology.orchestra.run.smithi193:> hostname
2023-11-23T03:00:57.492 INFO:teuthology.orchestra.run.smithi193.stdout:smithi022
2023-11-23T03:00:57.492 DEBUG:teuthology.orchestra.run.smithi193:> grep smithi022 /etc/hosts
2023-11-23T03:00:57.547 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-11-23T03:00:57.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-11-23T03:00:57.672 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi022/smithi193/g' /etc/hosts
2023-11-23T03:00:57.699 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/172.21.15.22/172.21.15.193/g' /etc/hosts
2023-11-23T03:00:57.765 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i -e 's/smithi022/smithi193/g' /etc/hostname
2023-11-23T03:00:57.831 DEBUG:teuthology.orchestra.run.smithi193:> sudo hostname smithi193
2023-11-23T03:00:57.898 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T03:00:57.955 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T03:00:57.956 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T03:00:57.956 INFO:teuthology.provision.fog.smithi193:Deploy complete!
2023-11-23T03:00:57.957 DEBUG:teuthology.parallel:result is None
2023-11-23T03:00:58.147 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2023-11-23T03:00:58.147 INFO:teuthology.lock.ops:Checking smithi193.front.sepia.ceph.com
2023-11-23T03:00:58.149 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2023-11-23T03:00:58.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-11-23T03:00:58.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:58.218 DEBUG:teuthology.orchestra.run.smithi026:> true
2023-11-23T03:00:58.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-11-23T03:00:58.353 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2023-11-23T03:00:58.411 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2023-11-23T03:00:58.411 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2023-11-23T03:00:58.470 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:
2023-11-23T03:00:58.471 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T03:00:58.472 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T03:00:58.472 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T03:00:58.472 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T03:00:58.472 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2023-11-23T03:00:58.496 INFO:teuthology.lock.ops:Updating [smithi193.front.sepia.ceph.com]: set os type and version on server
2023-11-23T03:00:58.496 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com'
2023-11-23T03:00:58.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T03:00:58.562 DEBUG:teuthology.orchestra.run.smithi193:> true
2023-11-23T03:00:58.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com'
2023-11-23T03:00:58.626 DEBUG:teuthology.orchestra.run.smithi193:> uname -m
2023-11-23T03:00:58.681 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64
2023-11-23T03:00:58.682 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="Red Hat Enterprise Linux"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="8.6 (Ootpa)"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:ID="rhel"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="fedora"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="8.6"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el8"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-11-23T03:00:58.738 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://www.redhat.com/"
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-23T03:00:58.739 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-11-23T03:00:58.739 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server
2023-11-23T03:00:58.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:00:58.868 INFO:teuthology.dispatcher.supervisor:Running job 7464563
2023-11-23T03:00:58.868 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464563 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464563/orig.config.yaml
2023-11-23T03:00:58.871 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464563
2023-11-23T03:00:58.871 INFO:teuthology.dispatcher.supervisor:Job PID: 686248
2023-11-23T03:00:58.871 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T03:02:58.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:04:59.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:06:59.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:08:59.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:10:59.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:12:59.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:15:00.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:17:00.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:19:00.456 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:21:00.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:23:00.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:25:00.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:27:01.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:27:01.189 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T03:27:01.323 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T03:27:01.323 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T03:27:01.373 DEBUG:teuthology.nuke:shortname: smithi026
2023-11-23T03:27:01.374 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:27:01.396 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464563', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:56:35.069645', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-23T03:27:01.399 DEBUG:teuthology.nuke:shortname: smithi193
2023-11-23T03:27:01.399 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T03:27:01.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464563', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:56:35.071482', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-11-23T03:27:01.443 INFO:teuthology.orchestra.console.smithi026:Power off
2023-11-23T03:27:01.443 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:27:01.464 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2023-11-23T03:27:01.465 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:27:01.479 INFO:teuthology.orchestra.console.smithi193:Power off
2023-11-23T03:27:01.480 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T03:27:01.487 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2023-11-23T03:27:01.500 DEBUG:teuthology.orchestra.console.smithi193:power off output: Chassis Power Control: Down/Off
2023-11-23T03:27:01.500 DEBUG:teuthology.orchestra.console.smithi193:pexpect command: ipmitool -H smithi193.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T03:27:01.521 DEBUG:teuthology.orchestra.console.smithi193:check power output: Chassis Power is off
2023-11-23T03:27:01.588 INFO:teuthology.orchestra.console.smithi026:Power off completed
2023-11-23T03:27:01.623 INFO:teuthology.orchestra.console.smithi193:Power off completed
2023-11-23T03:27:01.735 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com
2023-11-23T03:27:01.777 INFO:teuthology.lock.ops:unlocked: smithi193.front.sepia.ceph.com