2023-08-27T15:54:42.593 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-27T15:54:42.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T15:54:42.732 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f56e6deaa60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f56e78dd1f0>, signals=[15])
2023-08-27T15:54:42.732 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging
2023-08-27T15:54:42.733 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server
2023-08-27T15:54:42.733 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-08-27T15:54:42.756 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging
2023-08-27T15:54:42.756 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server
2023-08-27T15:54:42.756 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-08-27T15:54:42.757 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"}
2023-08-27T15:54:42.781 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /host {"name": "smithi138"}
2023-08-27T15:54:42.836 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-27T15:54:42.847 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-08-27T15:54:42.879 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-27T15:54:42.879 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 5}
2023-08-27T15:54:42.891 DEBUG:teuthology.provision.fog.smithi138:Requesting image smithi_rhel_8.6 (ID 5)
2023-08-27T15:54:42.891 DEBUG:teuthology.provision.fog.smithi138:FOG request: PUT /host/243 {"imageID": 5}
2023-08-27T15:54:42.926 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of rhel 8.6
2023-08-27T15:54:42.926 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:54:42.935 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of rhel 8.6
2023-08-27T15:54:42.936 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:54:42.992 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"}
2023-08-27T15:54:42.997 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /tasktype {"name": "deploy"}
2023-08-27T15:54:43.040 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1}
2023-08-27T15:54:43.043 DEBUG:teuthology.provision.fog.smithi138:FOG request: POST /host/243/task {"taskTypeID": 1}
2023-08-27T15:54:43.096 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:54:43.099 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:54:43.192 INFO:teuthology.orchestra.console.smithi112:Power off
2023-08-27T15:54:43.193 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T15:54:43.206 INFO:teuthology.orchestra.console.smithi138:Power off
2023-08-27T15:54:43.206 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T15:54:43.214 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off
2023-08-27T15:54:43.214 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:43.224 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-08-27T15:54:43.225 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:43.234 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-27T15:54:43.244 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-27T15:54:43.335 INFO:teuthology.orchestra.console.smithi112:Power off completed
2023-08-27T15:54:43.346 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-08-27T15:54:43.436 INFO:teuthology.orchestra.console.smithi112:Power on
2023-08-27T15:54:43.436 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-27T15:54:43.447 INFO:teuthology.orchestra.console.smithi138:Power on
2023-08-27T15:54:43.447 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-27T15:54:43.456 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On
2023-08-27T15:54:43.457 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:43.467 DEBUG:teuthology.orchestra.console.smithi138:power on output: Chassis Power Control: Up/On
2023-08-27T15:54:43.467 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:43.478 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-27T15:54:43.489 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-27T15:54:47.483 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:47.490 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:47.591 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off
2023-08-27T15:54:47.598 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on
2023-08-27T15:54:47.698 INFO:teuthology.orchestra.console.smithi138:Power on completed
2023-08-27T15:54:47.799 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish
2023-08-27T15:54:47.800 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:54:51.595 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T15:54:51.838 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on
2023-08-27T15:54:51.938 INFO:teuthology.orchestra.console.smithi112:Power on completed
2023-08-27T15:54:52.039 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish
2023-08-27T15:54:52.039 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:55:02.883 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:55:07.105 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:55:17.987 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:55:22.203 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:55:33.076 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:55:37.287 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:55:48.163 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:55:52.391 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:56:03.251 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:56:07.500 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:56:18.339 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:56:22.591 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:56:33.443 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:56:37.683 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:56:48.535 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:56:52.783 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:57:03.639 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:57:07.871 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:57:18.747 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:57:22.981 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:57:33.883 DEBUG:teuthology.provision.fog.smithi138:FOG request: GET /task/active None
2023-08-27T15:57:33.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:57:38.087 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None
2023-08-27T15:57:38.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:57:52.367 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-27T15:57:56.715 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-27T15:57:58.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:01.451 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-27T15:58:02.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:05.803 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-27T15:58:07.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:10.507 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-27T15:58:11.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:12.683 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-27T15:58:16.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:18.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:19.563 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-27T15:58:21.739 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112
2023-08-27T15:58:25.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:27.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:58:28.623 WARNING:teuthology.provision.fog.smithi138:[Errno None] Unable to connect to port 22 on 172.21.15.138
2023-08-27T15:58:34.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:59:27.795 WARNING:teuthology.provision.fog.smithi112:timed out
2023-08-27T15:59:33.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:59:33.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-27T15:59:33.866 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-27T15:59:33.930 INFO:teuthology.provision.fog.smithi112:Node is ready
2023-08-27T15:59:33.930 DEBUG:teuthology.orchestra.run.smithi112:> hostname
2023-08-27T15:59:33.988 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112
2023-08-27T15:59:33.988 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112 /etc/hosts
2023-08-27T15:59:34.045 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112
2023-08-27T15:59:34.045 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-08-27T15:59:34.111 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hosts
2023-08-27T15:59:34.178 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts
2023-08-27T15:59:34.245 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112/smithi112/g' /etc/hostname
2023-08-27T15:59:34.312 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112
2023-08-27T15:59:34.381 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2023-08-27T15:59:34.437 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-27T15:59:34.438 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-27T15:59:34.439 INFO:teuthology.provision.fog.smithi112:Deploy complete!
2023-08-27T15:59:34.440 DEBUG:teuthology.parallel:result is None
2023-08-27T15:59:34.629 WARNING:teuthology.provision.fog.smithi138:timed out
2023-08-27T15:59:40.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:59:40.987 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-27T15:59:40.988 DEBUG:teuthology.orchestra.run.smithi138:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-27T15:59:41.265 INFO:teuthology.provision.fog.smithi138:Node is ready
2023-08-27T15:59:41.265 DEBUG:teuthology.orchestra.run.smithi138:> hostname
2023-08-27T15:59:41.283 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138
2023-08-27T15:59:41.283 DEBUG:teuthology.orchestra.run.smithi138:> grep smithi138 /etc/hosts
2023-08-27T15:59:41.342 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138
2023-08-27T15:59:41.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-08-27T15:59:41.466 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138/smithi138/g' /etc/hosts
2023-08-27T15:59:41.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/172.21.15.138/172.21.15.138/g' /etc/hosts
2023-08-27T15:59:41.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i -e 's/smithi138/smithi138/g' /etc/hostname
2023-08-27T15:59:41.631 DEBUG:teuthology.orchestra.run.smithi138:> sudo hostname smithi138
2023-08-27T15:59:41.699 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-08-27T15:59:41.756 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2023-08-27T15:59:41.756 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)"
2023-08-27T15:59:41.756 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2023-08-27T15:59:41.756 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-27T15:59:41.757 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-27T15:59:41.758 INFO:teuthology.provision.fog.smithi138:Deploy complete!
2023-08-27T15:59:41.758 DEBUG:teuthology.parallel:result is None
2023-08-27T15:59:41.934 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com
2023-08-27T15:59:41.934 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-27T15:59:41.953 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com
2023-08-27T15:59:41.955 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server
2023-08-27T15:59:41.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-08-27T15:59:41.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:59:42.022 DEBUG:teuthology.orchestra.run.smithi112:> true
2023-08-27T15:59:42.090 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com'
2023-08-27T15:59:42.090 DEBUG:teuthology.orchestra.run.smithi112:> uname -m
2023-08-27T15:59:42.147 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64
2023-08-27T15:59:42.147 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release
2023-08-27T15:59:42.202 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="Red Hat Enterprise Linux"
2023-08-27T15:59:42.202 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="8.6 (Ootpa)"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:ID="rhel"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="fedora"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="8.6"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el8"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://www.redhat.com/"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:
2023-08-27T15:59:42.203 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T15:59:42.204 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-27T15:59:42.204 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-27T15:59:42.204 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-27T15:59:42.204 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server
2023-08-27T15:59:42.229 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server
2023-08-27T15:59:42.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-08-27T15:59:42.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T15:59:42.295 DEBUG:teuthology.orchestra.run.smithi138:> true
2023-08-27T15:59:42.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com'
2023-08-27T15:59:42.363 DEBUG:teuthology.orchestra.run.smithi138:> uname -m
2023-08-27T15:59:42.419 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64
2023-08-27T15:59:42.420 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release
2023-08-27T15:59:42.475 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Red Hat Enterprise Linux"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8.6 (Ootpa)"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:ID="rhel"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="fedora"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8.6"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.redhat.com/"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T15:59:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:
2023-08-27T15:59:42.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T15:59:42.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-08-27T15:59:42.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-08-27T15:59:42.477 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-08-27T15:59:42.477 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server
2023-08-27T15:59:42.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T15:59:42.595 INFO:teuthology.dispatcher.supervisor:Running job 7381623
2023-08-27T15:59:42.595 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381623 --name rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} -- /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381623/orig.config.yaml
2023-08-27T15:59:42.598 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381623
2023-08-27T15:59:42.598 INFO:teuthology.dispatcher.supervisor:Job PID: 220052
2023-08-27T15:59:42.598 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-27T16:01:42.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:03:42.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:05:43.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:07:43.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:09:43.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:11:43.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:13:43.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:15:43.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:17:44.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:19:44.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:21:44.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:23:44.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:25:44.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:27:44.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:29:45.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:31:45.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:33:45.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:35:45.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:37:45.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:39:45.770 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:41:45.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:43:46.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:45:46.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:47:46.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:49:46.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:51:46.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:53:46.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:55:47.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:57:47.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T16:59:47.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:01:47.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:03:47.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:05:47.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:07:48.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:09:48.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T17:09:48.319 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-08-27T17:09:48.441 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi112 but it was locked by another job: /home/teuthworker/archive/teuthology-2023-08-26_14:23:13-upgrade:quincy-x-reef-distro-default-smithi/7381698
2023-08-27T17:09:48.441 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-27T17:09:48.441 INFO:teuthology.nuke:Checking targets against current locks
2023-08-27T17:09:48.461 INFO:teuthology.nuke:Not nuking smithi112.front.sepia.ceph.com because description doesn't match: rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi != /home/teuthworker/archive/teuthology-2023-08-26_14:23:13-upgrade:quincy-x-reef-distro-default-smithi/7381698
2023-08-27T17:09:48.504 DEBUG:teuthology.nuke:shortname: smithi138
2023-08-27T17:09:48.505 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-27T17:09:48.528 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-26_02:16:12-fs-wip-rishabh-xiubo-wip-57154-testing-default-smithi/7381623', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 15:54:41.691477', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-08-27T17:09:48.575 INFO:teuthology.orchestra.console.smithi138:Power off
2023-08-27T17:09:48.575 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T17:09:48.601 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off
2023-08-27T17:09:48.601 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T17:09:48.620 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off
2023-08-27T17:09:48.721 INFO:teuthology.orchestra.console.smithi138:Power off completed
2023-08-27T17:09:48.869 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com
2023-08-27T17:09:48.870 ERROR:teuthology.nuke:Could not nuke the following targets:
targets:
  smithi112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=