2023-10-19T03:30:33.793 INFO:root:teuthology version: 0.0.1.dev201+g202b180
2023-10-19T03:30:33.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:30:33.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9e054ccaf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9e0526bee0>, signals=[15])
2023-10-19T03:30:33.940 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging
2023-10-19T03:30:33.940 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server
2023-10-19T03:30:33.940 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-10-19T03:30:33.959 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-10-19T03:30:33.960 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-10-19T03:30:33.960 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-10-19T03:30:33.961 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"}
2023-10-19T03:30:33.984 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-10-19T03:30:34.027 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-19T03:30:34.049 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-10-19T03:30:34.069 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-19T03:30:34.069 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 5}
2023-10-19T03:30:34.093 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_rhel_8.6 (ID 5)
2023-10-19T03:30:34.094 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 5}
2023-10-19T03:30:34.119 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6
2023-10-19T03:30:34.120 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:30:34.144 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of rhel 8.6
2023-10-19T03:30:34.145 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:30:34.195 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"}
2023-10-19T03:30:34.200 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-10-19T03:30:34.230 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1}
2023-10-19T03:30:34.234 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-10-19T03:30:34.286 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:30:34.289 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:30:34.404 INFO:teuthology.orchestra.console.smithi006:Power off
2023-10-19T03:30:34.405 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-19T03:30:34.418 INFO:teuthology.orchestra.console.smithi079:Power off
2023-10-19T03:30:34.418 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-19T03:30:34.427 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off
2023-10-19T03:30:34.427 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:34.439 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-10-19T03:30:34.440 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:34.451 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-10-19T03:30:34.461 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-19T03:30:34.552 INFO:teuthology.orchestra.console.smithi006:Power off completed
2023-10-19T03:30:34.562 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-10-19T03:30:34.654 INFO:teuthology.orchestra.console.smithi006:Power on
2023-10-19T03:30:34.654 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-19T03:30:34.663 INFO:teuthology.orchestra.console.smithi079:Power on
2023-10-19T03:30:34.664 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-19T03:30:34.675 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On
2023-10-19T03:30:34.675 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:34.685 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2023-10-19T03:30:34.686 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:34.696 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-10-19T03:30:34.705 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-19T03:30:38.699 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:38.707 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:38.809 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on
2023-10-19T03:30:38.818 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-19T03:30:38.910 INFO:teuthology.orchestra.console.smithi006:Power on completed
2023-10-19T03:30:39.011 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish
2023-10-19T03:30:39.012 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:30:42.822 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:30:42.931 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-10-19T03:30:43.032 INFO:teuthology.orchestra.console.smithi079:Power on completed
2023-10-19T03:30:43.133 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-10-19T03:30:43.133 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:30:54.094 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:30:58.234 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:31:09.186 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:31:13.323 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:31:24.294 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:31:28.410 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:31:39.382 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:31:43.494 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:31:54.470 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:31:58.574 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:32:09.545 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:32:13.645 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:32:24.630 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:32:28.726 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:32:39.717 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:32:43.802 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:32:54.806 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:32:58.866 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:33:09.874 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None
2023-10-19T03:33:09.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:13.934 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:33:28.315 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-10-19T03:33:28.996 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-10-19T03:33:29.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:34.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:37.406 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-10-19T03:33:43.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:46.490 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-10-19T03:33:47.518 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-19T03:33:52.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:53.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:33:55.546 WARNING:teuthology.provision.fog.smithi006:[Errno None] Unable to connect to port 22 on 172.21.15.6
2023-10-19T03:33:56.570 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-19T03:34:01.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:34:02.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:34:05.630 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-19T03:34:11.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:34:14.714 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-10-19T03:34:20.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:34:52.605 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-19T03:34:52.606 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-19T03:34:52.865 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-10-19T03:34:52.865 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-10-19T03:34:52.882 INFO:teuthology.orchestra.run.smithi079.stdout:smithi022
2023-10-19T03:34:52.883 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi022 /etc/hosts
2023-10-19T03:34:52.939 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-10-19T03:34:52.939 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-10-19T03:34:53.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi022/smithi079/g' /etc/hosts
2023-10-19T03:34:53.089 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.22/172.21.15.79/g' /etc/hosts
2023-10-19T03:34:53.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi022/smithi079/g' /etc/hostname
2023-10-19T03:34:53.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-10-19T03:34:53.289 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-10-19T03:34:53.345 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-10-19T03:34:53.346 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-10-19T03:34:53.346 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-10-19T03:34:53.346 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-10-19T03:34:53.346 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-10-19T03:34:53.347 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-10-19T03:34:53.347 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-19T03:34:53.347 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-10-19T03:34:53.347 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-19T03:34:53.347 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-10-19T03:34:53.348 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-19T03:34:53.348 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-19T03:34:53.348 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-10-19T03:34:53.348 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-19T03:34:53.348 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-19T03:34:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-19T03:34:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-19T03:34:53.350 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-10-19T03:34:53.351 DEBUG:teuthology.parallel:result is None
2023-10-19T03:35:01.558 WARNING:teuthology.provision.fog.smithi006:timed out
2023-10-19T03:35:07.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:35:07.918 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-19T03:35:07.919 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-19T03:35:08.396 INFO:teuthology.provision.fog.smithi006:Node is ready
2023-10-19T03:35:08.397 DEBUG:teuthology.orchestra.run.smithi006:> hostname
2023-10-19T03:35:08.417 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com
2023-10-19T03:35:08.417 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts
2023-10-19T03:35:08.477 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006
2023-10-19T03:35:08.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2023-10-19T03:35:08.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts
2023-10-19T03:35:08.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts
2023-10-19T03:35:08.699 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname
2023-10-19T03:35:08.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006
2023-10-19T03:35:08.837 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2023-10-19T03:35:08.894 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2023-10-19T03:35:08.895 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)"
2023-10-19T03:35:08.895 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2023-10-19T03:35:08.895 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2023-10-19T03:35:08.895 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6"
2023-10-19T03:35:08.896 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2023-10-19T03:35:08.896 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-19T03:35:08.896 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2023-10-19T03:35:08.896 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-19T03:35:08.896 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-19T03:35:08.897 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-19T03:35:08.898 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-19T03:35:08.898 INFO:teuthology.provision.fog.smithi006:Deploy complete!
2023-10-19T03:35:08.899 DEBUG:teuthology.parallel:result is None
2023-10-19T03:35:09.051 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com
2023-10-19T03:35:09.052 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-19T03:35:09.079 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2023-10-19T03:35:09.079 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-19T03:35:09.105 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server
2023-10-19T03:35:09.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-10-19T03:35:09.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:35:09.172 DEBUG:teuthology.orchestra.run.smithi006:> true
2023-10-19T03:35:09.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com'
2023-10-19T03:35:09.240 DEBUG:teuthology.orchestra.run.smithi006:> uname -m
2023-10-19T03:35:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64
2023-10-19T03:35:09.298 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release
2023-10-19T03:35:09.355 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux"
2023-10-19T03:35:09.355 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)"
2023-10-19T03:35:09.355 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel"
2023-10-19T03:35:09.355 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora"
2023-10-19T03:35:09.356 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6"
2023-10-19T03:35:09.356 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8"
2023-10-19T03:35:09.356 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-19T03:35:09.356 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31"
2023-10-19T03:35:09.356 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-19T03:35:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/"
2023-10-19T03:35:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-19T03:35:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-19T03:35:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:
2023-10-19T03:35:09.357 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-19T03:35:09.358 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-19T03:35:09.358 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-19T03:35:09.358 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-19T03:35:09.359 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server
2023-10-19T03:35:09.379 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2023-10-19T03:35:09.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-10-19T03:35:09.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-19T03:35:09.447 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-10-19T03:35:09.584 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-10-19T03:35:09.585 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2023-10-19T03:35:09.641 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2023-10-19T03:35:09.641 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-10-19T03:35:09.699 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Red Hat Enterprise Linux"
2023-10-19T03:35:09.699 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8.6 (Ootpa)"
2023-10-19T03:35:09.700 INFO:teuthology.orchestra.run.smithi079.stdout:ID="rhel"
2023-10-19T03:35:09.700 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="fedora"
2023-10-19T03:35:09.700 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8.6"
2023-10-19T03:35:09.700 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-10-19T03:35:09.700 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-10-19T03:35:09.701 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-10-19T03:35:09.701 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-10-19T03:35:09.701 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.redhat.com/"
2023-10-19T03:35:09.701 INFO:teuthology.orchestra.run.smithi079.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-10-19T03:35:09.701 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-19T03:35:09.702 INFO:teuthology.orchestra.run.smithi079.stdout:
2023-10-19T03:35:09.702 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-19T03:35:09.702 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-10-19T03:35:09.702 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-10-19T03:35:09.702 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-10-19T03:35:09.703 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-10-19T03:35:09.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:35:09.825 INFO:teuthology.dispatcher.supervisor:Running job 7432023
2023-10-19T03:35:09.826 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432023 --name teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/rhel_8.6_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432023/orig.config.yaml
2023-10-19T03:35:09.829 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432023
2023-10-19T03:35:09.830 INFO:teuthology.dispatcher.supervisor:Job PID: 2350288
2023-10-19T03:35:09.830 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-19T03:37:09.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:39:10.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:41:10.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:43:10.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:45:10.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:47:10.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:49:10.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:51:11.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:53:11.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-19T03:53:11.402 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-19T03:53:11.554 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-19T03:53:11.554 INFO:teuthology.nuke:Checking targets against current locks
2023-10-19T03:53:11.600 DEBUG:teuthology.nuke:shortname: smithi006
2023-10-19T03:53:11.601 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-19T03:53:11.623 DEBUG:teuthology.nuke:shortname: smithi079
2023-10-19T03:53:11.624 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-19T03:53:11.627 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432023', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:30:32.972928', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-19T03:53:11.652 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-19_02:25:06-upgrade:reef-x-main-distro-default-smithi/7432023', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-19 03:30:32.974829', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-10-19T03:53:11.683 INFO:teuthology.orchestra.console.smithi006:Power off
2023-10-19T03:53:11.684 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-19T03:53:11.705 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off
2023-10-19T03:53:11.706 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:53:11.720 INFO:teuthology.orchestra.console.smithi079:Power off
2023-10-19T03:53:11.721 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-19T03:53:11.729 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off
2023-10-19T03:53:11.742 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-10-19T03:53:11.742 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-19T03:53:11.763 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-10-19T03:53:11.831 INFO:teuthology.orchestra.console.smithi006:Power off completed
2023-10-19T03:53:11.864 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-10-19T03:53:11.992 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com
2023-10-19T03:53:12.008 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com