2023-07-10T23:25:24.719 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-10T23:25:24.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:25:24.723 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:25:24.890 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fa80b3625e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fa80c5818b0>, signals=[15])
2023-07-10T23:25:24.893 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-07-10T23:25:24.893 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-07-10T23:25:24.894 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-07-10T23:25:24.919 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging
2023-07-10T23:25:24.919 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server
2023-07-10T23:25:24.919 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-07-10T23:25:24.920 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"}
2023-07-10T23:25:24.943 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"}
2023-07-10T23:25:24.995 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-10T23:25:25.013 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-07-10T23:25:25.035 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-10T23:25:25.035 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5}
2023-07-10T23:25:25.054 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_rhel_8.6 (ID 5)
2023-07-10T23:25:25.054 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 5}
2023-07-10T23:25:25.077 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6
2023-07-10T23:25:25.077 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:25:25.096 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of rhel 8.6
2023-07-10T23:25:25.096 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:25:25.113 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"}
2023-07-10T23:25:25.132 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"}
2023-07-10T23:25:25.148 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1}
2023-07-10T23:25:25.166 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1}
2023-07-10T23:25:25.201 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:25:25.208 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:25:25.292 INFO:teuthology.orchestra.console:Power off smithi033
2023-07-10T23:25:25.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-10T23:25:25.309 INFO:teuthology.orchestra.console:Power off smithi144
2023-07-10T23:25:25.310 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-10T23:25:25.320 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:25.331 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:25.445 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-07-10T23:25:25.454 INFO:teuthology.orchestra.console:Power off for smithi144 completed
2023-07-10T23:25:25.547 INFO:teuthology.orchestra.console:Power on smithi033
2023-07-10T23:25:25.548 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-10T23:25:25.562 INFO:teuthology.orchestra.console:Power on smithi144
2023-07-10T23:25:25.563 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-10T23:25:25.582 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:25.604 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:29.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:29.647 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:25:29.851 INFO:teuthology.orchestra.console:Power on for smithi033 completed
2023-07-10T23:25:29.859 INFO:teuthology.orchestra.console:Power on for smithi144 completed
2023-07-10T23:25:29.953 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-07-10T23:25:29.954 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:25:29.960 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish
2023-07-10T23:25:29.961 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:25:45.020 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:25:45.021 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:26:00.080 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:26:00.081 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:26:15.152 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:26:15.154 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:26:30.220 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:26:30.221 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:26:45.296 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:26:45.297 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:27:00.376 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:27:00.378 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:27:15.456 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:27:15.458 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:27:30.544 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:27:30.546 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:27:45.628 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:27:45.629 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:28:00.712 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:28:00.713 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-07-10T23:28:00.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:03.824 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-10T23:28:09.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:12.880 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-10T23:28:15.776 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None
2023-07-10T23:28:15.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:18.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:18.900 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:28:21.936 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-10T23:28:24.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:27.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:27.988 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:28:30.992 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-10T23:28:33.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:36.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:37.072 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:28:40.080 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-07-10T23:28:43.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:46.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:46.128 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:28:52.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:28:55.216 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:29:01.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:29:04.272 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144
2023-07-10T23:29:10.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:29:46.120 WARNING:teuthology.provision.fog.smithi033:timed out
2023-07-10T23:29:52.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:29:52.488 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-10T23:29:52.489 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-10T23:29:52.815 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-07-10T23:29:52.816 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2023-07-10T23:29:52.835 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2023-07-10T23:29:52.836 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts
2023-07-10T23:29:52.896 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2023-07-10T23:29:52.896 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-07-10T23:29:53.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts
2023-07-10T23:29:53.046 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts
2023-07-10T23:29:53.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname
2023-07-10T23:29:53.185 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-07-10T23:29:53.253 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-07-10T23:29:53.310 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-07-10T23:29:53.310 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-07-10T23:29:53.310 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-10T23:29:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-10T23:29:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-10T23:29:53.313 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2023-07-10T23:29:53.314 DEBUG:teuthology.parallel:result is None
2023-07-10T23:30:10.292 WARNING:teuthology.provision.fog.smithi144:timed out
2023-07-10T23:30:16.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:30:16.636 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-10T23:30:16.637 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-10T23:30:16.904 INFO:teuthology.provision.fog.smithi144:Node is ready
2023-07-10T23:30:16.904 DEBUG:teuthology.orchestra.run.smithi144:> hostname
2023-07-10T23:30:16.922 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com
2023-07-10T23:30:16.923 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts
2023-07-10T23:30:16.980 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144
2023-07-10T23:30:16.981 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-10T23:30:17.112 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts
2023-07-10T23:30:17.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts
2023-07-10T23:30:17.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname
2023-07-10T23:30:17.277 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144
2023-07-10T23:30:17.344 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-07-10T23:30:17.401 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-10T23:30:17.402 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:
2023-07-10T23:30:17.403 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-10T23:30:17.404 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-10T23:30:17.404 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-10T23:30:17.404 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-10T23:30:17.404 INFO:teuthology.provision.fog.smithi144:Deploy complete!
2023-07-10T23:30:17.405 DEBUG:teuthology.parallel:result is None
2023-07-10T23:30:17.591 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2023-07-10T23:30:17.592 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-10T23:30:17.617 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com
2023-07-10T23:30:17.617 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-10T23:30:17.635 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2023-07-10T23:30:17.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-07-10T23:30:17.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:30:17.703 DEBUG:teuthology.orchestra.run.smithi033:> true
2023-07-10T23:30:17.838 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-07-10T23:30:17.839 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2023-07-10T23:30:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2023-07-10T23:30:17.897 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-07-10T23:30:17.955 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-07-10T23:30:17.955 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-07-10T23:30:17.955 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-10T23:30:17.956 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-10T23:30:17.957 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-10T23:30:17.958 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-07-10T23:30:17.983 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server
2023-07-10T23:30:17.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-07-10T23:30:17.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-10T23:30:18.052 DEBUG:teuthology.orchestra.run.smithi144:> true
2023-07-10T23:30:18.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com'
2023-07-10T23:30:18.119 DEBUG:teuthology.orchestra.run.smithi144:> uname -m
2023-07-10T23:30:18.180 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64
2023-07-10T23:30:18.181 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release
2023-07-10T23:30:18.241 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Red Hat Enterprise Linux"
2023-07-10T23:30:18.241 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8.6 (Ootpa)"
2023-07-10T23:30:18.241 INFO:teuthology.orchestra.run.smithi144.stdout:ID="rhel"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="fedora"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8.6"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-07-10T23:30:18.242 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.redhat.com/"
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-07-10T23:30:18.243 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-07-10T23:30:18.244 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server
2023-07-10T23:30:18.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:30:18.276 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:30:18.377 INFO:teuthology.dispatcher.supervisor:Running job 7332852
2023-07-10T23:30:18.377 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332852 --name pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} -- /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332852/orig.config.yaml
2023-07-10T23:30:18.381 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332852
2023-07-10T23:30:18.382 INFO:teuthology.dispatcher.supervisor:Job PID: 11599
2023-07-10T23:30:18.382 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-10T23:32:18.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:32:18.484 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:34:18.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:34:18.614 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:36:18.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:36:18.791 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:38:18.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:38:18.958 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:40:19.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:40:19.130 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:42:19.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:42:19.297 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:44:19.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:44:19.474 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:46:19.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:46:19.649 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:48:19.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:48:19.829 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:50:20.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:50:20.025 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:52:20.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-10T23:52:20.196 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-10T23:52:20.280 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-10T23:52:20.420 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-10T23:52:20.422 INFO:teuthology.nuke:Checking targets against current locks
2023-07-10T23:52:20.481 DEBUG:teuthology.nuke:shortname: smithi033
2023-07-10T23:52:20.482 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-10T23:52:20.507 DEBUG:teuthology.nuke:shortname: smithi144
2023-07-10T23:52:20.508 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-10T23:52:20.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:25:23.859358', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-10T23:52:20.540 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-07-10_22:55:54-fs-wip-pdonnell-testing-20230710.195410-distro-default-smithi/7332852', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-10 23:25:23.860862', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}
2023-07-10T23:52:20.565 INFO:teuthology.orchestra.console:Power off smithi033
2023-07-10T23:52:20.566 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-10T23:52:20.586 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:52:20.609 INFO:teuthology.orchestra.console:Power off smithi144
2023-07-10T23:52:20.609 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-10T23:52:20.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-10T23:52:20.721 INFO:teuthology.orchestra.console:Power off for smithi033 completed
2023-07-10T23:52:20.758 INFO:teuthology.orchestra.console:Power off for smithi144 completed
2023-07-10T23:52:20.875 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2023-07-10T23:52:20.907 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com