2023-11-08T01:36:11.782 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-08T01:36:11.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:36:11.927 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fdb6003aaf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fdb60b41670>, signals=[15])
2023-11-08T01:36:11.929 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging
2023-11-08T01:36:11.929 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T01:36:11.930 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2023-11-08T01:36:11.953 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging
2023-11-08T01:36:11.953 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T01:36:11.953 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-11-08T01:36:11.955 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /host {"name": "smithi001"}
2023-11-08T01:36:11.978 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"}
2023-11-08T01:36:12.028 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-08T01:36:12.052 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-08T01:36:12.081 DEBUG:teuthology.provision.fog.smithi001:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-08T01:36:12.081 DEBUG:teuthology.provision.fog.smithi001:FOG request: PUT /host/107 {"imageID": 7}
2023-11-08T01:36:12.092 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-08T01:36:12.092 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 7}
2023-11-08T01:36:12.127 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of rhel 8.4
2023-11-08T01:36:12.127 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:36:12.146 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of rhel 8.4
2023-11-08T01:36:12.146 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:36:12.184 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T01:36:12.207 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T01:36:12.223 DEBUG:teuthology.provision.fog.smithi001:FOG request: POST /host/107/task {"taskTypeID": 1}
2023-11-08T01:36:12.249 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1}
2023-11-08T01:36:12.278 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:36:12.412 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:36:12.461 INFO:teuthology.orchestra.console.smithi001:Power off
2023-11-08T01:36:12.462 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T01:36:12.485 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2023-11-08T01:36:12.486 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:12.508 INFO:teuthology.orchestra.console.smithi023:Power off
2023-11-08T01:36:12.509 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T01:36:12.517 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-11-08T01:36:12.531 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off
2023-11-08T01:36:12.532 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:12.555 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-08T01:36:16.519 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:16.556 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:16.629 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-11-08T01:36:16.666 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-08T01:36:20.634 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:20.667 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:20.743 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-11-08T01:36:20.776 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-08T01:36:20.845 INFO:teuthology.orchestra.console.smithi001:Power off completed
2023-11-08T01:36:20.878 INFO:teuthology.orchestra.console.smithi023:Power off completed
2023-11-08T01:36:20.946 INFO:teuthology.orchestra.console.smithi001:Power on
2023-11-08T01:36:20.947 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T01:36:20.969 DEBUG:teuthology.orchestra.console.smithi001:power on output: Chassis Power Control: Up/On
2023-11-08T01:36:20.969 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:20.978 INFO:teuthology.orchestra.console.smithi023:Power on
2023-11-08T01:36:20.979 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T01:36:20.989 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-11-08T01:36:20.999 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On
2023-11-08T01:36:21.000 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:21.023 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-08T01:36:24.991 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:25.024 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:25.099 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-11-08T01:36:25.133 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-08T01:36:29.102 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:29.134 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T01:36:29.211 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is on
2023-11-08T01:36:29.243 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on
2023-11-08T01:36:29.312 INFO:teuthology.orchestra.console.smithi001:Power on completed
2023-11-08T01:36:29.345 INFO:teuthology.orchestra.console.smithi023:Power on completed
2023-11-08T01:36:29.413 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish
2023-11-08T01:36:29.413 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:36:29.447 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2023-11-08T01:36:29.447 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:36:44.494 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:36:44.517 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:36:59.574 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:36:59.578 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:37:14.646 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:37:14.648 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:37:29.726 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:37:29.728 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:37:44.798 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:37:44.800 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:37:59.865 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:37:59.870 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:38:14.950 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:38:14.952 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:38:30.026 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:38:30.027 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:38:45.098 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:38:45.100 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:39:00.167 DEBUG:teuthology.provision.fog.smithi001:FOG request: GET /task/active None
2023-11-08T01:39:00.169 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:39:00.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:03.290 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:09.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:12.350 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:15.227 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:39:18.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:21.434 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:27.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:30.302 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:39:30.490 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:36.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:39.546 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:45.356 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-11-08T01:39:45.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:45.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:48.474 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:39:48.602 WARNING:teuthology.provision.fog.smithi001:[Errno None] Unable to connect to port 22 on 172.21.15.1
2023-11-08T01:39:54.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:54.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:39:57.566 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:03.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:06.654 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:12.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:15.738 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:21.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:24.794 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:30.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:33.882 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:39.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:42.942 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:48.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:40:52.026 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:40:54.610 WARNING:teuthology.provision.fog.smithi001:timed out
2023-11-08T01:40:58.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:41:00.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:41:00.892 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T01:41:00.893 DEBUG:teuthology.orchestra.run.smithi001:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T01:41:01.082 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:41:01.125 INFO:teuthology.provision.fog.smithi001:Node is ready
2023-11-08T01:41:01.126 DEBUG:teuthology.orchestra.run.smithi001:> hostname
2023-11-08T01:41:01.181 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com
2023-11-08T01:41:01.182 DEBUG:teuthology.orchestra.run.smithi001:> grep smithi001.front.sepia.ceph.com /etc/hosts
2023-11-08T01:41:01.237 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001
2023-11-08T01:41:01.238 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2023-11-08T01:41:01.355 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hosts
2023-11-08T01:41:01.381 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/172.21.15.1/172.21.15.1/g' /etc/hosts
2023-11-08T01:41:01.446 DEBUG:teuthology.orchestra.run.smithi001:> sudo sed -i -e 's/smithi001.front.sepia.ceph.com/smithi001/g' /etc/hostname
2023-11-08T01:41:01.511 DEBUG:teuthology.orchestra.run.smithi001:> sudo hostname smithi001
2023-11-08T01:41:01.575 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2023-11-08T01:41:01.629 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T01:41:01.630 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.4 (Ootpa)"
2023-11-08T01:41:01.630 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel"
2023-11-08T01:41:01.630 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora"
2023-11-08T01:41:01.631 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.4"
2023-11-08T01:41:01.631 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2023-11-08T01:41:01.631 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-08T01:41:01.631 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2023-11-08T01:41:01.632 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-08T01:41:01.632 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T01:41:01.632 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T01:41:01.632 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T01:41:01.633 INFO:teuthology.orchestra.run.smithi001.stdout:
2023-11-08T01:41:01.633 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T01:41:01.633 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-08T01:41:01.633 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T01:41:01.634 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-08T01:41:01.634 INFO:teuthology.provision.fog.smithi001:Deploy complete!
2023-11-08T01:41:01.636 DEBUG:teuthology.parallel:result is None
2023-11-08T01:41:07.089 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:41:10.174 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-11-08T01:41:16.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:42:16.243 WARNING:teuthology.provision.fog.smithi023:timed out
2023-11-08T01:42:22.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:42:22.564 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T01:42:22.564 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T01:42:22.800 INFO:teuthology.provision.fog.smithi023:Node is ready
2023-11-08T01:42:22.801 DEBUG:teuthology.orchestra.run.smithi023:> hostname
2023-11-08T01:42:22.857 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com
2023-11-08T01:42:22.857 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts
2023-11-08T01:42:22.915 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023
2023-11-08T01:42:22.915 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-11-08T01:42:23.029 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts
2023-11-08T01:42:23.057 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts
2023-11-08T01:42:23.124 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname
2023-11-08T01:42:23.190 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-11-08T01:42:23.256 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-11-08T01:42:23.312 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T01:42:23.312 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.4 (Ootpa)"
2023-11-08T01:42:23.313 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel"
2023-11-08T01:42:23.313 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora"
2023-11-08T01:42:23.313 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.4"
2023-11-08T01:42:23.313 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2023-11-08T01:42:23.314 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-08T01:42:23.314 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-11-08T01:42:23.314 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-08T01:42:23.314 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T01:42:23.314 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T01:42:23.315 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T01:42:23.315 INFO:teuthology.orchestra.run.smithi023.stdout:
2023-11-08T01:42:23.315 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T01:42:23.315 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-08T01:42:23.315 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T01:42:23.316 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-08T01:42:23.316 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2023-11-08T01:42:23.317 DEBUG:teuthology.parallel:result is None
2023-11-08T01:42:23.472 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com
2023-11-08T01:42:23.473 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T01:42:23.496 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2023-11-08T01:42:23.496 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T01:42:23.514 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server
2023-11-08T01:42:23.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com'
2023-11-08T01:42:23.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:42:23.586 DEBUG:teuthology.orchestra.run.smithi001:> true
2023-11-08T01:42:23.714 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi001.front.sepia.ceph.com'
2023-11-08T01:42:23.715 DEBUG:teuthology.orchestra.run.smithi001:> uname -m
2023-11-08T01:42:23.771 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64
2023-11-08T01:42:23.771 DEBUG:teuthology.orchestra.run.smithi001:> cat /etc/os-release
2023-11-08T01:42:23.827 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T01:42:23.827 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8.4 (Ootpa)"
2023-11-08T01:42:23.827 INFO:teuthology.orchestra.run.smithi001.stdout:ID="rhel"
2023-11-08T01:42:23.827 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="fedora"
2023-11-08T01:42:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8.4"
2023-11-08T01:42:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8"
2023-11-08T01:42:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-08T01:42:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31"
2023-11-08T01:42:23.828 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-08T01:42:23.829 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T01:42:23.829 INFO:teuthology.orchestra.run.smithi001.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T01:42:23.829 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T01:42:23.829 INFO:teuthology.orchestra.run.smithi001.stdout:
2023-11-08T01:42:23.829 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T01:42:23.830 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-08T01:42:23.830 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T01:42:23.830 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-08T01:42:23.831 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server
2023-11-08T01:42:23.847 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2023-11-08T01:42:23.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-11-08T01:42:23.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T01:42:23.954 DEBUG:teuthology.orchestra.run.smithi023:> true
2023-11-08T01:42:23.978 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-11-08T01:42:23.979 DEBUG:teuthology.orchestra.run.smithi023:> uname -m
2023-11-08T01:42:24.035 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2023-11-08T01:42:24.035 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-11-08T01:42:24.091 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="Red Hat Enterprise Linux"
2023-11-08T01:42:24.092 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8.4 (Ootpa)"
2023-11-08T01:42:24.092 INFO:teuthology.orchestra.run.smithi023.stdout:ID="rhel"
2023-11-08T01:42:24.092 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="fedora"
2023-11-08T01:42:24.092 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8.4"
2023-11-08T01:42:24.093 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8"
2023-11-08T01:42:24.093 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-08T01:42:24.093 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-11-08T01:42:24.093 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-08T01:42:24.093 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://www.redhat.com/"
2023-11-08T01:42:24.094 INFO:teuthology.orchestra.run.smithi023.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-08T01:42:24.094 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T01:42:24.094 INFO:teuthology.orchestra.run.smithi023.stdout:
2023-11-08T01:42:24.094 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T01:42:24.094 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-08T01:42:24.095 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-08T01:42:24.095 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-08T01:42:24.095 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-11-08T01:42:24.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:42:24.193 INFO:teuthology.dispatcher.supervisor:Running job 7451203
2023-11-08T01:42:24.194 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451203 --name yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} -- /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451203/orig.config.yaml
2023-11-08T01:42:24.197 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451203
2023-11-08T01:42:24.198 INFO:teuthology.dispatcher.supervisor:Job PID: 579242
2023-11-08T01:42:24.198 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-08T01:44:24.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:46:24.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:48:24.631 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:50:24.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:52:24.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:54:25.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:56:25.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T01:58:25.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:00:25.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:02:25.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:04:25.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:06:26.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:08:26.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:10:26.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:12:26.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:14:26.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:16:26.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:18:27.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:20:27.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:22:27.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:24:27.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T02:24:27.874 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-08T02:24:27.970 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-08T02:24:27.971 INFO:teuthology.nuke:Checking targets against current locks
2023-11-08T02:24:28.019 DEBUG:teuthology.nuke:shortname: smithi001
2023-11-08T02:24:28.020 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T02:24:28.044 DEBUG:teuthology.nuke:shortname: smithi023
2023-11-08T02:24:28.044 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T02:24:28.048 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi001.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 01:36:10.995519', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM+WWmTKiyWGBcrU/dCy4X3rxNP3g04mdugWFWvDDoAejY5XwuJkY3D6QAU3ARnWvtB84RHJK7a3Y1Tzk9SgVH0='}
2023-11-08T02:24:28.071 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi023.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-07_19:34:21-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7451203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 01:36:10.997103', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALbJ9vBL8Zy9vV+rU6DfYGtA9fcy0821zUKVb9XoG0UsDmI5CNQbByKDueV/LPOv0cQyGc/Z3Bg4Y6HhWPUaxk='}
2023-11-08T02:24:28.100 INFO:teuthology.orchestra.console.smithi001:Power off
2023-11-08T02:24:28.101 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T02:24:28.122 DEBUG:teuthology.orchestra.console.smithi001:power off output: Chassis Power Control: Down/Off
2023-11-08T02:24:28.122 DEBUG:teuthology.orchestra.console.smithi001:pexpect command: ipmitool -H smithi001.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T02:24:28.135 INFO:teuthology.orchestra.console.smithi023:Power off
2023-11-08T02:24:28.136 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T02:24:28.145 DEBUG:teuthology.orchestra.console.smithi001:check power output: Chassis Power is off
2023-11-08T02:24:28.156 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off
2023-11-08T02:24:28.157 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T02:24:28.182 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off
2023-11-08T02:24:28.247 INFO:teuthology.orchestra.console.smithi001:Power off completed
2023-11-08T02:24:28.283 INFO:teuthology.orchestra.console.smithi023:Power off completed
2023-11-08T02:24:28.416 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com
2023-11-08T02:24:28.431 INFO:teuthology.lock.ops:unlocked: smithi023.front.sepia.ceph.com