2023-09-15T11:38:50.380 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-15T11:38:50.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:38:50.515 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f7d34327c70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7d33fd2c10>, signals=[15])
2023-09-15T11:38:50.517 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging
2023-09-15T11:38:50.517 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server
2023-09-15T11:38:50.517 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-09-15T11:38:50.544 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2023-09-15T11:38:50.545 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2023-09-15T11:38:50.545 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-09-15T11:38:50.546 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"}
2023-09-15T11:38:50.569 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"}
2023-09-15T11:38:50.617 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-15T11:38:50.628 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_rhel_8.6"}
2023-09-15T11:38:50.658 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-15T11:38:50.658 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 5}
2023-09-15T11:38:50.675 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_rhel_8.6 (ID 5)
2023-09-15T11:38:50.675 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 5}
2023-09-15T11:38:50.704 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.6
2023-09-15T11:38:50.705 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:38:50.710 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of rhel 8.6
2023-09-15T11:38:50.710 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:38:50.796 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"}
2023-09-15T11:38:50.799 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"}
2023-09-15T11:38:50.839 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1}
2023-09-15T11:38:50.842 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1}
2023-09-15T11:38:50.899 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:38:50.902 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:38:51.012 INFO:teuthology.orchestra.console.smithi151:Power off
2023-09-15T11:38:51.012 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T11:38:51.024 INFO:teuthology.orchestra.console.smithi033:Power off
2023-09-15T11:38:51.024 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T11:38:51.033 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-09-15T11:38:51.033 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:51.047 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2023-09-15T11:38:51.048 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:51.057 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-15T11:38:51.069 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-09-15T11:38:55.062 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:55.070 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:55.173 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-15T11:38:55.180 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-09-15T11:38:59.178 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:59.185 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:59.287 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-15T11:38:59.293 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-09-15T11:38:59.393 INFO:teuthology.orchestra.console.smithi033:Power off completed
2023-09-15T11:38:59.494 INFO:teuthology.orchestra.console.smithi033:Power on
2023-09-15T11:38:59.494 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-15T11:38:59.516 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On
2023-09-15T11:38:59.516 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:38:59.535 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-09-15T11:39:03.292 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:03.400 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-15T11:39:03.501 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-09-15T11:39:03.536 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:03.602 INFO:teuthology.orchestra.console.smithi151:Power on
2023-09-15T11:39:03.603 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-15T11:39:03.624 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2023-09-15T11:39:03.624 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:03.644 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-09-15T11:39:03.645 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-15T11:39:07.649 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:07.655 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T11:39:07.764 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-15T11:39:07.839 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on
2023-09-15T11:39:07.865 INFO:teuthology.orchestra.console.smithi151:Power on completed
2023-09-15T11:39:07.940 INFO:teuthology.orchestra.console.smithi033:Power on completed
2023-09-15T11:39:07.967 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2023-09-15T11:39:07.967 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:39:08.041 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish
2023-09-15T11:39:08.041 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:39:23.156 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:39:23.212 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:39:38.388 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:39:38.393 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:39:53.596 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:39:53.599 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:40:08.794 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:40:08.796 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:40:23.998 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:40:23.999 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:40:39.202 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:40:39.204 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:41:19.068 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:41:20.989 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:41:37.070 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:41:38.888 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:41:53.936 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:41:55.612 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:42:09.338 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:42:12.677 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:42:24.655 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:42:29.510 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:42:39.862 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:42:45.966 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:42:55.078 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:43:02.433 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:43:10.330 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:43:19.631 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None
2023-09-15T11:43:20.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:25.719 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:43:39.422 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-09-15T11:43:41.037 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:43:45.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:48.506 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-09-15T11:43:54.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:43:56.344 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:43:57.594 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33
2023-09-15T11:44:03.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:44:11.706 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:44:26.967 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:44:42.166 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:44:57.374 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:45:03.610 WARNING:teuthology.provision.fog.smithi033:timed out
2023-09-15T11:45:09.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:45:09.954 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-15T11:45:09.955 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-15T11:45:10.248 INFO:teuthology.provision.fog.smithi033:Node is ready
2023-09-15T11:45:10.249 DEBUG:teuthology.orchestra.run.smithi033:> hostname
2023-09-15T11:45:10.267 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com
2023-09-15T11:45:10.267 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts
2023-09-15T11:45:10.325 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033
2023-09-15T11:45:10.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-09-15T11:45:10.438 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts
2023-09-15T11:45:10.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts
2023-09-15T11:45:10.535 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname
2023-09-15T11:45:10.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033
2023-09-15T11:45:10.670 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-09-15T11:45:10.727 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-09-15T11:45:10.728 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-09-15T11:45:10.728 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-09-15T11:45:10.728 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-09-15T11:45:10.728 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-09-15T11:45:10.728 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:45:10.729 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-15T11:45:10.729 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-09-15T11:45:10.729 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-15T11:45:10.729 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-09-15T11:45:10.729 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-15T11:45:10.730 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:45:10.730 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-09-15T11:45:10.730 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:45:10.730 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-15T11:45:10.730 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-15T11:45:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-15T11:45:10.731 INFO:teuthology.provision.fog.smithi033:Deploy complete!
2023-09-15T11:45:10.733 DEBUG:teuthology.parallel:result is None
2023-09-15T11:45:12.598 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:45:27.770 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:45:42.954 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:45:58.142 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:46:13.330 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:46:28.481 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:46:43.632 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:46:58.784 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:47:13.910 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-15T11:47:14.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:47:32.379 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:47:38.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:47:41.466 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:47:47.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:47:50.554 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:47:56.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:47:59.610 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:48:05.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:08.666 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:48:14.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:17.722 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:48:23.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:42.266 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:48:48.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:48:51.354 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:48:57.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:00.410 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-15T11:49:06.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:06.742 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-15T11:49:06.742 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-15T11:49:06.999 INFO:teuthology.provision.fog.smithi151:Node is ready
2023-09-15T11:49:06.999 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2023-09-15T11:49:07.016 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2023-09-15T11:49:07.016 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2023-09-15T11:49:07.074 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2023-09-15T11:49:07.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-09-15T11:49:07.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2023-09-15T11:49:07.222 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2023-09-15T11:49:07.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2023-09-15T11:49:07.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-09-15T11:49:07.421 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-09-15T11:49:07.478 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux"
2023-09-15T11:49:07.478 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)"
2023-09-15T11:49:07.478 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel"
2023-09-15T11:49:07.478 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-15T11:49:07.479 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/"
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-15T11:49:07.480 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-15T11:49:07.481 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-15T11:49:07.481 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2023-09-15T11:49:07.482 DEBUG:teuthology.parallel:result is None
2023-09-15T11:49:07.627 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com
2023-09-15T11:49:07.628 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-15T11:49:07.649 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2023-09-15T11:49:07.650 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-15T11:49:07.666 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server
2023-09-15T11:49:07.667 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-09-15T11:49:07.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:07.735 DEBUG:teuthology.orchestra.run.smithi033:> true
2023-09-15T11:49:07.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com'
2023-09-15T11:49:07.830 DEBUG:teuthology.orchestra.run.smithi033:> uname -m
2023-09-15T11:49:07.887 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64
2023-09-15T11:49:07.888 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release
2023-09-15T11:49:07.945 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux"
2023-09-15T11:49:07.945 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)"
2023-09-15T11:49:07.946 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel"
2023-09-15T11:49:07.946 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora"
2023-09-15T11:49:07.946 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6"
2023-09-15T11:49:07.946 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:07.946 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:07.947 INFO:teuthology.orchestra.run.smithi033.stdout:
2023-09-15T11:49:07.948 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:07.948 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-15T11:49:07.948 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-15T11:49:07.948 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-15T11:49:07.949 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server
2023-09-15T11:49:07.966 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2023-09-15T11:49:07.966 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-09-15T11:49:07.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-15T11:49:08.032 DEBUG:teuthology.orchestra.run.smithi151:> true
2023-09-15T11:49:08.103 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-09-15T11:49:08.104 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2023-09-15T11:49:08.161 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2023-09-15T11:49:08.162 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-09-15T11:49:08.219 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux"
2023-09-15T11:49:08.219 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)"
2023-09-15T11:49:08.219 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel"
2023-09-15T11:49:08.219 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-09-15T11:49:08.220 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/"
2023-09-15T11:49:08.221 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-09-15T11:49:08.221 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-15T11:49:08.221 INFO:teuthology.orchestra.run.smithi151.stdout:
2023-09-15T11:49:08.221 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-15T11:49:08.221 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-09-15T11:49:08.222 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-09-15T11:49:08.222 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-09-15T11:49:08.222 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-09-15T11:49:08.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:49:08.353 INFO:teuthology.dispatcher.supervisor:Running job 7396927
2023-09-15T11:49:08.353 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_rfriedma@teuthology --archive /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396927 --name rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} -- /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396927/orig.config.yaml
2023-09-15T11:49:08.356 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396927
2023-09-15T11:49:08.356 INFO:teuthology.dispatcher.supervisor:Job PID: 708320
2023-09-15T11:49:08.357 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-15T11:51:08.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:53:08.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:55:08.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:57:09.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T11:59:09.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:01:09.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:03:09.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:05:09.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:07:09.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:09:09.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-15T12:09:10.047 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-15T12:09:10.153 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-15T12:09:10.154 INFO:teuthology.nuke:Checking targets against current locks
2023-09-15T12:09:10.200 DEBUG:teuthology.nuke:shortname: smithi033
2023-09-15T12:09:10.201 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-15T12:09:10.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:49.598868', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-15T12:09:10.226 DEBUG:teuthology.nuke:shortname: smithi151
2023-09-15T12:09:10.226 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-15T12:09:10.249 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rfriedma-2023-09-15_11:34:08-rados:thrash-wip-rf-squeue2-distro-default-smithi/7396927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-15 11:38:49.599988', 'locked_by': 'scheduled_rfriedma@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}
2023-09-15T12:09:10.275 INFO:teuthology.orchestra.console.smithi033:Power off
2023-09-15T12:09:10.276 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T12:09:10.290 INFO:teuthology.orchestra.console.smithi151:Power off
2023-09-15T12:09:10.290 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-15T12:09:10.298 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off
2023-09-15T12:09:10.298 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T12:09:10.310 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-09-15T12:09:10.311 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-15T12:09:10.318 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off
2023-09-15T12:09:10.331 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-15T12:09:10.419 INFO:teuthology.orchestra.console.smithi033:Power off completed
2023-09-15T12:09:10.432 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-09-15T12:09:10.565 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com
2023-09-15T12:09:10.575 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com