2023-12-20T03:59:22.409 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-20T03:59:22.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T03:59:22.576 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd4508ff550>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd451849940>, signals=[15])
2023-12-20T03:59:22.577 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2023-12-20T03:59:22.577 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T03:59:22.577 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-12-20T03:59:22.599 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging
2023-12-20T03:59:22.599 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T03:59:22.599 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-20T03:59:22.624 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging
2023-12-20T03:59:22.624 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server
2023-12-20T03:59:22.624 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-12-20T03:59:22.709 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T03:59:22.725 DEBUG:teuthology.provision.fog.smithi111:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T03:59:22.755 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_rhel_8.6 (ID 5)
2023-12-20T03:59:22.766 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6
2023-12-20T03:59:22.775 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of rhel 8.6
2023-12-20T03:59:22.799 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of rhel 8.6
2023-12-20T03:59:23.066 INFO:teuthology.orchestra.console.smithi125:Power off
2023-12-20T03:59:23.066 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T03:59:23.079 INFO:teuthology.orchestra.console.smithi027:Power off
2023-12-20T03:59:23.079 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T03:59:23.089 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-20T03:59:23.090 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T03:59:23.097 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-12-20T03:59:23.098 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:23.106 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-12-20T03:59:23.106 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:23.114 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-20T03:59:23.114 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:23.122 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-12-20T03:59:23.126 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-12-20T03:59:23.134 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-20T03:59:23.227 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-12-20T03:59:23.235 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-20T03:59:23.328 INFO:teuthology.orchestra.console.smithi027:Power on
2023-12-20T03:59:23.328 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T03:59:23.336 INFO:teuthology.orchestra.console.smithi111:Power on
2023-12-20T03:59:23.337 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T03:59:23.349 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2023-12-20T03:59:23.350 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:23.360 DEBUG:teuthology.orchestra.console.smithi111:power on output: Chassis Power Control: Up/On
2023-12-20T03:59:23.360 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:23.375 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-12-20T03:59:23.381 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-20T03:59:27.125 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:27.235 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-12-20T03:59:27.376 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:27.383 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:27.485 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2023-12-20T03:59:27.490 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-20T03:59:27.587 INFO:teuthology.orchestra.console.smithi027:Power on completed
2023-12-20T03:59:27.687 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2023-12-20T03:59:31.237 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:31.346 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-12-20T03:59:31.447 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-12-20T03:59:31.491 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:31.547 INFO:teuthology.orchestra.console.smithi125:Power on
2023-12-20T03:59:31.548 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-20T03:59:31.569 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On
2023-12-20T03:59:31.570 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:31.589 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-12-20T03:59:31.655 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on
2023-12-20T03:59:31.756 INFO:teuthology.orchestra.console.smithi111:Power on completed
2023-12-20T03:59:31.856 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish
2023-12-20T03:59:35.593 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:35.702 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-12-20T03:59:39.705 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T03:59:39.888 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on
2023-12-20T03:59:39.988 INFO:teuthology.orchestra.console.smithi125:Power on completed
2023-12-20T03:59:40.089 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2023-12-20T04:02:47.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:02:50.097 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:02:56.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:02:59.185 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:03:05.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:08.241 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:03:14.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:17.329 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:03:23.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:26.385 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:03:32.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:35.473 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:03:41.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:03:59.889 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:04:05.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:08.945 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:04:14.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:16.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:18.002 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125
2023-12-20T04:04:19.505 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:04:24.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:24.525 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:04:24.525 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:04:25.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:28.561 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:04:34.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:37.617 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:04:40.633 INFO:teuthology.provision.fog.smithi125:Node is ready
2023-12-20T04:04:40.633 DEBUG:teuthology.orchestra.run.smithi125:> hostname
2023-12-20T04:04:40.655 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2023-12-20T04:04:40.656 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts
2023-12-20T04:04:40.716 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2023-12-20T04:04:40.716 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-12-20T04:04:40.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts
2023-12-20T04:04:40.870 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts
2023-12-20T04:04:40.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname
2023-12-20T04:04:41.009 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125
2023-12-20T04:04:41.077 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-12-20T04:04:41.134 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:04:41.135 INFO:teuthology.orchestra.run.smithi125.stdout:
2023-12-20T04:04:41.136 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:04:41.136 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:04:41.136 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:04:41.136 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:04:41.136 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2023-12-20T04:04:41.138 DEBUG:teuthology.parallel:result is None
2023-12-20T04:04:43.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:46.674 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:04:52.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:04:55.729 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:01.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:04.817 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:10.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:13.873 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:19.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:22.961 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:28.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:32.017 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:37.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:38.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:40.754 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:05:41.073 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:46.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:47.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:49.809 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:05:50.130 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:05:55.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:56.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:05:58.897 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:05:59.185 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:06:04.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:05.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:07.989 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:06:13.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:17.073 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:06:23.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:23.509 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:06:26.129 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:06:29.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:32.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:32.593 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:06:35.186 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:06:38.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:41.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:41.649 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-12-20T04:06:47.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:06:47.954 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:06:47.954 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:06:59.601 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:07:03.113 INFO:teuthology.provision.fog.smithi027:Node is ready
2023-12-20T04:07:03.113 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2023-12-20T04:07:03.136 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2023-12-20T04:07:03.137 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2023-12-20T04:07:03.196 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2023-12-20T04:07:03.197 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-12-20T04:07:03.332 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2023-12-20T04:07:03.362 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2023-12-20T04:07:03.430 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2023-12-20T04:07:03.498 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-12-20T04:07:03.569 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-12-20T04:07:03.625 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:07:03.626 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:07:03.627 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:07:03.627 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2023-12-20T04:07:03.627 DEBUG:teuthology.parallel:result is None
2023-12-20T04:07:05.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:08.658 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:07:14.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:17.713 WARNING:teuthology.provision.fog.smithi111:[Errno None] Unable to connect to port 22 on 172.21.15.111
2023-12-20T04:07:23.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:23.994 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-20T04:07:23.995 DEBUG:teuthology.orchestra.run.smithi111:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-20T04:07:44.312 INFO:teuthology.provision.fog.smithi111:Node is ready
2023-12-20T04:07:44.312 DEBUG:teuthology.orchestra.run.smithi111:> hostname
2023-12-20T04:07:44.334 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com
2023-12-20T04:07:44.334 DEBUG:teuthology.orchestra.run.smithi111:> grep smithi111.front.sepia.ceph.com /etc/hosts
2023-12-20T04:07:44.394 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111
2023-12-20T04:07:44.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-20T04:07:44.525 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hosts
2023-12-20T04:07:44.556 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/172.21.15.111/172.21.15.111/g' /etc/hosts
2023-12-20T04:07:44.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i -e 's/smithi111.front.sepia.ceph.com/smithi111/g' /etc/hostname
2023-12-20T04:07:44.694 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname smithi111
2023-12-20T04:07:44.762 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-20T04:07:44.819 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:07:44.819 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:07:44.820 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:07:44.821 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:07:44.821 INFO:teuthology.provision.fog.smithi111:Deploy complete!
2023-12-20T04:07:44.821 DEBUG:teuthology.parallel:result is None
2023-12-20T04:07:45.015 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2023-12-20T04:07:45.015 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:07:45.038 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com
2023-12-20T04:07:45.038 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:07:45.055 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2023-12-20T04:07:45.055 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-20T04:07:45.073 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:07:45.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-12-20T04:07:45.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:45.141 DEBUG:teuthology.orchestra.run.smithi027:> true
2023-12-20T04:07:45.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-12-20T04:07:45.280 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2023-12-20T04:07:45.339 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2023-12-20T04:07:45.339 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-12-20T04:07:45.397 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:07:45.397 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:07:45.397 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel"
2023-12-20T04:07:45.397 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:07:45.398 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:07:45.399 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-12-20T04:07:45.414 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:07:45.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-20T04:07:45.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:45.484 DEBUG:teuthology.orchestra.run.smithi111:> true
2023-12-20T04:07:45.556 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com'
2023-12-20T04:07:45.557 DEBUG:teuthology.orchestra.run.smithi111:> uname -m
2023-12-20T04:07:45.615 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64
2023-12-20T04:07:45.615 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:ID="rhel"
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="fedora"
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8.6"
2023-12-20T04:07:45.674 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:07:45.675 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:07:45.676 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server
2023-12-20T04:07:45.697 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2023-12-20T04:07:45.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-12-20T04:07:45.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-20T04:07:45.762 DEBUG:teuthology.orchestra.run.smithi125:> true
2023-12-20T04:07:45.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com'
2023-12-20T04:07:45.904 DEBUG:teuthology.orchestra.run.smithi125:> uname -m
2023-12-20T04:07:45.961 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2023-12-20T04:07:45.962 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Red Hat Enterprise Linux"
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8.6 (Ootpa)"
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:ID="rhel"
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="fedora"
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8.6"
2023-12-20T04:07:46.019 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.redhat.com/"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-12-20T04:07:46.020 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6"
2023-12-20T04:07:46.021 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2023-12-20T04:07:46.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:07:46.124 INFO:teuthology.dispatcher.supervisor:Running job 7497366
2023-12-20T04:07:46.124 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366 --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{no-subvolume} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366/orig.config.yaml
2023-12-20T04:07:46.127 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366
2023-12-20T04:07:46.128 INFO:teuthology.dispatcher.supervisor:Job PID: 3413647
2023-12-20T04:07:46.128 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-20T04:09:46.226 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:11:46.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:13:46.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:15:46.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:17:46.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:19:47.074 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:21:47.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:23:47.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:25:47.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-20T04:25:47.688 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-20T04:25:47.870 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-20T04:25:47.871 INFO:teuthology.nuke:Checking targets against current locks
2023-12-20T04:25:47.912 DEBUG:teuthology.nuke:shortname: smithi027
2023-12-20T04:25:47.913 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:25:47.944 DEBUG:teuthology.nuke:shortname: smithi111
2023-12-20T04:25:47.944 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:25:47.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:21.477178', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMqsjom8MHsT1pmZ4jkmQOd8NISGBb+n+a4FOfMPXo6KLVsEDWzJq49uOqfDD1QBaLa1KPF3LbdbvboTDE9ERpY='}
2023-12-20T04:25:47.974 DEBUG:teuthology.nuke:shortname: smithi125
2023-12-20T04:25:47.974 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-20T04:25:47.975 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:21.475526', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHYcVGlMQ6dpiFyhUlN42mEtdU6TnL21NT4ZP4Ctll2kWFUBa3BB9uDYRs/unEg/UU4a0uiuJaRsYiwcPnrhj58='}
2023-12-20T04:25:47.993 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497366', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 03:59:21.478338', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGC9fJDbOVupwNnV6ZetUz786NVeyyC+5ha9MM2Qt3hOIpKS4DjeS2WxNwAw4Gpd7frJEGCBkgphYSXM2KAnfP0='}
2023-12-20T04:25:48.002 INFO:teuthology.orchestra.console.smithi027:Power off
2023-12-20T04:25:48.003 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:25:48.030 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-12-20T04:25:48.030 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:25:48.043 INFO:teuthology.orchestra.console.smithi111:Power off
2023-12-20T04:25:48.043 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:25:48.055 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-12-20T04:25:48.065 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off
2023-12-20T04:25:48.065 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:25:48.081 INFO:teuthology.orchestra.console.smithi125:Power off
2023-12-20T04:25:48.081 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-20T04:25:48.090 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off
2023-12-20T04:25:48.102 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off
2023-12-20T04:25:48.102 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-20T04:25:48.124 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off
2023-12-20T04:25:48.156 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-12-20T04:25:48.191 INFO:teuthology.orchestra.console.smithi111:Power off completed
2023-12-20T04:25:48.225 INFO:teuthology.orchestra.console.smithi125:Power off completed
2023-12-20T04:25:48.311 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2023-12-20T04:25:48.336 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com
2023-12-20T04:25:48.369 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com