2023-10-16T19:38:19.012 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-16T19:38:19.013 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:38:19.140 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ffb4338cb50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ffb43135b80>, signals=[15])
2023-10-16T19:38:19.141 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-10-16T19:38:19.141 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-10-16T19:38:19.142 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-10-16T19:38:19.160 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2023-10-16T19:38:19.161 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2023-10-16T19:38:19.161 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-10-16T19:38:19.162 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"}
2023-10-16T19:38:19.184 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"}
2023-10-16T19:38:19.254 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-16T19:38:19.260 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-16T19:38:19.298 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_9.stream (ID 10)
2023-10-16T19:38:19.298 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 10}
2023-10-16T19:38:19.306 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_9.stream (ID 10)
2023-10-16T19:38:19.306 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 10}
2023-10-16T19:38:19.348 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 9.stream
2023-10-16T19:38:19.348 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:38:19.351 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 9.stream
2023-10-16T19:38:19.351 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:38:19.397 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"}
2023-10-16T19:38:19.400 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"}
2023-10-16T19:38:19.445 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1}
2023-10-16T19:38:19.449 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1}
2023-10-16T19:38:19.502 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:38:19.506 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:38:19.590 INFO:teuthology.orchestra.console.smithi151:Power off
2023-10-16T19:38:19.590 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T19:38:19.604 INFO:teuthology.orchestra.console.smithi124:Power off
2023-10-16T19:38:19.605 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T19:38:19.613 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-10-16T19:38:19.613 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:19.629 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-10-16T19:38:19.630 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:19.638 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-10-16T19:38:19.651 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-10-16T19:38:19.739 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-10-16T19:38:19.752 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-10-16T19:38:19.841 INFO:teuthology.orchestra.console.smithi151:Power on
2023-10-16T19:38:19.841 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-16T19:38:19.853 INFO:teuthology.orchestra.console.smithi124:Power on
2023-10-16T19:38:19.854 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-16T19:38:19.863 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2023-10-16T19:38:19.863 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:19.875 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-10-16T19:38:19.875 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:19.885 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-10-16T19:38:19.898 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-10-16T19:38:23.886 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:23.900 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:23.995 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-10-16T19:38:24.008 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-10-16T19:38:28.001 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:28.008 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T19:38:28.110 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-10-16T19:38:28.116 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-10-16T19:38:28.212 INFO:teuthology.orchestra.console.smithi151:Power on completed
2023-10-16T19:38:28.217 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-10-16T19:38:28.313 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2023-10-16T19:38:28.313 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:38:28.318 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-10-16T19:38:28.319 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:38:43.387 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:38:43.389 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:38:58.462 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:38:58.464 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:39:13.534 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:39:13.536 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:39:28.610 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:39:28.612 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:39:43.692 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:39:43.695 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:39:58.766 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:39:58.768 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:40:13.838 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:40:13.840 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:40:28.920 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:40:28.921 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:40:44.008 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:40:44.010 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:40:59.110 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:40:59.112 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None
2023-10-16T19:40:59.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:14.199 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-10-16T19:41:14.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:17.562 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-10-16T19:41:23.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:26.618 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-10-16T19:41:32.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:32.670 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-10-16T19:41:35.674 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-10-16T19:41:38.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:41.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:41.754 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-10-16T19:41:44.730 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-10-16T19:41:47.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:50.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:50.814 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-10-16T19:41:53.786 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-10-16T19:41:56.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:59.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:41:59.898 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-10-16T19:42:05.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:42:08.954 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-10-16T19:42:14.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:42:59.820 WARNING:teuthology.provision.fog.smithi124:timed out
2023-10-16T19:43:05.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:43:06.058 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-16T19:43:06.059 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-16T19:43:06.397 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-10-16T19:43:06.397 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-10-16T19:43:06.414 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-10-16T19:43:06.414 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-10-16T19:43:06.470 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-10-16T19:43:06.471 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-10-16T19:43:06.605 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-10-16T19:43:06.635 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-10-16T19:43:06.703 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-10-16T19:43:06.772 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-10-16T19:43:06.839 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-10-16T19:43:06.894 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-10-16T19:43:06.894 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-10-16T19:43:06.895 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-10-16T19:43:06.895 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-10-16T19:43:06.895 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-10-16T19:43:06.895 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-10-16T19:43:06.895 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-16T19:43:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-10-16T19:43:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-10-16T19:43:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-16T19:43:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-10-16T19:43:06.896 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-16T19:43:06.897 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-16T19:43:06.897 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-16T19:43:06.898 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-10-16T19:43:06.899 DEBUG:teuthology.parallel:result is None
2023-10-16T19:43:14.970 WARNING:teuthology.provision.fog.smithi151:timed out
2023-10-16T19:43:20.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:43:21.207 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-16T19:43:21.208 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-16T19:43:21.556 INFO:teuthology.provision.fog.smithi151:Node is ready
2023-10-16T19:43:21.556 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2023-10-16T19:43:21.571 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2023-10-16T19:43:21.571 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2023-10-16T19:43:21.627 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2023-10-16T19:43:21.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-10-16T19:43:21.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2023-10-16T19:43:21.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2023-10-16T19:43:21.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2023-10-16T19:43:21.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-10-16T19:43:21.961 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-10-16T19:43:22.015 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2023-10-16T19:43:22.015 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2023-10-16T19:43:22.016 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2023-10-16T19:43:22.016 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2023-10-16T19:43:22.016 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2023-10-16T19:43:22.016 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2023-10-16T19:43:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-16T19:43:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-10-16T19:43:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2023-10-16T19:43:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-16T19:43:22.017 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2023-10-16T19:43:22.018 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-16T19:43:22.018 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-16T19:43:22.018 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-16T19:43:22.019 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2023-10-16T19:43:22.019 DEBUG:teuthology.parallel:result is None
2023-10-16T19:43:22.182 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-10-16T19:43:22.183 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-16T19:43:22.211 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2023-10-16T19:43:22.211 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-16T19:43:22.237 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-10-16T19:43:22.238 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-10-16T19:43:22.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:43:22.322 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-10-16T19:43:22.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-10-16T19:43:22.484 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-10-16T19:43:22.538 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-10-16T19:43:22.538 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-10-16T19:43:22.592 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-10-16T19:43:22.592 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="9"
2023-10-16T19:43:22.592 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-10-16T19:43:22.593 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-10-16T19:43:22.593 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="9"
2023-10-16T19:43:22.593 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el9"
2023-10-16T19:43:22.593 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-16T19:43:22.593 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-10-16T19:43:22.594 INFO:teuthology.orchestra.run.smithi124.stdout:LOGO="fedora-logo-icon"
2023-10-16T19:43:22.594 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-16T19:43:22.594 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-10-16T19:43:22.594 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-16T19:43:22.594 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-16T19:43:22.595 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-16T19:43:22.595 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-10-16T19:43:22.620 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2023-10-16T19:43:22.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-10-16T19:43:22.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-16T19:43:22.702 DEBUG:teuthology.orchestra.run.smithi151:> true
2023-10-16T19:43:22.772 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-10-16T19:43:22.773 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2023-10-16T19:43:22.827 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2023-10-16T19:43:22.827 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-10-16T19:43:22.880 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2023-10-16T19:43:22.881 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9"
2023-10-16T19:43:22.881 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2023-10-16T19:43:22.881 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2023-10-16T19:43:22.881 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-16T19:43:22.882 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2023-10-16T19:43:22.883 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-16T19:43:22.883 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-16T19:43:22.883 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-16T19:43:22.883 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-10-16T19:43:22.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:43:23.001 INFO:teuthology.dispatcher.supervisor:Running job 7430080
2023-10-16T19:43:23.001 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430080 --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430080/orig.config.yaml
2023-10-16T19:43:23.004 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430080
2023-10-16T19:43:23.005 INFO:teuthology.dispatcher.supervisor:Job PID: 580687
2023-10-16T19:43:23.005 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-16T19:45:23.056 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:47:23.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:49:23.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:51:23.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:53:23.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:55:23.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:57:24.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T19:59:24.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T20:01:24.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T20:03:24.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T20:05:24.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-16T20:05:24.944 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-16T20:05:25.057 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-16T20:05:25.057 INFO:teuthology.nuke:Checking targets against current locks
2023-10-16T20:05:25.106 DEBUG:teuthology.nuke:shortname: smithi124
2023-10-16T20:05:25.106 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-16T20:05:25.129 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430080', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:38:18.205683', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZs5enEhTb65dV5DFvR6bos/vPlEDgbDhdkL6p/73P0QqH6n1irc6V1sIPc/DpBZk0Mc4wZy3gQzDdCRXSqo7M='}
2023-10-16T20:05:25.133 DEBUG:teuthology.nuke:shortname: smithi151
2023-10-16T20:05:25.133 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-16T20:05:25.154 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430080', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:38:18.204279', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHJADC8KHVsUYlXYgSviZLWXp+QOYXs4sFv3jNr29agDibn6ZHJP4lVYPrbtq9y+lEKof1iY2YxXcDw6Vmo0BKQ='}
2023-10-16T20:05:25.184 INFO:teuthology.orchestra.console.smithi124:Power off
2023-10-16T20:05:25.185 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T20:05:25.203 INFO:teuthology.orchestra.console.smithi151:Power off
2023-10-16T20:05:25.204 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-16T20:05:25.212 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-10-16T20:05:25.213 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T20:05:25.225 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-10-16T20:05:25.225 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-16T20:05:25.236 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-10-16T20:05:25.245 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-10-16T20:05:25.338 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-10-16T20:05:25.347 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-10-16T20:05:25.480 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2023-10-16T20:05:25.498 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com