2023-09-05T12:06:47.291 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-05T12:06:47.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:06:47.468 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fb510809d00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fb5112fc670>, signals=[15])
2023-09-05T12:06:47.470 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-09-05T12:06:47.470 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-09-05T12:06:47.470 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-09-05T12:06:47.493 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging
2023-09-05T12:06:47.493 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server
2023-09-05T12:06:47.494 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-09-05T12:06:47.495 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-09-05T12:06:47.518 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /host {"name": "smithi134"}
2023-09-05T12:06:47.564 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-05T12:06:47.603 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-09-05T12:06:47.610 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_9.stream (ID 10)
2023-09-05T12:06:47.610 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 10}
2023-09-05T12:06:47.637 DEBUG:teuthology.provision.fog.smithi134:Requesting image smithi_centos_9.stream (ID 10)
2023-09-05T12:06:47.637 DEBUG:teuthology.provision.fog.smithi134:FOG request: PUT /host/239 {"imageID": 10}
2023-09-05T12:06:47.656 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 9.stream
2023-09-05T12:06:47.656 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:06:47.685 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 9.stream
2023-09-05T12:06:47.686 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:06:47.757 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-09-05T12:06:47.784 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /tasktype {"name": "deploy"}
2023-09-05T12:06:47.793 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-09-05T12:06:47.839 DEBUG:teuthology.provision.fog.smithi134:FOG request: POST /host/239/task {"taskTypeID": 1}
2023-09-05T12:06:47.872 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:06:47.888 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:06:48.005 INFO:teuthology.orchestra.console.smithi099:Power off
2023-09-05T12:06:48.006 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:06:48.020 INFO:teuthology.orchestra.console.smithi134:Power off
2023-09-05T12:06:48.020 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:06:48.027 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-09-05T12:06:48.028 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:48.043 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2023-09-05T12:06:48.044 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:48.053 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-09-05T12:06:48.066 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-09-05T12:06:48.155 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-09-05T12:06:48.255 INFO:teuthology.orchestra.console.smithi099:Power on
2023-09-05T12:06:48.256 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-05T12:06:48.278 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-09-05T12:06:48.279 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:48.299 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-09-05T12:06:52.070 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:52.179 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-09-05T12:06:52.301 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:52.410 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-09-05T12:06:52.511 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-09-05T12:06:52.612 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-09-05T12:06:52.612 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:06:56.182 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:06:56.292 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-09-05T12:07:00.297 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:07:00.406 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-09-05T12:07:00.507 INFO:teuthology.orchestra.console.smithi134:Power off completed
2023-09-05T12:07:00.608 INFO:teuthology.orchestra.console.smithi134:Power on
2023-09-05T12:07:00.608 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-05T12:07:00.628 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On
2023-09-05T12:07:00.629 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:07:00.652 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-09-05T12:07:04.654 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:07:04.763 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on
2023-09-05T12:07:04.864 INFO:teuthology.orchestra.console.smithi134:Power on completed
2023-09-05T12:07:04.964 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish
2023-09-05T12:07:04.965 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:07:07.730 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:07:20.102 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:07:22.866 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:07:35.338 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:07:37.990 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:07:50.454 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:07:53.120 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:08:05.586 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:08:08.212 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:08:20.677 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:08:23.294 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:08:35.798 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:08:38.406 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:08:50.880 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:08:53.486 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:09:05.993 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:09:08.590 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:09:21.094 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:09:23.698 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-09-05T12:09:23.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:26.842 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:09:32.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:35.902 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:09:36.182 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:09:41.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:44.986 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:09:50.993 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:51.254 DEBUG:teuthology.provision.fog.smithi134:FOG request: GET /task/active None
2023-09-05T12:09:51.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:09:54.078 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:09:54.398 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:00.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:00.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:03.162 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:10:03.450 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:09.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:09.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:12.222 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:10:12.542 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:18.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:18.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:21.306 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-09-05T12:10:21.598 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:27.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:27.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:30.650 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:36.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:10:39.742 WARNING:teuthology.provision.fog.smithi134:[Errno None] Unable to connect to port 22 on 172.21.15.134
2023-09-05T12:10:45.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:11:27.354 WARNING:teuthology.provision.fog.smithi099:timed out
2023-09-05T12:11:33.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:11:33.819 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-05T12:11:33.820 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-05T12:11:34.171 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-09-05T12:11:34.171 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-09-05T12:11:34.186 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-09-05T12:11:34.186 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-09-05T12:11:34.245 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-09-05T12:11:34.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-09-05T12:11:34.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-09-05T12:11:34.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-09-05T12:11:34.464 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-09-05T12:11:34.535 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-09-05T12:11:34.605 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-09-05T12:11:34.663 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-09-05T12:11:34.663 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2023-09-05T12:11:34.663 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-09-05T12:11:34.663 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:11:34.664 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2023-09-05T12:11:34.664 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2023-09-05T12:11:34.664 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-05T12:11:34.664 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-09-05T12:11:34.665 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2023-09-05T12:11:34.665 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-05T12:11:34.665 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:11:34.666 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:11:34.666 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-05T12:11:34.666 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:11:34.667 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-09-05T12:11:34.668 DEBUG:teuthology.parallel:result is None
2023-09-05T12:11:45.758 WARNING:teuthology.provision.fog.smithi134:timed out
2023-09-05T12:11:51.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:11:52.176 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-05T12:11:52.177 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-05T12:11:52.534 INFO:teuthology.provision.fog.smithi134:Node is ready
2023-09-05T12:11:52.535 DEBUG:teuthology.orchestra.run.smithi134:> hostname
2023-09-05T12:11:52.550 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com
2023-09-05T12:11:52.550 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts
2023-09-05T12:11:52.607 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134
2023-09-05T12:11:52.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-09-05T12:11:52.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts
2023-09-05T12:11:52.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts
2023-09-05T12:11:52.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname
2023-09-05T12:11:52.883 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134
2023-09-05T12:11:52.951 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-09-05T12:11:53.008 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2023-09-05T12:11:53.009 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2023-09-05T12:11:53.010 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2023-09-05T12:11:53.010 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:11:53.010 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2023-09-05T12:11:53.010 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2023-09-05T12:11:53.010 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-05T12:11:53.011 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-09-05T12:11:53.011 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2023-09-05T12:11:53.011 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-05T12:11:53.011 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:11:53.012 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:11:53.012 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-05T12:11:53.012 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:11:53.013 INFO:teuthology.provision.fog.smithi134:Deploy complete!
2023-09-05T12:11:53.013 DEBUG:teuthology.parallel:result is None
2023-09-05T12:11:53.191 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-09-05T12:11:53.192 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-05T12:11:53.218 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com
2023-09-05T12:11:53.219 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-05T12:11:53.244 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-09-05T12:11:53.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-09-05T12:11:53.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:11:53.327 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-09-05T12:11:53.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-09-05T12:11:53.493 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-09-05T12:11:53.547 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-09-05T12:11:53.547 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-09-05T12:11:53.601 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-09-05T12:11:53.602 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="9"
2023-09-05T12:11:53.602 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-09-05T12:11:53.602 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:11:53.602 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="9"
2023-09-05T12:11:53.603 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el9"
2023-09-05T12:11:53.603 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-05T12:11:53.603 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-09-05T12:11:53.603 INFO:teuthology.orchestra.run.smithi099.stdout:LOGO="fedora-logo-icon"
2023-09-05T12:11:53.603 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-05T12:11:53.604 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:11:53.604 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:11:53.604 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-05T12:11:53.604 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:11:53.605 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-09-05T12:11:53.627 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server
2023-09-05T12:11:53.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-09-05T12:11:53.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-05T12:11:53.713 DEBUG:teuthology.orchestra.run.smithi134:> true
2023-09-05T12:11:53.785 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com'
2023-09-05T12:11:53.786 DEBUG:teuthology.orchestra.run.smithi134:> uname -m
2023-09-05T12:11:53.843 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64
2023-09-05T12:11:53.844 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release
2023-09-05T12:11:53.901 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream"
2023-09-05T12:11:53.901 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9"
2023-09-05T12:11:53.901 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos"
2023-09-05T12:11:53.901 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora"
2023-09-05T12:11:53.902 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9"
2023-09-05T12:11:53.902 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9"
2023-09-05T12:11:53.902 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9"
2023-09-05T12:11:53.902 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31"
2023-09-05T12:11:53.902 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon"
2023-09-05T12:11:53.903 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-09-05T12:11:53.903 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/"
2023-09-05T12:11:53.903 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-05T12:11:53.903 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-09-05T12:11:53.904 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-05T12:11:53.904 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server
2023-09-05T12:11:53.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:11:54.026 INFO:teuthology.dispatcher.supervisor:Running job 7388287
2023-09-05T12:11:54.027 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388287 --name mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-flush} -- /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388287/orig.config.yaml
2023-09-05T12:11:54.031 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388287
2023-09-05T12:11:54.032 INFO:teuthology.dispatcher.supervisor:Job PID: 3991411
2023-09-05T12:11:54.032 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-05T12:13:54.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:15:54.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:17:54.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:19:54.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:21:54.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:23:54.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:25:55.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:27:55.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-05T12:27:55.903 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-05T12:27:56.056 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-05T12:27:56.056 INFO:teuthology.nuke:Checking targets against current locks
2023-09-05T12:27:56.110 DEBUG:teuthology.nuke:shortname: smithi099
2023-09-05T12:27:56.111 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-05T12:27:56.125 DEBUG:teuthology.nuke:shortname: smithi134
2023-09-05T12:27:56.126 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-05T12:27:56.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:06:46.484116', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFX99MR/2ijy+7KKoMnSJa3ycV7ieYxTyuOUNJVUmWGf6Nm/lSL2p+Fc+ra++wY3pfmUiXA972E3r8u9LKRF6TA='}
2023-09-05T12:27:56.152 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-09-05_10:53:07-fs-wip-mchangir-testing-20230905.131537-testing-default-smithi/7388287', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 12:06:46.482605', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCgckymP/edBPYVz6fizoLtqYKue1BS7cmM0ZuWeYLlmzbkbORfNU+8Oo7qgotnnMhhLz6d6ishN2LAun6av8jei+AX/lCQ7Y484v1mgoXYlhD52M1j5Pqumyyq1aWfjxM7MSglOFqQ13LCHFQyWeu11J+Aw2kukyLuniNszKoCq4H/5FkylsO5PozhMCaOzfPMAVII1BvgHAKGW4QRri/zOgyKW+/KWIEEbKd4HXJHvTDNNJ4e/7OYVdVGvwsqCwcy03mIPkQrn84HFND84kYcNXrw5TsmboHH+P4Koi5FDS/KePusiD9WlG1uHmFopatVwQQc6sEVe8ocqk4Ulj3BZ64dPRPv/FbgHYRsvc7lee2bb6bYWlfTXmYxpRRjMm3wzQe2pHSqcevyjF1hBQQhL7k8oDvFnZRlXZkocz+pClftIIq0BR6WRGCVKPBVIZEmtTkr68rqUvGuW1papzHP/cYxwTHzBytbiDJ/zT149saivx5NniLh1sc0BIkzEz0='}
2023-09-05T12:27:56.183 INFO:teuthology.orchestra.console.smithi099:Power off
2023-09-05T12:27:56.184 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:27:56.205 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-09-05T12:27:56.206 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:27:56.223 INFO:teuthology.orchestra.console.smithi134:Power off
2023-09-05T12:27:56.224 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-05T12:27:56.234 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-09-05T12:27:56.249 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off
2023-09-05T12:27:56.249 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-05T12:27:56.270 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off
2023-09-05T12:27:56.335 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-09-05T12:27:56.371 INFO:teuthology.orchestra.console.smithi134:Power off completed
2023-09-05T12:27:56.494 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com
2023-09-05T12:27:56.519 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com