2023-11-15T17:42:26.480 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-15T17:42:26.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:42:26.625 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f73d9dbeac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f73da8a8670>, signals=[15])
2023-11-15T17:42:26.626 INFO:teuthology.lock.ops:Start node 'smithi066.front.sepia.ceph.com' reimaging
2023-11-15T17:42:26.627 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T17:42:26.627 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-11-15T17:42:26.648 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2023-11-15T17:42:26.649 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2023-11-15T17:42:26.649 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-15T17:42:26.650 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /host {"name": "smithi066"}
2023-11-15T17:42:26.673 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /host {"name": "smithi104"}
2023-11-15T17:42:26.729 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-15T17:42:26.733 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-15T17:42:26.768 DEBUG:teuthology.provision.fog.smithi066:Requesting image smithi_centos_9.stream (ID 10)
2023-11-15T17:42:26.769 DEBUG:teuthology.provision.fog.smithi066:FOG request: PUT /host/171 {"imageID": 10}
2023-11-15T17:42:26.773 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10)
2023-11-15T17:42:26.773 DEBUG:teuthology.provision.fog.smithi104:FOG request: PUT /host/209 {"imageID": 10}
2023-11-15T17:42:26.816 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream
2023-11-15T17:42:26.816 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:42:26.819 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of centos 9.stream
2023-11-15T17:42:26.819 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:42:26.894 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T17:42:26.898 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /tasktype {"name": "deploy"}
2023-11-15T17:42:26.931 DEBUG:teuthology.provision.fog.smithi104:FOG request: POST /host/209/task {"taskTypeID": 1}
2023-11-15T17:42:26.938 DEBUG:teuthology.provision.fog.smithi066:FOG request: POST /host/171/task {"taskTypeID": 1}
2023-11-15T17:42:26.989 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:42:26.992 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:42:27.100 INFO:teuthology.orchestra.console.smithi066:Power off
2023-11-15T17:42:27.101 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T17:42:27.117 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-15T17:42:27.118 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T17:42:27.125 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-11-15T17:42:27.126 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:27.140 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-15T17:42:27.140 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:27.148 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-11-15T17:42:27.161 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-15T17:42:31.153 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:31.161 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:31.263 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-11-15T17:42:31.271 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-15T17:42:35.266 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:35.273 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:35.376 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-11-15T17:42:35.382 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-15T17:42:35.478 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-11-15T17:42:35.484 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-15T17:42:35.579 INFO:teuthology.orchestra.console.smithi066:Power on
2023-11-15T17:42:35.580 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T17:42:35.587 INFO:teuthology.orchestra.console.smithi104:Power on
2023-11-15T17:42:35.588 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-15T17:42:35.601 DEBUG:teuthology.orchestra.console.smithi066:power on output: Chassis Power Control: Up/On
2023-11-15T17:42:35.602 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:35.609 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2023-11-15T17:42:35.610 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:35.622 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-11-15T17:42:35.630 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-15T17:42:39.626 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:39.633 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:39.735 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-11-15T17:42:39.742 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-15T17:42:43.738 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:43.745 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T17:42:43.848 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is on
2023-11-15T17:42:43.854 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2023-11-15T17:42:43.949 INFO:teuthology.orchestra.console.smithi066:Power on completed
2023-11-15T17:42:43.955 INFO:teuthology.orchestra.console.smithi104:Power on completed
2023-11-15T17:42:44.050 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish
2023-11-15T17:42:44.051 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:42:44.056 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2023-11-15T17:42:44.056 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:42:59.142 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:42:59.144 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:43:14.234 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:43:14.236 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:43:29.326 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:43:29.328 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:43:44.410 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:43:44.412 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:43:59.492 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:43:59.494 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:44:14.582 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:44:14.584 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:44:29.674 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:44:29.676 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:44:44.795 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:44:44.796 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:44:59.894 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:44:59.896 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:45:14.983 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:45:14.984 DEBUG:teuthology.provision.fog.smithi104:FOG request: GET /task/active None
2023-11-15T17:45:15.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:45:15.354 ERROR:teuthology.orchestra.connection:Error authenticating with smithi104.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-15T17:45:30.047 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:45:45.092 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:46:00.147 DEBUG:teuthology.provision.fog.smithi066:FOG request: GET /task/active None
2023-11-15T17:46:00.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:03.258 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:09.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:12.314 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:18.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:19.358 WARNING:teuthology.provision.fog.smithi104:timed out
2023-11-15T17:46:21.370 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:25.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:27.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:30.426 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:36.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:39.482 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:43.710 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-15T17:46:45.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:48.538 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:49.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:52.766 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2023-11-15T17:46:54.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:57.594 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:46:58.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:46:59.044 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T17:46:59.045 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T17:47:03.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:47:06.650 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:47:12.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:47:15.710 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:47:19.387 INFO:teuthology.provision.fog.smithi104:Node is ready
2023-11-15T17:47:19.387 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2023-11-15T17:47:19.406 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2023-11-15T17:47:19.407 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2023-11-15T17:47:19.464 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2023-11-15T17:47:19.465 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-15T17:47:19.590 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2023-11-15T17:47:19.621 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2023-11-15T17:47:19.690 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2023-11-15T17:47:19.759 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2023-11-15T17:47:19.827 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-15T17:47:19.882 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2023-11-15T17:47:19.882 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2023-11-15T17:47:19.882 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2023-11-15T17:47:19.883 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2023-11-15T17:47:19.883 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2023-11-15T17:47:19.883 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2023-11-15T17:47:19.883 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T17:47:19.883 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-15T17:47:19.884 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2023-11-15T17:47:19.884 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T17:47:19.884 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2023-11-15T17:47:19.884 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T17:47:19.884 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T17:47:19.885 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T17:47:19.885 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2023-11-15T17:47:19.887 DEBUG:teuthology.parallel:result is None
2023-11-15T17:47:21.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:47:24.766 WARNING:teuthology.provision.fog.smithi066:[Errno None] Unable to connect to port 22 on 172.21.15.66
2023-11-15T17:47:30.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:48:30.771 WARNING:teuthology.provision.fog.smithi066:timed out
2023-11-15T17:48:36.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:48:37.064 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-15T17:48:37.065 DEBUG:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-15T17:48:37.405 INFO:teuthology.provision.fog.smithi066:Node is ready
2023-11-15T17:48:37.405 DEBUG:teuthology.orchestra.run.smithi066:> hostname
2023-11-15T17:48:37.421 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com
2023-11-15T17:48:37.421 DEBUG:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts
2023-11-15T17:48:37.477 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066
2023-11-15T17:48:37.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-11-15T17:48:37.596 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts
2023-11-15T17:48:37.628 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts
2023-11-15T17:48:37.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname
2023-11-15T17:48:37.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo hostname smithi066
2023-11-15T17:48:37.840 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-11-15T17:48:37.894 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2023-11-15T17:48:37.895 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2023-11-15T17:48:37.895 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2023-11-15T17:48:37.895 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2023-11-15T17:48:37.895 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2023-11-15T17:48:37.895 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2023-11-15T17:48:37.896 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T17:48:37.896 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-11-15T17:48:37.896 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2023-11-15T17:48:37.896 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T17:48:37.896 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2023-11-15T17:48:37.897 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T17:48:37.897 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T17:48:37.897 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T17:48:37.897 INFO:teuthology.provision.fog.smithi066:Deploy complete!
2023-11-15T17:48:37.898 DEBUG:teuthology.parallel:result is None
2023-11-15T17:48:38.074 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com
2023-11-15T17:48:38.075 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-15T17:48:38.099 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2023-11-15T17:48:38.099 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-15T17:48:38.116 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server
2023-11-15T17:48:38.116 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-11-15T17:48:38.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:48:38.212 DEBUG:teuthology.orchestra.run.smithi066:> true
2023-11-15T17:48:38.280 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com'
2023-11-15T17:48:38.281 DEBUG:teuthology.orchestra.run.smithi066:> uname -m
2023-11-15T17:48:38.335 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64
2023-11-15T17:48:38.335 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release
2023-11-15T17:48:38.390 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream"
2023-11-15T17:48:38.390 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T17:48:38.391 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31"
2023-11-15T17:48:38.392 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon"
2023-11-15T17:48:38.392 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T17:48:38.392 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/"
2023-11-15T17:48:38.392 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T17:48:38.392 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T17:48:38.393 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T17:48:38.393 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server
2023-11-15T17:48:38.415 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2023-11-15T17:48:38.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-15T17:48:38.416 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-15T17:48:38.500 DEBUG:teuthology.orchestra.run.smithi104:> true
2023-11-15T17:48:38.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2023-11-15T17:48:38.668 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2023-11-15T17:48:38.722 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2023-11-15T17:48:38.723 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2023-11-15T17:48:38.777 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2023-11-15T17:48:38.777 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2023-11-15T17:48:38.777 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2023-11-15T17:48:38.778 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2023-11-15T17:48:38.778 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2023-11-15T17:48:38.778 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2023-11-15T17:48:38.778 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-15T17:48:38.779 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2023-11-15T17:48:38.779 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2023-11-15T17:48:38.779 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-15T17:48:38.779 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2023-11-15T17:48:38.779 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-15T17:48:38.780 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-15T17:48:38.780 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-15T17:48:38.780 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2023-11-15T17:48:38.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:48:38.880 INFO:teuthology.dispatcher.supervisor:Running job 7459259
2023-11-15T17:48:38.880 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_choffman@teuthology --archive /home/teuthworker/archive/choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi/7459259 --name choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} -- /home/teuthworker/archive/choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi/7459259/orig.config.yaml
2023-11-15T17:48:38.884 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi/7459259
2023-11-15T17:48:38.884 INFO:teuthology.dispatcher.supervisor:Job PID: 935171
2023-11-15T17:48:38.885 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-15T17:50:38.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:52:38.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:54:39.032 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:56:39.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T17:58:39.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T18:00:39.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T18:02:39.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T18:04:39.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T18:06:39.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-15T18:06:39.507 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-15T18:06:39.610 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-15T18:06:39.611 INFO:teuthology.nuke:Checking targets against current locks
2023-11-15T18:06:39.659 DEBUG:teuthology.nuke:shortname: smithi066
2023-11-15T18:06:39.659 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T18:06:39.675 DEBUG:teuthology.nuke:shortname: smithi104
2023-11-15T18:06:39.675 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-15T18:06:39.679 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi/7459259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 17:42:25.653017', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJMi9z7YbQbFtUtOjk7/7txB7bVPk4UomzovTN68Iu9hvkvfSBZvColqMc04v4bpry2wD5OCoAIKJF+JeJSsuIo='}
2023-11-15T18:06:39.693 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi104.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/choffman-2023-11-15_17:41:22-fs:functional-wip-mchangir-testing-20231110.052303-distro-default-smithi/7459259', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-15 17:42:25.654571', 'locked_by': 'scheduled_choffman@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtkvxy61ZMz+JgzrUbaH2ETPBsWeDhVL+eHUdFBdGYjozRDcV4dUU/B7aNL7j2r9NjwZV9RCwCSF6GYUrFV/js='}
2023-11-15T18:06:39.722 INFO:teuthology.orchestra.console.smithi066:Power off
2023-11-15T18:06:39.723 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T18:06:39.741 INFO:teuthology.orchestra.console.smithi104:Power off
2023-11-15T18:06:39.741 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-15T18:06:39.750 DEBUG:teuthology.orchestra.console.smithi066:power off output: Chassis Power Control: Down/Off
2023-11-15T18:06:39.751 DEBUG:teuthology.orchestra.console.smithi066:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T18:06:39.763 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2023-11-15T18:06:39.764 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-15T18:06:39.772 DEBUG:teuthology.orchestra.console.smithi066:check power output: Chassis Power is off
2023-11-15T18:06:39.787 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2023-11-15T18:06:39.874 INFO:teuthology.orchestra.console.smithi066:Power off completed
2023-11-15T18:06:39.889 INFO:teuthology.orchestra.console.smithi104:Power off completed
2023-11-15T18:06:40.022 INFO:teuthology.lock.ops:unlocked: smithi066.front.sepia.ceph.com
2023-11-15T18:06:40.030 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com