2023-08-23T06:57:42.174 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T06:57:42.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T06:57:42.328 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faeff09e310>, signals=[15]) 2023-08-23T06:57:42.330 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-08-23T06:57:42.330 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T06:57:42.330 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-23T06:57:42.351 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-08-23T06:57:42.351 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-08-23T06:57:42.351 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-08-23T06:57:42.353 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-08-23T06:57:42.376 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-08-23T06:57:42.427 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-23T06:57:42.443 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-23T06:57:42.466 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-08-23T06:57:42.466 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 10} 2023-08-23T06:57:42.478 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_9.stream (ID 10) 2023-08-23T06:57:42.479 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 10} 2023-08-23T06:57:42.510 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-08-23T06:57:42.510 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:57:42.522 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 9.stream 2023-08-23T06:57:42.522 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:57:42.585 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T06:57:42.592 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-08-23T06:57:42.624 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-08-23T06:57:42.626 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-08-23T06:57:42.701 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:57:42.705 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:57:42.814 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-23T06:57:42.815 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:57:42.830 INFO:teuthology.orchestra.console.smithi187:Power off 2023-08-23T06:57:42.831 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T06:57:42.842 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-23T06:57:42.843 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:42.855 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-08-23T06:57:42.856 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:42.870 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-23T06:57:42.879 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-23T06:57:46.872 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:46.882 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:46.985 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-23T06:57:46.994 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-23T06:57:50.989 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:50.998 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:51.101 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-23T06:57:51.109 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-23T06:57:51.209 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-08-23T06:57:51.310 INFO:teuthology.orchestra.console.smithi187:Power on 2023-08-23T06:57:51.310 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T06:57:51.332 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-08-23T06:57:51.333 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:51.355 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-23T06:57:55.105 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:55.217 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-23T06:57:55.318 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-23T06:57:55.357 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:55.420 INFO:teuthology.orchestra.console.smithi112:Power on 2023-08-23T06:57:55.421 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-23T06:57:55.441 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-08-23T06:57:55.442 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:55.463 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-23T06:57:55.469 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-23T06:57:59.471 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:59.481 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:57:59.583 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-23T06:57:59.592 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-23T06:57:59.693 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-08-23T06:57:59.794 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-08-23T06:57:59.795 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:58:03.585 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T06:58:03.695 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-23T06:58:03.795 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-08-23T06:58:03.897 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-08-23T06:58:03.897 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:58:14.876 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:58:18.972 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:58:29.952 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:58:34.052 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:58:45.024 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:58:49.125 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:59:00.108 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:59:04.196 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:59:15.176 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:59:19.272 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:59:30.249 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:59:34.344 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T06:59:45.324 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T06:59:49.417 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T07:00:00.409 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T07:00:04.500 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T07:00:15.488 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T07:00:19.568 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T07:00:30.564 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-08-23T07:00:30.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:33.680 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:00:34.628 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-23T07:00:34.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:37.744 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:00:39.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:42.736 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:00:43.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:46.800 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:00:48.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:51.792 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:00:52.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:00:55.860 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:00:57.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:00.848 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:01:01.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:04.912 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:01:06.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:09.904 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:01:10.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:13.968 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:01:15.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:18.960 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-23T07:01:19.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:23.025 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-23T07:01:24.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:01:29.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:02:25.020 WARNING:teuthology.provision.fog.smithi187:timed out 2023-08-23T07:02:29.032 WARNING:teuthology.provision.fog.smithi112:timed out 2023-08-23T07:02:31.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:02:31.232 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T07:02:31.233 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T07:02:31.576 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-08-23T07:02:31.576 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-08-23T07:02:31.592 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2023-08-23T07:02:31.592 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2023-08-23T07:02:31.648 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-08-23T07:02:31.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-08-23T07:02:31.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2023-08-23T07:02:31.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-08-23T07:02:31.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2023-08-23T07:02:31.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-08-23T07:02:32.010 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-08-23T07:02:32.069 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-08-23T07:02:32.070 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-08-23T07:02:32.070 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-08-23T07:02:32.070 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-08-23T07:02:32.071 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-08-23T07:02:32.071 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-08-23T07:02:32.071 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T07:02:32.072 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-08-23T07:02:32.072 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-08-23T07:02:32.072 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T07:02:32.073 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-08-23T07:02:32.073 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T07:02:32.073 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T07:02:32.073 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T07:02:32.074 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-08-23T07:02:32.076 DEBUG:teuthology.parallel:result is None 2023-08-23T07:02:35.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:02:35.315 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-23T07:02:35.315 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-23T07:02:35.714 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-08-23T07:02:35.714 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-08-23T07:02:35.730 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-08-23T07:02:35.731 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-08-23T07:02:35.788 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-08-23T07:02:35.789 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-23T07:02:35.912 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-08-23T07:02:35.941 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-08-23T07:02:36.010 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-08-23T07:02:36.078 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-23T07:02:36.145 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-23T07:02:36.201 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-23T07:02:36.202 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T07:02:36.203 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T07:02:36.204 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-08-23T07:02:36.204 DEBUG:teuthology.parallel:result is None 2023-08-23T07:02:36.352 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-08-23T07:02:36.353 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T07:02:36.382 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-08-23T07:02:36.382 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-23T07:02:36.399 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-08-23T07:02:36.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-23T07:02:36.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:02:36.487 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-08-23T07:02:36.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-23T07:02:36.552 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-08-23T07:02:36.605 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-08-23T07:02:36.606 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-23T07:02:36.659 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-23T07:02:36.659 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-23T07:02:36.659 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-23T07:02:36.659 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-23T07:02:36.659 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-23T07:02:36.660 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T07:02:36.661 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T07:02:36.661 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T07:02:36.661 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-23T07:02:36.682 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-08-23T07:02:36.682 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-23T07:02:36.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T07:02:36.767 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-08-23T07:02:36.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-23T07:02:36.837 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-08-23T07:02:36.893 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-08-23T07:02:36.894 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-08-23T07:02:36.950 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-08-23T07:02:36.950 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-08-23T07:02:36.950 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-08-23T07:02:36.950 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-23T07:02:36.951 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-08-23T07:02:36.952 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-23T07:02:36.952 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-23T07:02:36.952 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-23T07:02:36.952 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-08-23T07:02:36.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:02:37.074 INFO:teuthology.dispatcher.supervisor:Running job 7377290 2023-08-23T07:02:37.074 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377290 --name vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377290/orig.config.yaml 2023-08-23T07:02:37.078 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377290 2023-08-23T07:02:37.079 INFO:teuthology.dispatcher.supervisor:Job PID: 32312 2023-08-23T07:02:37.079 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-23T07:04:37.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:06:37.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:08:37.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:10:37.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:12:37.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:14:38.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:16:38.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:18:38.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:20:38.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:22:38.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:24:38.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:26:39.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T07:26:39.124 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-23T07:26:39.349 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-23T07:26:39.350 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T07:26:39.413 DEBUG:teuthology.nuke:shortname: smithi112 2023-08-23T07:26:39.413 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T07:26:39.440 DEBUG:teuthology.nuke:shortname: smithi187 2023-08-23T07:26:39.440 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T07:26:39.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 06:57:41.356726', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNtQ2fBpfqAFmVcyJJI5qxOHfGJCj/J3zSHpPXR85qtsf/4cXdDbbooDDAtD85qtWd/pf/o1+PwaCVUAZbAuvfw='} 2023-08-23T07:26:39.468 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-23_03:59:53-fs-wip-vshankar-testing-20230822.060131-testing-default-smithi/7377290', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 06:57:41.358022', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJaHlgg3T5u8WAjAW6YFz4Ji4Wj37ZyaftQnbThSVumeTdEUJZKy+BWSZ3gqrtJXapkVi0CAeKKuLnm9O6yx4jU='} 2023-08-23T07:26:39.512 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-23T07:26:39.513 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T07:26:39.536 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-23T07:26:39.538 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T07:26:39.562 INFO:teuthology.orchestra.console.smithi187:Power off 2023-08-23T07:26:39.562 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T07:26:39.593 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-23T07:26:39.613 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-08-23T07:26:39.614 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T07:26:39.644 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-23T07:26:39.695 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-23T07:26:39.746 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-08-23T07:26:39.848 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-08-23T07:26:39.906 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com