2023-09-02T01:04:50.318 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-02T01:04:50.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:04:50.452 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc8c7807670>, signals=[15]) 2023-09-02T01:04:50.454 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging 2023-09-02T01:04:50.455 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:04:50.455 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-09-02T01:04:50.473 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-09-02T01:04:50.473 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-09-02T01:04:50.474 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-02T01:04:50.475 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"} 2023-09-02T01:04:50.498 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-09-02T01:04:50.542 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:04:50.565 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-02T01:04:50.578 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:04:50.578 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 10} 2023-09-02T01:04:50.611 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_9.stream (ID 10) 2023-09-02T01:04:50.611 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 10} 2023-09-02T01:04:50.626 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 9.stream 2023-09-02T01:04:50.626 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:04:50.657 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 9.stream 2023-09-02T01:04:50.657 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:04:50.841 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:04:50.849 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-09-02T01:04:50.878 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1} 2023-09-02T01:04:50.893 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-09-02T01:04:50.943 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:04:50.964 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:04:51.257 INFO:teuthology.orchestra.console.smithi060:Power off 2023-09-02T01:04:51.258 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:04:51.271 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-02T01:04:51.272 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:04:51.279 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-09-02T01:04:51.280 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:51.292 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-02T01:04:51.293 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:51.301 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-09-02T01:04:51.314 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-02T01:04:55.304 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:55.314 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:55.414 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-09-02T01:04:55.423 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-02T01:04:59.418 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:59.425 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:59.528 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-09-02T01:04:59.534 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-02T01:04:59.629 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-09-02T01:04:59.635 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-02T01:04:59.731 INFO:teuthology.orchestra.console.smithi060:Power on 2023-09-02T01:04:59.731 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:04:59.738 INFO:teuthology.orchestra.console.smithi135:Power on 2023-09-02T01:04:59.738 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-02T01:04:59.751 DEBUG:teuthology.orchestra.console.smithi060:power on output: Chassis Power Control: Up/On 2023-09-02T01:04:59.751 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:59.758 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-09-02T01:04:59.758 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:04:59.770 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-09-02T01:04:59.777 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-02T01:05:03.775 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:05:03.782 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:05:03.884 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-09-02T01:05:03.890 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-02T01:05:07.890 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:05:07.897 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:05:07.999 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is on 2023-09-02T01:05:08.007 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-02T01:05:08.101 INFO:teuthology.orchestra.console.smithi060:Power on completed 2023-09-02T01:05:08.108 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-09-02T01:05:08.202 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2023-09-02T01:05:08.202 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:05:08.210 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-09-02T01:05:08.210 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:05:23.446 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:05:23.449 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:05:38.683 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:05:38.704 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:05:53.945 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:05:53.971 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:06:09.209 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:06:09.250 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:06:24.488 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:06:24.493 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:06:41.734 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:06:41.786 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:06:57.390 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:06:57.433 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:07:13.666 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:07:13.965 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:07:42.874 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:07:42.875 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:08:04.745 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:08:05.014 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:08:23.116 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:08:26.163 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:08:38.591 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:08:41.901 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:08:54.144 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:08:57.502 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:09:12.523 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:09:13.158 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:09:31.687 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:09:32.319 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-02T01:09:35.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:09:38.426 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:09:44.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:09:47.483 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:09:50.306 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:09:53.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:09:56.542 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:10:02.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:05.626 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:10:08.095 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:10:11.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:14.682 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:10:20.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:23.738 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-02T01:10:25.090 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:10:29.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:10:41.654 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:10:57.858 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:11:13.666 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:11:28.932 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:11:29.745 WARNING:teuthology.provision.fog.smithi135:timed out 2023-09-02T01:11:35.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:11:36.072 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:11:36.073 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:11:36.409 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-09-02T01:11:36.409 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-09-02T01:11:36.425 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-09-02T01:11:36.426 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-09-02T01:11:36.482 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-09-02T01:11:36.482 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-09-02T01:11:36.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-09-02T01:11:36.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-09-02T01:11:36.676 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-09-02T01:11:36.744 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-09-02T01:11:36.811 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-02T01:11:36.866 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-09-02T01:11:36.867 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2023-09-02T01:11:36.867 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-09-02T01:11:36.867 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:11:36.867 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2023-09-02T01:11:36.867 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:11:36.868 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:11:36.869 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:11:36.869 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:11:36.870 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-09-02T01:11:36.871 DEBUG:teuthology.parallel:result is None 2023-09-02T01:11:44.243 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:11:59.462 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:12:14.623 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:12:29.798 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:12:44.950 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None 2023-09-02T01:12:45.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:12:48.154 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-09-02T01:12:54.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:12:57.210 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-09-02T01:13:03.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:06.298 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-09-02T01:13:12.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:15.358 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-09-02T01:13:21.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:13:24.442 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60 2023-09-02T01:13:30.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:14:30.506 WARNING:teuthology.provision.fog.smithi060:timed out 2023-09-02T01:14:36.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:14:36.775 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-02T01:14:36.775 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-02T01:14:37.159 INFO:teuthology.provision.fog.smithi060:Node is ready 2023-09-02T01:14:37.160 DEBUG:teuthology.orchestra.run.smithi060:> hostname 2023-09-02T01:14:37.175 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2023-09-02T01:14:37.175 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2023-09-02T01:14:37.230 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2023-09-02T01:14:37.231 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-09-02T01:14:37.330 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2023-09-02T01:14:37.362 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2023-09-02T01:14:37.434 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2023-09-02T01:14:37.504 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2023-09-02T01:14:37.578 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-09-02T01:14:37.632 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-09-02T01:14:37.633 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2023-09-02T01:14:37.633 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-09-02T01:14:37.633 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:14:37.634 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2023-09-02T01:14:37.634 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:14:37.634 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:14:37.635 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-09-02T01:14:37.635 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:14:37.635 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:14:37.635 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:14:37.635 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:14:37.636 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:14:37.636 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:14:37.636 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2023-09-02T01:14:37.637 DEBUG:teuthology.parallel:result is None 2023-09-02T01:14:37.802 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2023-09-02T01:14:37.803 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:14:37.829 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-09-02T01:14:37.829 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-02T01:14:37.847 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:14:37.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-09-02T01:14:37.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:14:37.945 DEBUG:teuthology.orchestra.run.smithi060:> true 2023-09-02T01:14:38.017 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2023-09-02T01:14:38.017 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2023-09-02T01:14:38.071 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2023-09-02T01:14:38.072 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2023-09-02T01:14:38.127 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2023-09-02T01:14:38.127 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2023-09-02T01:14:38.127 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2023-09-02T01:14:38.127 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:14:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2023-09-02T01:14:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:14:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:14:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2023-09-02T01:14:38.128 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:14:38.129 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:14:38.129 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:14:38.129 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:14:38.129 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:14:38.129 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:14:38.130 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2023-09-02T01:14:38.154 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-09-02T01:14:38.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-02T01:14:38.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-02T01:14:38.237 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-02T01:14:38.404 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-02T01:14:38.404 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-09-02T01:14:38.459 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-09-02T01:14:38.459 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-02T01:14:38.514 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-09-02T01:14:38.514 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2023-09-02T01:14:38.514 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-09-02T01:14:38.515 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-09-02T01:14:38.515 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2023-09-02T01:14:38.515 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2023-09-02T01:14:38.515 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-02T01:14:38.515 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-02T01:14:38.516 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2023-09-02T01:14:38.516 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-02T01:14:38.516 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-09-02T01:14:38.516 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-02T01:14:38.516 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-02T01:14:38.517 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-02T01:14:38.517 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-02T01:14:38.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:14:38.623 INFO:teuthology.dispatcher.supervisor:Running job 7386728 2023-09-02T01:14:38.624 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386728 --name pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} -- /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386728/orig.config.yaml 2023-09-02T01:14:38.627 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386728 2023-09-02T01:14:38.627 INFO:teuthology.dispatcher.supervisor:Job PID: 458571 2023-09-02T01:14:38.628 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-02T01:16:38.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:18:38.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:20:39.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:22:39.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:24:39.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-02T01:24:39.522 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-02T01:24:39.636 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-02T01:24:39.637 INFO:teuthology.nuke:Checking targets against current locks 2023-09-02T01:24:39.690 DEBUG:teuthology.nuke:shortname: smithi060 2023-09-02T01:24:39.690 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T01:24:39.713 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386728', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:49.544090', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG/LVQfasPR/RC4NtV299KUvdYfxTbBj4Y/0qg+d4omZ240l7qmVvnMZfrHk+ug4rom7qZIAeLvuvlv2Xu/zxxI='} 2023-09-02T01:24:39.717 DEBUG:teuthology.nuke:shortname: smithi135 2023-09-02T01:24:39.717 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-02T01:24:39.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-02_01:04:01-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7386728', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-02 01:04:49.542517', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyI0LoyXbj527WBcm/FonDAdGQJ3Yjw7jyAv4T9QSuqn+YT1tGSHgQAHkE9aqeEVG7BiiJd8+LK1cxF3QgvFbn8zJjtw+mmpGRjdeLUyvRfTTuQbI/MIxYiHX7C24WPqWx7KZe50KYdgriwYu+RlXKrHyrLFvzDIf3wxYTu7YKPf8/uu4iR1QBp+iss7vDwJJboQWlmlRaOHqDOTF5pXRByqgRAxgme9ZGSPuo2CvWPbTZNPlOUUTRHGUih+ogEmGeeiulVVhBZIOHL272adWJBSK8Y9qk7JURjDzXLkRg6IGfVJT0Ua3FXFP7yRQWXRLi9sQcHceXHbGymRW4b9se7vITNLoZUZeVExrGRys1xxAu7nvG+NgQlJ6XM138UDmpIIh6mkrzbHHuUJ776kSro77CNGoqtqU6+8H1cGPbPkI6+QhfB/hlhCe7teyCrdXUnolBHB8JyyYVa7banE2szgu7lsHSgtW8qpbgugQbBhB6djCZhnnPlboj0ueTXdk='} 2023-09-02T01:24:39.763 INFO:teuthology.orchestra.console.smithi060:Power off 2023-09-02T01:24:39.763 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:24:39.784 DEBUG:teuthology.orchestra.console.smithi060:power off output: Chassis Power Control: Down/Off 2023-09-02T01:24:39.785 DEBUG:teuthology.orchestra.console.smithi060:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:24:39.798 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-02T01:24:39.799 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-02T01:24:39.807 DEBUG:teuthology.orchestra.console.smithi060:check power output: Chassis Power is off 2023-09-02T01:24:39.819 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-02T01:24:39.820 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-02T01:24:39.844 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-02T01:24:39.909 INFO:teuthology.orchestra.console.smithi060:Power off completed 2023-09-02T01:24:39.945 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-02T01:24:40.064 INFO:teuthology.lock.ops:unlocked: smithi060.front.sepia.ceph.com 2023-09-02T01:24:40.096 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com