2023-11-04T01:04:39.502 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T01:04:39.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:04:39.655 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f55b56ccdc0>, signals=[15]) 2023-11-04T01:04:39.655 INFO:teuthology.lock.ops:Start node 'smithi130.front.sepia.ceph.com' reimaging 2023-11-04T01:04:39.655 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T01:04:39.655 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-11-04T01:04:39.679 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging 2023-11-04T01:04:39.679 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T01:04:39.679 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-11-04T01:04:39.680 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /host {"name": "smithi130"} 2023-11-04T01:04:39.703 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"} 2023-11-04T01:04:39.763 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T01:04:39.766 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-04T01:04:39.805 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T01:04:39.806 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 10} 2023-11-04T01:04:39.809 DEBUG:teuthology.provision.fog.smithi130:Requesting image smithi_centos_9.stream (ID 10) 2023-11-04T01:04:39.809 DEBUG:teuthology.provision.fog.smithi130:FOG request: PUT /host/235 {"imageID": 10} 2023-11-04T01:04:39.847 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 9.stream 2023-11-04T01:04:39.847 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:04:39.850 INFO:teuthology.provision.fog.smithi130:Scheduling deploy of centos 9.stream 2023-11-04T01:04:39.850 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:04:39.930 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T01:04:39.935 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T01:04:39.981 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1} 2023-11-04T01:04:39.985 DEBUG:teuthology.provision.fog.smithi130:FOG request: POST /host/235/task {"taskTypeID": 1} 2023-11-04T01:04:40.050 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:04:40.071 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:04:40.162 INFO:teuthology.orchestra.console.smithi130:Power off 2023-11-04T01:04:40.163 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:04:40.183 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-11-04T01:04:40.183 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:40.200 INFO:teuthology.orchestra.console.smithi203:Power off 2023-11-04T01:04:40.200 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:04:40.208 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-11-04T01:04:40.223 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-11-04T01:04:40.224 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:40.245 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-04T01:04:40.346 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-11-04T01:04:40.446 INFO:teuthology.orchestra.console.smithi203:Power on 2023-11-04T01:04:40.447 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T01:04:40.467 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On 2023-11-04T01:04:40.467 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:40.487 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-04T01:04:44.213 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:44.322 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-11-04T01:04:44.488 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:44.596 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-04T01:04:48.327 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:48.436 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-11-04T01:04:48.537 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-11-04T01:04:48.597 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:48.638 INFO:teuthology.orchestra.console.smithi130:Power on 2023-11-04T01:04:48.639 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T01:04:48.662 DEBUG:teuthology.orchestra.console.smithi130:power on output: Chassis Power Control: Up/On 2023-11-04T01:04:48.662 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:48.682 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-11-04T01:04:48.705 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2023-11-04T01:04:48.805 INFO:teuthology.orchestra.console.smithi203:Power on completed 2023-11-04T01:04:48.906 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish 2023-11-04T01:04:48.906 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:04:52.686 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:52.794 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-11-04T01:04:56.799 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:04:57.018 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-11-04T01:04:57.119 INFO:teuthology.orchestra.console.smithi130:Power on completed 2023-11-04T01:04:57.219 INFO:teuthology.provision.fog.smithi130:Waiting for deploy to finish 2023-11-04T01:04:57.219 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:05:04.025 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:05:12.348 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:05:19.165 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:05:27.454 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:05:34.299 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:05:42.614 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:05:49.517 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:05:57.846 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:06:04.746 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:06:13.116 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:06:20.020 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:06:28.366 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:06:35.280 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:06:43.630 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:07:17.226 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:07:19.282 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:07:38.974 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None 2023-11-04T01:07:39.383 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:07:45.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:07:48.923 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:07:54.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:07:58.011 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:08:02.796 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:08:04.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:08:07.066 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:08:13.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:08:16.154 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:08:22.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:08:23.185 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:08:25.242 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:08:31.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:08:41.509 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:08:49.658 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:08:55.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:08:58.746 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:09:00.737 DEBUG:teuthology.provision.fog.smithi130:FOG request: GET /task/active None 2023-11-04T01:09:04.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:04.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:07.706 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:09:07.802 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-04T01:09:13.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:13.803 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:14.027 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:09:14.027 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T01:09:16.794 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:09:22.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:25.850 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:09:29.401 INFO:teuthology.provision.fog.smithi203:Node is ready 2023-11-04T01:09:29.401 DEBUG:teuthology.orchestra.run.smithi203:> hostname 2023-11-04T01:09:29.459 INFO:teuthology.orchestra.run.smithi203.stdout:smithi046 2023-11-04T01:09:29.459 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi046 /etc/hosts 2023-11-04T01:09:29.516 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2023-11-04T01:09:29.516 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-11-04T01:09:29.688 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi046/smithi203/g' /etc/hosts 2023-11-04T01:09:29.721 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.46/172.21.15.203/g' /etc/hosts 2023-11-04T01:09:29.792 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi046/smithi203/g' /etc/hostname 2023-11-04T01:09:29.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203 2023-11-04T01:09:29.930 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-11-04T01:09:29.992 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-11-04T01:09:29.992 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:09:29.993 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:09:29.995 INFO:teuthology.provision.fog.smithi203:Deploy complete! 2023-11-04T01:09:29.996 DEBUG:teuthology.parallel:result is None 2023-11-04T01:09:31.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:34.906 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:09:40.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:09:43.994 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:09:50.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:08.506 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:10:14.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:17.562 WARNING:teuthology.provision.fog.smithi130:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-11-04T01:10:23.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:26.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T01:10:26.837 DEBUG:teuthology.orchestra.run.smithi130:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T01:10:52.116 INFO:teuthology.provision.fog.smithi130:Node is ready 2023-11-04T01:10:52.117 DEBUG:teuthology.orchestra.run.smithi130:> hostname 2023-11-04T01:10:52.135 INFO:teuthology.orchestra.run.smithi130.stdout:smithi130.front.sepia.ceph.com 2023-11-04T01:10:52.135 DEBUG:teuthology.orchestra.run.smithi130:> grep smithi130.front.sepia.ceph.com /etc/hosts 2023-11-04T01:10:52.192 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.15.130 smithi130.front.sepia.ceph.com smithi130 2023-11-04T01:10:52.192 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-11-04T01:10:52.316 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hosts 2023-11-04T01:10:52.347 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/172.21.15.130/172.21.15.130/g' /etc/hosts 2023-11-04T01:10:52.416 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i -e 's/smithi130.front.sepia.ceph.com/smithi130/g' /etc/hostname 2023-11-04T01:10:52.486 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname smithi130 2023-11-04T01:10:52.553 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:52.608 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:52.609 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:52.609 INFO:teuthology.provision.fog.smithi130:Deploy complete! 2023-11-04T01:10:52.610 DEBUG:teuthology.parallel:result is None 2023-11-04T01:10:52.800 INFO:teuthology.lock.ops:Checking smithi130.front.sepia.ceph.com 2023-11-04T01:10:52.800 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T01:10:52.826 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com 2023-11-04T01:10:52.826 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T01:10:52.843 INFO:teuthology.lock.ops:Updating [smithi130.front.sepia.ceph.com]: set os type and version on server 2023-11-04T01:10:52.844 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T01:10:52.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:52.924 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-11-04T01:10:52.992 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-11-04T01:10:52.992 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-11-04T01:10:53.046 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-11-04T01:10:53.046 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-11-04T01:10:53.100 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-11-04T01:10:53.100 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2023-11-04T01:10:53.100 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:53.101 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:53.102 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-11-04T01:10:53.126 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server 2023-11-04T01:10:53.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-04T01:10:53.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T01:10:53.208 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-11-04T01:10:53.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-04T01:10:53.380 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-11-04T01:10:53.434 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-11-04T01:10:53.434 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2023-11-04T01:10:53.489 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-04T01:10:53.490 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-04T01:10:53.490 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-04T01:10:53.490 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-11-04T01:10:53.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:10:53.597 INFO:teuthology.dispatcher.supervisor:Running job 7445928 2023-11-04T01:10:53.597 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi/7445928 --name pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snapshots} -- /home/teuthworker/archive/pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi/7445928/orig.config.yaml 2023-11-04T01:10:53.600 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi/7445928 2023-11-04T01:10:53.600 INFO:teuthology.dispatcher.supervisor:Job PID: 3087363 2023-11-04T01:10:53.601 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-04T01:12:53.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:24:49.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:26:50.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:28:50.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:30:50.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:32:50.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:34:50.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:36:51.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:38:51.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:40:51.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:42:51.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:44:51.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:46:52.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:48:52.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:50:52.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:52:52.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T01:52:52.640 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-04T01:52:52.755 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-04T01:52:52.755 INFO:teuthology.nuke:Checking targets against current locks 2023-11-04T01:52:52.797 DEBUG:teuthology.nuke:shortname: smithi130 2023-11-04T01:52:52.798 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:52:52.817 DEBUG:teuthology.nuke:shortname: smithi203 2023-11-04T01:52:52.817 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-04T01:52:52.820 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi/7445928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:38.722317', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOLZFNcOtLCuIfVwdSZDWY6SXyJ+KNsuvTvdYuWQHf/XuBy2WdiluIwiII29qCGc3e5yZ8bh46Y7KRPyCHr6Kms='} 2023-11-04T01:52:52.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-11-03_18:13:51-fs:functional-main-distro-default-smithi/7445928', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 01:04:38.724824', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFouHkakb2tDMklTrHDubCihp7AntKvfMOYT5sLSIceWHpE+pStCcAFvnHUKdCjbHXbBFTZSjL5zec6KqAWD36A='} 2023-11-04T01:52:52.868 INFO:teuthology.orchestra.console.smithi130:Power off 2023-11-04T01:52:52.868 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:52:52.889 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-11-04T01:52:52.889 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:52:52.902 INFO:teuthology.orchestra.console.smithi203:Power off 2023-11-04T01:52:52.902 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T01:52:52.910 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-11-04T01:52:52.922 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2023-11-04T01:52:52.922 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T01:52:52.942 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2023-11-04T01:52:53.012 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-11-04T01:52:53.043 INFO:teuthology.orchestra.console.smithi203:Power off completed 2023-11-04T01:52:53.164 INFO:teuthology.lock.ops:unlocked: smithi130.front.sepia.ceph.com 2023-11-04T01:52:53.188 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com