2023-08-03T22:22:36.285 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-03T22:22:36.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:22:36.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7afd7d6280>, signals=[15]) 2023-08-03T22:22:36.425 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-08-03T22:22:36.426 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T22:22:36.426 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-08-03T22:22:36.449 INFO:teuthology.lock.ops:Start node 'smithi186.front.sepia.ceph.com' reimaging 2023-08-03T22:22:36.449 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: reset os type and version on server 2023-08-03T22:22:36.449 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-08-03T22:22:36.451 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-08-03T22:22:36.474 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /host {"name": "smithi186"} 2023-08-03T22:22:36.524 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T22:22:36.534 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-03T22:22:36.567 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T22:22:36.567 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3} 2023-08-03T22:22:36.581 DEBUG:teuthology.provision.fog.smithi186:Requesting image smithi_centos_8.stream (ID 3) 2023-08-03T22:22:36.581 DEBUG:teuthology.provision.fog.smithi186:FOG request: PUT /host/291 {"imageID": 3} 2023-08-03T22:22:36.610 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2023-08-03T22:22:36.610 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:22:36.621 INFO:teuthology.provision.fog.smithi186:Scheduling deploy of centos 8.stream 2023-08-03T22:22:36.621 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:22:36.652 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T22:22:36.658 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /tasktype {"name": "deploy"} 2023-08-03T22:22:36.683 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-08-03T22:22:36.695 DEBUG:teuthology.provision.fog.smithi186:FOG request: POST /host/291/task {"taskTypeID": 1} 2023-08-03T22:22:36.741 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:22:36.743 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:22:36.810 INFO:teuthology.orchestra.console.smithi186:Power off 2023-08-03T22:22:36.811 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T22:22:36.823 INFO:teuthology.orchestra.console.smithi099:Power off 2023-08-03T22:22:36.824 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T22:22:36.833 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-08-03T22:22:36.833 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:36.843 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-08-03T22:22:36.843 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:36.852 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-08-03T22:22:36.862 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-08-03T22:22:40.856 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:40.864 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:40.966 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-08-03T22:22:40.975 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-08-03T22:22:44.972 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:44.980 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:45.083 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-08-03T22:22:45.090 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-08-03T22:22:45.191 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-08-03T22:22:45.292 INFO:teuthology.orchestra.console.smithi099:Power on 2023-08-03T22:22:45.292 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T22:22:45.311 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-08-03T22:22:45.312 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:45.331 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-08-03T22:22:49.088 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:49.198 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-08-03T22:22:49.299 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-08-03T22:22:49.332 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:49.400 INFO:teuthology.orchestra.console.smithi186:Power on 2023-08-03T22:22:49.401 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-03T22:22:49.421 DEBUG:teuthology.orchestra.console.smithi186:power on output: Chassis Power Control: Up/On 2023-08-03T22:22:49.421 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:49.441 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-08-03T22:22:49.441 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-08-03T22:22:53.444 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:53.453 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T22:22:53.563 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-08-03T22:22:53.645 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-08-03T22:22:53.665 INFO:teuthology.orchestra.console.smithi186:Power on completed 2023-08-03T22:22:53.746 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-08-03T22:22:53.766 INFO:teuthology.provision.fog.smithi186:Waiting for deploy to finish 2023-08-03T22:22:53.766 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:22:53.847 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-08-03T22:22:53.847 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:23:08.832 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:23:08.897 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:23:23.900 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:23:23.943 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:23:38.955 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:23:38.983 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:23:54.020 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:23:54.029 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:24:09.086 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:24:09.087 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:24:24.152 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:24:24.153 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:24:39.210 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:24:39.211 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:24:54.276 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:24:54.277 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:25:09.334 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:25:09.336 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:25:24.400 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:25:24.401 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:25:39.464 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-08-03T22:25:39.465 DEBUG:teuthology.provision.fog.smithi186:FOG request: GET /task/active None 2023-08-03T22:25:39.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:25:39.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:25:57.872 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-08-03T22:25:57.873 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-08-03T22:26:03.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:03.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:06.928 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-08-03T22:26:06.929 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-08-03T22:26:12.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:12.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:16.016 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-08-03T22:26:16.017 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-08-03T22:26:22.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:22.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:25.072 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-08-03T22:26:25.073 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-08-03T22:26:31.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:31.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:26:34.160 WARNING:teuthology.provision.fog.smithi186:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-08-03T22:26:40.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:27:31.132 WARNING:teuthology.provision.fog.smithi099:timed out 2023-08-03T22:27:37.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:27:37.357 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T22:27:37.358 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T22:27:37.606 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-08-03T22:27:37.606 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-08-03T22:27:37.626 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-08-03T22:27:37.627 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-08-03T22:27:37.689 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-08-03T22:27:37.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-08-03T22:27:37.801 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-08-03T22:27:37.833 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-08-03T22:27:37.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-08-03T22:27:37.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-08-03T22:27:38.038 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-08-03T22:27:38.096 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-08-03T22:27:38.097 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T22:27:38.098 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T22:27:38.099 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-08-03T22:27:38.100 DEBUG:teuthology.parallel:result is None 2023-08-03T22:27:40.171 WARNING:teuthology.provision.fog.smithi186:timed out 2023-08-03T22:27:46.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:27:46.366 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-03T22:27:46.366 DEBUG:teuthology.orchestra.run.smithi186:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-03T22:27:46.611 INFO:teuthology.provision.fog.smithi186:Node is ready 2023-08-03T22:27:46.611 DEBUG:teuthology.orchestra.run.smithi186:> hostname 2023-08-03T22:27:46.631 INFO:teuthology.orchestra.run.smithi186.stdout:smithi186.front.sepia.ceph.com 2023-08-03T22:27:46.631 DEBUG:teuthology.orchestra.run.smithi186:> grep smithi186.front.sepia.ceph.com /etc/hosts 2023-08-03T22:27:46.690 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.15.186 smithi186.front.sepia.ceph.com smithi186 2023-08-03T22:27:46.690 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-08-03T22:27:46.807 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hosts 2023-08-03T22:27:46.836 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/172.21.15.186/172.21.15.186/g' /etc/hosts 2023-08-03T22:27:46.904 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i -e 's/smithi186.front.sepia.ceph.com/smithi186/g' /etc/hostname 2023-08-03T22:27:46.971 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname smithi186 2023-08-03T22:27:47.037 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-08-03T22:27:47.095 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-08-03T22:27:47.096 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T22:27:47.097 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T22:27:47.098 INFO:teuthology.provision.fog.smithi186:Deploy complete! 2023-08-03T22:27:47.098 DEBUG:teuthology.parallel:result is None 2023-08-03T22:27:47.236 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-08-03T22:27:47.237 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T22:27:47.265 INFO:teuthology.lock.ops:Checking smithi186.front.sepia.ceph.com 2023-08-03T22:27:47.265 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-03T22:27:47.283 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-08-03T22:27:47.283 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-08-03T22:27:47.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:27:47.350 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-08-03T22:27:47.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-08-03T22:27:47.422 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-08-03T22:27:47.482 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-08-03T22:27:47.482 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-08-03T22:27:47.541 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-08-03T22:27:47.541 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-08-03T22:27:47.541 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-08-03T22:27:47.541 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-08-03T22:27:47.542 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T22:27:47.543 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T22:27:47.543 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T22:27:47.543 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-08-03T22:27:47.565 INFO:teuthology.lock.ops:Updating [smithi186.front.sepia.ceph.com]: set os type and version on server 2023-08-03T22:27:47.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-08-03T22:27:47.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-03T22:27:47.628 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-08-03T22:27:47.693 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-08-03T22:27:47.694 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-08-03T22:27:47.751 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-08-03T22:27:47.752 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-08-03T22:27:47.808 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2023-08-03T22:27:47.808 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2023-08-03T22:27:47.808 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-08-03T22:27:47.809 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-03T22:27:47.810 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2023-08-03T22:27:47.810 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-03T22:27:47.810 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-03T22:27:47.810 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-03T22:27:47.810 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-08-03T22:27:47.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:27:47.915 INFO:teuthology.dispatcher.supervisor:Running job 7359634 2023-08-03T22:27:47.915 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi/7359634 --name adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi/7359634/orig.config.yaml 2023-08-03T22:27:47.919 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi/7359634 2023-08-03T22:27:47.920 INFO:teuthology.dispatcher.supervisor:Job PID: 25383 2023-08-03T22:27:47.920 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-03T22:29:48.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:31:48.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:33:48.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:35:48.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:37:48.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:39:48.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:41:48.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:43:49.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:45:49.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:47:49.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:49:49.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:51:49.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:53:49.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:55:50.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:57:50.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T22:59:50.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:01:50.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:03:50.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:05:50.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:07:50.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:09:51.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-03T23:09:51.198 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-03T23:09:51.296 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-03T23:09:51.297 INFO:teuthology.nuke:Checking targets against current locks 2023-08-03T23:09:51.343 DEBUG:teuthology.nuke:shortname: smithi099 2023-08-03T23:09:51.344 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T23:09:51.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi/7359634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 22:22:35.521585', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSwm2EQizNlesDLZs+tRC9tQcSEQG4wqFFlJCtuwLW1RPqUmmmBfO8hKgBXf5IzJZSRihuj2AaqUSQ27RWIXd8H6SkJuT9g7YvdLTZcuOsVHWxTxaieRjEhZzWSmByhhjoU6aI6GU7Pawd1xTR2qaf8+8VBS/TRFUQVD37861pYA/yCfPpNINXaTgJFr2fgZUYZ9/HxWArMfi1WA/KUlkBbCfe2MShgjS2ZEcZnKn9pxbAi7sVHPpogGwiJHcMDQWeENpG/i7wb/mF7h5NeW1RCKIeSV/7r0YcVQ0loDqNr6bLYdN4a/fWcD6Yy+Cbc03DeDJewmvu08F6p2ENUjcUrNgK6LloCMygULCNVeDnai9iQQoAPuoxrQpYLrn9w7S6xb98ra6sGVEieHIscgUtgXjNByp8fpVA/5fZwWGXXewbXkksqsK4hf07qUqjtWsDryCB3kztKE5cdXZRwlmuNNMHXdajGHFB1ejjNIijNd8FCmYw1nvXiuRf9a+/x5s='} 2023-08-03T23:09:51.367 DEBUG:teuthology.nuke:shortname: smithi186 2023-08-03T23:09:51.367 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-03T23:09:51.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-03_14:45:10-orch:cephadm-main-distro-default-smithi/7359634', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-03 22:22:35.519609', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDVWpkMSoFbQDX5Xnu1YGrxy0j7j+18KLbD5X8/5UgE3wgWnOp3WarVEvnXOn0Qya5AXBISVmi+lsGUltw3GdTiNdADdojO3UQFfAeC3/8QHhMQXOiNWRK9u8mjX0HWIM45dF593S4lpXRcdItfgd1TGzqf6odmfqFuFKz7ds8e6sC+JBQEgD6hScvdosV+e2k9yW2utPPpBecYR3NoZluRa1dSfQBNbZep0gfJGKfppNrh7R+0+RCquHIx074CL6NtektPcFeT3r8N9LtM0WHUaDw9HwT/AbsDTvMhbvcVZzwx6ykm9hanEb3hhAbMtDo8i7Imu5834e+L7ziv68p8XtSYx1sIGujObyseUWeLDgdWJyMD2QaQNe8oX/lSghLoPOFzdXEd1OilvWTHM1xlhfqdYIV7DzWsZn08V4RaXQ6yxXT+WUVuCRMFWMNzk4p/MhW6o8O8jV3CMbyU/tuDcFaztb/ozkh/c0k6jiKhI3+LTTH+Y2t4X72wu8DvhNE='} 2023-08-03T23:09:51.415 INFO:teuthology.orchestra.console.smithi099:Power off 2023-08-03T23:09:51.416 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T23:09:51.435 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-08-03T23:09:51.436 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T23:09:51.454 INFO:teuthology.orchestra.console.smithi186:Power off 2023-08-03T23:09:51.455 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-03T23:09:51.463 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-08-03T23:09:51.474 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-08-03T23:09:51.474 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-03T23:09:51.494 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-08-03T23:09:51.564 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-08-03T23:09:51.595 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-08-03T23:09:51.714 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com 2023-08-03T23:09:51.739 INFO:teuthology.lock.ops:unlocked: smithi186.front.sepia.ceph.com