2023-10-31T11:21:09.862 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-31T11:21:09.864 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:21:10.016 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f570a91d670>, signals=[15]) 2023-10-31T11:21:10.018 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-10-31T11:21:10.018 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-10-31T11:21:10.018 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-31T11:21:10.037 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging 2023-10-31T11:21:10.038 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server 2023-10-31T11:21:10.038 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-31T11:21:10.039 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-10-31T11:21:10.062 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"} 2023-10-31T11:21:10.109 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-31T11:21:10.134 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-31T11:21:10.153 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_centos_8.stream (ID 3) 2023-10-31T11:21:10.153 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 3} 2023-10-31T11:21:10.173 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3) 2023-10-31T11:21:10.173 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3} 2023-10-31T11:21:10.194 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream 2023-10-31T11:21:10.195 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:21:10.220 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream 2023-10-31T11:21:10.220 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:21:10.248 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-10-31T11:21:10.270 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"} 2023-10-31T11:21:10.286 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-10-31T11:21:10.305 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1} 2023-10-31T11:21:10.339 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:21:10.358 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:21:10.429 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-31T11:21:10.430 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:21:10.443 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-31T11:21:10.444 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:21:10.451 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-31T11:21:10.452 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:10.465 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-31T11:21:10.465 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:10.476 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-31T11:21:10.485 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-31T11:21:10.586 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-31T11:21:10.687 INFO:teuthology.orchestra.console.smithi099:Power on 2023-10-31T11:21:10.687 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-31T11:21:10.708 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On 2023-10-31T11:21:10.708 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:10.732 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-31T11:21:14.479 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:14.589 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-31T11:21:14.733 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:14.843 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-31T11:21:18.595 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:18.703 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-31T11:21:18.804 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-31T11:21:18.845 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:18.905 INFO:teuthology.orchestra.console.smithi086:Power on 2023-10-31T11:21:18.906 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-31T11:21:18.926 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-10-31T11:21:18.927 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:18.947 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-31T11:21:18.954 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2023-10-31T11:21:19.055 INFO:teuthology.orchestra.console.smithi099:Power on completed 2023-10-31T11:21:19.156 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish 2023-10-31T11:21:19.156 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:21:22.950 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:23.058 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-31T11:21:27.062 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:21:27.171 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-10-31T11:21:27.272 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-10-31T11:21:27.373 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-10-31T11:21:27.373 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:21:34.233 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:21:42.442 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:21:49.298 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:21:57.514 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:22:04.372 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:22:12.586 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:22:19.448 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:22:27.661 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:22:34.518 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:22:42.739 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:22:49.588 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:22:57.827 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:23:04.654 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:23:12.910 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:23:19.726 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:23:28.006 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:23:34.808 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:23:43.095 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:23:49.897 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:23:58.179 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:24:04.975 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None 2023-10-31T11:24:05.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:13.250 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-10-31T11:24:13.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:23.546 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:24:29.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:31.738 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:24:32.634 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:24:37.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:38.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:40.830 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:24:41.690 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:24:46.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:47.693 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:49.914 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:24:50.746 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:24:55.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:56.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:24:59.002 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:25:02.842 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:25:05.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:08.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:11.898 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:25:17.903 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:20.954 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99 2023-10-31T11:25:23.450 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:25:26.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:27.990 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-31T11:25:27.991 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-31T11:25:29.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:32.506 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-10-31T11:25:38.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:25:39.168 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-31T11:25:39.168 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-31T11:25:52.970 INFO:teuthology.provision.fog.smithi099:Node is ready 2023-10-31T11:25:52.971 DEBUG:teuthology.orchestra.run.smithi099:> hostname 2023-10-31T11:25:52.996 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com 2023-10-31T11:25:52.996 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts 2023-10-31T11:25:53.056 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099 2023-10-31T11:25:53.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-31T11:25:53.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts 2023-10-31T11:25:53.210 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts 2023-10-31T11:25:53.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname 2023-10-31T11:25:53.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099 2023-10-31T11:25:53.416 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-31T11:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-10-31T11:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-10-31T11:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-10-31T11:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-10-31T11:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-10-31T11:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:25:53.477 INFO:teuthology.provision.fog.smithi099:Deploy complete! 2023-10-31T11:25:53.479 DEBUG:teuthology.parallel:result is None 2023-10-31T11:26:04.842 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-10-31T11:26:04.843 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-10-31T11:26:04.883 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-10-31T11:26:04.884 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-10-31T11:26:04.957 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-10-31T11:26:04.958 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-10-31T11:26:05.101 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-10-31T11:26:05.143 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-10-31T11:26:05.216 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-10-31T11:26:05.289 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-10-31T11:26:05.359 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-31T11:26:05.420 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2023-10-31T11:26:05.421 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2023-10-31T11:26:05.421 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2023-10-31T11:26:05.421 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:26:05.421 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2023-10-31T11:26:05.421 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:26:05.422 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:26:05.422 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-31T11:26:05.422 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:26:05.422 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:26:05.423 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:26:05.423 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:26:05.423 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:26:05.423 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-10-31T11:26:05.424 DEBUG:teuthology.parallel:result is None 2023-10-31T11:26:05.725 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-10-31T11:26:05.725 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-31T11:26:05.745 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com 2023-10-31T11:26:05.746 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-31T11:26:05.772 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-10-31T11:26:05.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-31T11:26:05.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:26:05.841 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-10-31T11:26:05.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-10-31T11:26:05.915 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-10-31T11:26:05.974 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-10-31T11:26:05.975 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-10-31T11:26:06.033 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2023-10-31T11:26:06.033 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8" 2023-10-31T11:26:06.033 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2023-10-31T11:26:06.033 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:26:06.034 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8" 2023-10-31T11:26:06.034 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:26:06.034 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:26:06.034 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2023-10-31T11:26:06.035 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:26:06.035 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:26:06.035 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:26:06.036 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:26:06.036 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:26:06.036 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-10-31T11:26:06.062 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server 2023-10-31T11:26:06.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-31T11:26:06.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:26:06.132 DEBUG:teuthology.orchestra.run.smithi099:> true 2023-10-31T11:26:06.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2023-10-31T11:26:06.275 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2023-10-31T11:26:06.333 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2023-10-31T11:26:06.333 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2023-10-31T11:26:06.392 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream" 2023-10-31T11:26:06.392 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8" 2023-10-31T11:26:06.392 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos" 2023-10-31T11:26:06.392 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:26:06.393 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8" 2023-10-31T11:26:06.393 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:26:06.393 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:26:06.393 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31" 2023-10-31T11:26:06.393 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:26:06.394 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:26:06.394 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:26:06.394 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:26:06.394 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:26:06.395 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2023-10-31T11:26:06.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:26:06.505 INFO:teuthology.dispatcher.supervisor:Running job 7441927 2023-10-31T11:26:06.505 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441927 --name dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} -- /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441927/orig.config.yaml 2023-10-31T11:26:06.508 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441927 2023-10-31T11:26:06.509 INFO:teuthology.dispatcher.supervisor:Job PID: 3844931 2023-10-31T11:26:06.509 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-31T11:28:06.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:30:06.779 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:32:06.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:34:07.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:36:07.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:38:07.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:40:07.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:42:07.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:44:08.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:46:08.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:48:08.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:50:08.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:52:08.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:54:08.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:56:09.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:56:09.096 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-31T11:56:09.265 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-31T11:56:09.266 INFO:teuthology.nuke:Checking targets against current locks 2023-10-31T11:56:09.314 DEBUG:teuthology.nuke:shortname: smithi086 2023-10-31T11:56:09.315 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-31T11:56:09.337 DEBUG:teuthology.nuke:shortname: smithi099 2023-10-31T11:56:09.338 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-31T11:56:09.341 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 11:21:09.061096', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH8Z2j8oREM9qulMeNMpsh+z+2z8HLpJ9cptcK5ZKDEekvb+K5bp8Z7tyHt/bH/3AV0oQTKUHN90FrsghZ0lkO4='} 2023-10-31T11:56:09.359 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 11:21:09.063063', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNDY5dA/7V5ZsTZB8rpUdnafEIzadkd2tL8yKFQRBJ9ETcNRQ4Lex8gPNdeqGYrsGYGVRCHIlu2I0TL0phGLiuE='} 2023-10-31T11:56:09.385 INFO:teuthology.orchestra.console.smithi086:Power off 2023-10-31T11:56:09.385 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:56:09.409 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-10-31T11:56:09.410 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:56:09.423 INFO:teuthology.orchestra.console.smithi099:Power off 2023-10-31T11:56:09.424 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:56:09.432 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-10-31T11:56:09.444 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2023-10-31T11:56:09.445 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:56:09.465 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2023-10-31T11:56:09.534 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-10-31T11:56:09.566 INFO:teuthology.orchestra.console.smithi099:Power off completed 2023-10-31T11:56:09.687 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com 2023-10-31T11:56:09.711 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com