2023-08-17T21:20:33.212 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-17T21:20:33.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:20:33.347 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f7974b310>, signals=[15]) 2023-08-17T21:20:33.349 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-08-17T21:20:33.349 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T21:20:33.349 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-08-17T21:20:33.370 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2023-08-17T21:20:33.371 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2023-08-17T21:20:33.371 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-08-17T21:20:33.372 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-08-17T21:20:33.395 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /host {"name": "smithi105"} 2023-08-17T21:20:33.446 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-17T21:20:33.455 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-17T21:20:33.485 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-08-17T21:20:33.485 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-08-17T21:20:33.487 DEBUG:teuthology.provision.fog.smithi105:Requesting image smithi_centos_8.stream (ID 3) 2023-08-17T21:20:33.487 DEBUG:teuthology.provision.fog.smithi105:FOG request: PUT /host/210 {"imageID": 3} 2023-08-17T21:20:33.534 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-08-17T21:20:33.534 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:20:33.537 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2023-08-17T21:20:33.537 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:20:33.630 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T21:20:33.633 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /tasktype {"name": "deploy"} 2023-08-17T21:20:33.671 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-08-17T21:20:33.677 DEBUG:teuthology.provision.fog.smithi105:FOG request: POST /host/210/task {"taskTypeID": 1} 2023-08-17T21:20:33.717 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:20:33.719 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:20:33.876 INFO:teuthology.orchestra.console.smithi105:Power off 2023-08-17T21:20:33.877 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T21:20:33.892 INFO:teuthology.orchestra.console.smithi090:Power off 2023-08-17T21:20:33.893 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T21:20:33.902 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-08-17T21:20:33.903 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:33.915 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-08-17T21:20:33.916 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:33.926 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-17T21:20:33.938 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-08-17T21:20:37.932 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:37.941 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:38.043 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-17T21:20:38.050 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-08-17T21:20:42.048 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:42.058 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:42.160 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-17T21:20:42.166 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-08-17T21:20:46.166 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:46.173 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:46.276 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-17T21:20:46.282 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-17T21:20:46.378 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-08-17T21:20:46.383 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-08-17T21:20:46.479 INFO:teuthology.orchestra.console.smithi105:Power on 2023-08-17T21:20:46.551 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T21:20:46.561 INFO:teuthology.orchestra.console.smithi090:Power on 2023-08-17T21:20:46.562 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-17T21:20:46.573 DEBUG:teuthology.orchestra.console.smithi105:power on output: Chassis Power Control: Up/On 2023-08-17T21:20:46.574 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:46.583 DEBUG:teuthology.orchestra.console.smithi090:power on output: Chassis Power Control: Up/On 2023-08-17T21:20:46.583 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:46.594 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-17T21:20:46.604 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-17T21:20:50.596 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:50.605 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:50.707 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-17T21:20:50.715 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-17T21:20:54.712 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:54.720 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T21:20:54.822 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is on 2023-08-17T21:20:54.831 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is on 2023-08-17T21:20:54.924 INFO:teuthology.orchestra.console.smithi105:Power on completed 2023-08-17T21:20:54.932 INFO:teuthology.orchestra.console.smithi090:Power on completed 2023-08-17T21:20:55.025 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2023-08-17T21:20:55.025 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:20:55.034 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-08-17T21:20:55.034 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:21:10.264 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:21:10.265 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:21:25.536 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:21:25.541 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:21:40.755 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:21:40.759 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:21:56.040 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:21:56.041 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:22:11.326 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:22:11.341 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:22:26.654 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:22:26.655 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:22:41.948 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:22:41.961 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:22:57.363 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:22:57.365 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:23:19.972 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:23:20.077 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:23:36.660 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:23:36.661 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:23:53.879 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:23:53.881 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:24:12.684 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:24:12.720 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:24:32.600 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:24:33.365 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:24:53.204 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:24:54.618 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:25:13.235 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-08-17T21:25:13.539 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:25:16.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:25:19.696 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:25:25.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:25:28.784 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:25:32.036 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:25:34.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:25:37.840 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:25:43.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:25:46.896 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:25:50.036 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:25:52.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:25:55.952 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:26:01.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:26:05.040 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:26:07.359 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:26:11.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:26:14.096 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:26:20.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:26:23.152 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-08-17T21:26:24.254 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:26:29.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:26:40.460 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:26:56.175 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:27:11.580 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:27:26.852 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:27:29.160 WARNING:teuthology.provision.fog.smithi090:timed out 2023-08-17T21:27:35.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:27:35.458 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T21:27:35.459 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T21:27:35.784 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-08-17T21:27:35.784 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-08-17T21:27:35.804 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-08-17T21:27:35.804 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-08-17T21:27:35.864 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-08-17T21:27:35.864 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-08-17T21:27:35.984 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-08-17T21:27:36.015 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-08-17T21:27:36.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-08-17T21:27:36.153 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-08-17T21:27:36.221 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-08-17T21:27:36.278 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-08-17T21:27:36.278 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-08-17T21:27:36.279 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-17T21:27:36.280 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-08-17T21:27:36.280 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T21:27:36.280 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T21:27:36.280 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-17T21:27:36.281 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-08-17T21:27:36.282 DEBUG:teuthology.parallel:result is None 2023-08-17T21:27:42.032 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:27:57.236 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:28:12.411 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:28:27.604 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:28:42.740 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:28:57.881 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:29:13.007 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:29:28.130 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:29:43.240 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:29:58.332 DEBUG:teuthology.provision.fog.smithi105:FOG request: GET /task/active None 2023-08-17T21:29:58.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:01.488 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:07.492 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:10.544 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:16.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:19.600 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:25.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:28.664 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:34.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:37.744 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:43.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:30:46.800 WARNING:teuthology.provision.fog.smithi105:[Errno None] Unable to connect to port 22 on 172.21.15.105 2023-08-17T21:30:52.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:31:24.634 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-17T21:31:24.634 DEBUG:teuthology.orchestra.run.smithi105:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-17T21:31:49.770 INFO:teuthology.provision.fog.smithi105:Node is ready 2023-08-17T21:31:49.771 DEBUG:teuthology.orchestra.run.smithi105:> hostname 2023-08-17T21:31:49.795 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2023-08-17T21:31:49.795 DEBUG:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2023-08-17T21:31:49.856 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2023-08-17T21:31:49.857 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-08-17T21:31:49.993 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2023-08-17T21:31:50.025 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2023-08-17T21:31:50.095 DEBUG:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2023-08-17T21:31:50.164 DEBUG:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2023-08-17T21:31:50.232 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-08-17T21:31:50.292 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-08-17T21:31:50.292 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-08-17T21:31:50.292 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-17T21:31:50.293 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-08-17T21:31:50.294 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T21:31:50.294 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T21:31:50.294 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-17T21:31:50.295 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2023-08-17T21:31:50.296 DEBUG:teuthology.parallel:result is None 2023-08-17T21:31:50.452 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-08-17T21:31:50.453 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-17T21:31:50.473 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2023-08-17T21:31:50.474 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-17T21:31:50.499 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-08-17T21:31:50.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-08-17T21:31:50.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:31:50.571 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-08-17T21:31:50.707 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-08-17T21:31:50.707 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-08-17T21:31:50.766 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-08-17T21:31:50.767 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-08-17T21:31:50.825 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-08-17T21:31:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-08-17T21:31:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-08-17T21:31:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-08-17T21:31:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-08-17T21:31:50.826 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T21:31:50.827 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-17T21:31:50.828 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-08-17T21:31:50.848 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2023-08-17T21:31:50.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-08-17T21:31:50.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi105.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-17T21:31:50.918 DEBUG:teuthology.orchestra.run.smithi105:> true 2023-08-17T21:31:50.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi105.front.sepia.ceph.com' 2023-08-17T21:31:50.989 DEBUG:teuthology.orchestra.run.smithi105:> uname -m 2023-08-17T21:31:51.047 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2023-08-17T21:31:51.048 DEBUG:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2023-08-17T21:31:51.107 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2023-08-17T21:31:51.107 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2023-08-17T21:31:51.107 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-17T21:31:51.108 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2023-08-17T21:31:51.109 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-17T21:31:51.109 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-17T21:31:51.109 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-17T21:31:51.110 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2023-08-17T21:31:51.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:31:51.229 INFO:teuthology.dispatcher.supervisor:Running job 7371977 2023-08-17T21:31:51.229 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi/7371977 --name yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi --description rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} -- /home/teuthworker/archive/yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi/7371977/orig.config.yaml 2023-08-17T21:31:51.234 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi/7371977 2023-08-17T21:31:51.235 INFO:teuthology.dispatcher.supervisor:Job PID: 3069 2023-08-17T21:31:51.235 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-17T21:33:51.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:35:51.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:37:52.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:39:52.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:41:52.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:43:52.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:45:53.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:47:53.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:49:53.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:51:53.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:53:53.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:55:53.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:57:54.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T21:59:54.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:01:54.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:03:54.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:05:54.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:07:54.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:09:55.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:11:55.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:13:55.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:15:55.522 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:17:55.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:19:55.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:21:56.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:23:56.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T22:23:56.261 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-17T22:23:56.402 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-17T22:23:56.403 INFO:teuthology.nuke:Checking targets against current locks 2023-08-17T22:23:56.447 DEBUG:teuthology.nuke:shortname: smithi090 2023-08-17T22:23:56.447 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T22:23:56.473 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi/7371977', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 21:20:32.435498', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCWWrhVUX5o0a9Vvtg2ydAqaTlf2S4S0rzdbSlCEWUXu3tBbVkQchkPMDNUvgMLx5w/ZMgrtwdcG00yUYYG6FwreX6U74MM1Fj0ENiH3AZx30ajTb2iTNWcgKZf4Nq4yi//j+57yjvYzP7UKIkzc6EX9T+gOxB5jm/y7EmJhsS6E82fMq2z2kpb2lJua71Dew5mk72465ybsV2jTdReE1xtMR7bLAmFzzKnRgRfXWPE73qZtRFu5Mi9ltBrk/NAG9Q61Sh1KwJ8PxGONRS/Qix496czcgmCYYNGc5ShTAHBGBEmvwOSrSpJ6qJCIk4+JT3H6v0A86F80B22DHauyqR/uvtuTdxs6Djyxk1FdoRacmjS62oxhj5wHdISp2ufrglOWhn5+ATMcxNiwax7wpiIpijio+2igJyJ5HoVPr8/pKXrL293XCzQpbKGTtqCoRDcIMvuIwx2lG93pmVOCgDpGqtmW5kQNs6/SPAjLg8VKAEtQeAQPqylS6Q900jaEcU='} 2023-08-17T22:23:56.477 DEBUG:teuthology.nuke:shortname: smithi105 2023-08-17T22:23:56.477 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T22:23:56.501 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi105.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_21:18:20-rados-wip-yuri11-testing-2023-08-17-0823-distro-default-smithi/7371977', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 21:20:32.433214', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIvWdSSXoQlzJNg/rZRz24rA3W6efC7FFE59zerAHGlr0qy7nkuBKRjN+T5BcS4DtUm3ZqKb7Qh3iS9EcpPBCB0='} 2023-08-17T22:23:56.537 INFO:teuthology.orchestra.console.smithi090:Power off 2023-08-17T22:23:56.538 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T22:23:56.562 DEBUG:teuthology.orchestra.console.smithi090:power off output: Chassis Power Control: Down/Off 2023-08-17T22:23:56.563 DEBUG:teuthology.orchestra.console.smithi090:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T22:23:56.582 INFO:teuthology.orchestra.console.smithi105:Power off 2023-08-17T22:23:56.583 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T22:23:56.596 DEBUG:teuthology.orchestra.console.smithi090:check power output: Chassis Power is off 2023-08-17T22:23:56.609 DEBUG:teuthology.orchestra.console.smithi105:power off output: Chassis Power Control: Down/Off 2023-08-17T22:23:56.610 DEBUG:teuthology.orchestra.console.smithi105:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T22:23:56.636 DEBUG:teuthology.orchestra.console.smithi105:check power output: Chassis Power is off 2023-08-17T22:23:56.699 INFO:teuthology.orchestra.console.smithi090:Power off completed 2023-08-17T22:23:56.738 INFO:teuthology.orchestra.console.smithi105:Power off completed 2023-08-17T22:23:56.853 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com 2023-08-17T22:23:56.893 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com