2023-10-21T17:57:31.779 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-21T17:57:31.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T17:57:31.916 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe501d22ee0>, signals=[15]) 2023-10-21T17:57:31.918 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-10-21T17:57:31.918 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T17:57:31.919 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-21T17:57:31.941 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-10-21T17:57:31.942 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-10-21T17:57:31.942 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-21T17:57:31.944 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /host {"name": "smithi132"} 2023-10-21T17:57:31.966 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /host {"name": "smithi191"} 2023-10-21T17:57:32.016 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T17:57:32.044 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-21T17:57:32.057 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T17:57:32.058 DEBUG:teuthology.provision.fog.smithi132:FOG request: PUT /host/237 {"imageID": 3} 2023-10-21T17:57:32.083 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2023-10-21T17:57:32.083 DEBUG:teuthology.provision.fog.smithi191:FOG request: PUT /host/296 {"imageID": 3} 2023-10-21T17:57:32.095 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream 2023-10-21T17:57:32.095 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:57:32.129 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2023-10-21T17:57:32.129 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:57:32.149 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T17:57:32.183 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /tasktype {"name": "deploy"} 2023-10-21T17:57:32.187 DEBUG:teuthology.provision.fog.smithi132:FOG request: POST /host/237/task {"taskTypeID": 1} 2023-10-21T17:57:32.222 DEBUG:teuthology.provision.fog.smithi191:FOG request: POST /host/296/task {"taskTypeID": 1} 2023-10-21T17:57:32.236 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:57:32.273 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:57:32.324 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-21T17:57:32.325 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T17:57:32.345 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-21T17:57:32.346 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:32.364 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-21T17:57:32.364 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T17:57:32.373 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-21T17:57:32.386 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-21T17:57:32.386 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:32.408 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-21T17:57:32.474 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-21T17:57:32.509 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-21T17:57:32.575 INFO:teuthology.orchestra.console.smithi132:Power on 2023-10-21T17:57:32.576 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T17:57:32.596 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2023-10-21T17:57:32.596 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:32.611 INFO:teuthology.orchestra.console.smithi191:Power on 2023-10-21T17:57:32.611 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-21T17:57:32.619 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-21T17:57:32.630 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2023-10-21T17:57:32.631 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:32.654 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-21T17:57:36.622 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:36.655 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:36.733 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-21T17:57:36.765 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-21T17:57:40.734 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:40.766 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T17:57:40.843 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-10-21T17:57:40.875 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2023-10-21T17:57:40.944 INFO:teuthology.orchestra.console.smithi132:Power on completed 2023-10-21T17:57:40.977 INFO:teuthology.orchestra.console.smithi191:Power on completed 2023-10-21T17:57:41.046 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-10-21T17:57:41.046 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:57:41.078 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-10-21T17:57:41.079 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:57:56.119 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:57:56.139 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:58:11.195 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:58:11.205 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:58:26.274 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:58:26.276 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:58:41.366 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:58:41.368 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:58:56.447 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:58:56.449 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:59:11.522 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:59:11.524 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:59:26.602 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:59:26.604 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:59:41.685 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T17:59:41.686 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:59:56.766 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T17:59:56.768 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T18:00:11.854 DEBUG:teuthology.provision.fog.smithi132:FOG request: GET /task/active None 2023-10-21T18:00:11.856 DEBUG:teuthology.provision.fog.smithi191:FOG request: GET /task/active None 2023-10-21T18:00:11.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:00:11.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:00:30.330 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:00:36.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:00:39.386 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:00:42.256 ERROR:teuthology.orchestra.connection:Error authenticating with smithi191.front.sepia.ceph.com: AuthenticationException('Authentication timeout.') 2023-10-21T18:00:45.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:00:48.442 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:00:54.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:00:56.442 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-21T18:00:57.498 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:01:02.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:03.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:05.502 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-10-21T18:01:06.554 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:01:11.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:12.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:31.002 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:01:37.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:40.058 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-10-21T18:01:46.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:01:47.136 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T18:01:47.137 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T18:02:10.938 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-10-21T18:02:11.506 WARNING:teuthology.provision.fog.smithi191:timed out 2023-10-21T18:02:12.476 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-10-21T18:02:12.476 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2023-10-21T18:02:12.541 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-10-21T18:02:12.541 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2023-10-21T18:02:12.601 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-10-21T18:02:12.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-21T18:02:12.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2023-10-21T18:02:12.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2023-10-21T18:02:12.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2023-10-21T18:02:12.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2023-10-21T18:02:12.971 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-21T18:02:13.030 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-21T18:02:13.031 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-10-21T18:02:13.031 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-21T18:02:13.031 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-21T18:02:13.031 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-10-21T18:02:13.032 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-21T18:02:13.032 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T18:02:13.032 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-21T18:02:13.032 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T18:02:13.032 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-21T18:02:13.033 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T18:02:13.033 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T18:02:13.033 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T18:02:13.034 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-10-21T18:02:13.035 DEBUG:teuthology.parallel:result is None 2023-10-21T18:02:17.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:02:17.742 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-21T18:02:17.742 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-21T18:02:17.985 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-10-21T18:02:17.985 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2023-10-21T18:02:18.006 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-10-21T18:02:18.006 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2023-10-21T18:02:18.067 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-10-21T18:02:18.067 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-21T18:02:18.181 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2023-10-21T18:02:18.216 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2023-10-21T18:02:18.288 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2023-10-21T18:02:18.360 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2023-10-21T18:02:18.431 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-21T18:02:18.492 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-21T18:02:18.493 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-21T18:02:18.493 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-21T18:02:18.493 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-21T18:02:18.494 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-21T18:02:18.494 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-21T18:02:18.494 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T18:02:18.494 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-21T18:02:18.494 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T18:02:18.495 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-21T18:02:18.495 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T18:02:18.495 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T18:02:18.495 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T18:02:18.496 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-10-21T18:02:18.496 DEBUG:teuthology.parallel:result is None 2023-10-21T18:02:18.682 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-10-21T18:02:18.683 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T18:02:18.708 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-10-21T18:02:18.708 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-21T18:02:18.726 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-10-21T18:02:18.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-21T18:02:18.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:02:18.793 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-10-21T18:02:18.872 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-10-21T18:02:18.873 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-10-21T18:02:18.934 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-10-21T18:02:18.935 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-10-21T18:02:18.995 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-10-21T18:02:18.995 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8" 2023-10-21T18:02:18.995 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-10-21T18:02:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-10-21T18:02:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8" 2023-10-21T18:02:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-10-21T18:02:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T18:02:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-10-21T18:02:18.997 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T18:02:18.997 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-10-21T18:02:18.997 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T18:02:18.997 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T18:02:18.998 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T18:02:18.998 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-10-21T18:02:19.016 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-10-21T18:02:19.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-21T18:02:19.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-21T18:02:19.085 DEBUG:teuthology.orchestra.run.smithi191:> true 2023-10-21T18:02:19.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-10-21T18:02:19.156 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2023-10-21T18:02:19.215 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-10-21T18:02:19.215 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2023-10-21T18:02:19.274 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2023-10-21T18:02:19.275 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2023-10-21T18:02:19.275 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2023-10-21T18:02:19.275 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2023-10-21T18:02:19.275 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2023-10-21T18:02:19.276 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-21T18:02:19.277 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-21T18:02:19.277 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-21T18:02:19.277 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-10-21T18:02:19.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:02:19.396 INFO:teuthology.dispatcher.supervisor:Running job 7427721 2023-10-21T18:02:19.397 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427721 --name teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427721/orig.config.yaml 2023-10-21T18:02:19.401 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427721 2023-10-21T18:02:19.402 INFO:teuthology.dispatcher.supervisor:Job PID: 54631 2023-10-21T18:02:19.403 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-21T18:04:19.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:06:19.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:08:19.836 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:10:20.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:12:20.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:14:20.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:16:20.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:18:20.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:20:20.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:22:21.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:24:21.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:26:21.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:28:21.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:30:21.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:32:21.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:34:22.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:36:22.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:38:22.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:40:22.575 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:42:22.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:44:22.904 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:46:23.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:48:23.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:50:23.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:52:23.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:54:23.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:56:23.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T18:58:23.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:00:24.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:02:24.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:04:24.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:06:24.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:08:24.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:10:24.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:12:25.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:14:25.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:16:25.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:18:25.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:20:25.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:22:25.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:24:26.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:26:26.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:28:26.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:30:28.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-21T19:30:28.660 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-21T19:30:28.864 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-21T19:30:28.865 INFO:teuthology.nuke:Checking targets against current locks 2023-10-21T19:30:28.911 DEBUG:teuthology.nuke:shortname: smithi132 2023-10-21T19:30:28.912 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T19:30:28.933 DEBUG:teuthology.nuke:shortname: smithi191 2023-10-21T19:30:28.934 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-21T19:30:28.937 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 17:57:30.905356', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7ngDcyekav/b0L13Omzvjirye6R8udITtTe3dyeKbRSAoOF4oZwFEca2uxjAc7XwwPpf4/R6Dwv+7fDOFIyXg='} 2023-10-21T19:30:28.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-10-14_14:23:11-upgrade:pacific-x-reef-distro-default-smithi/7427721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-21 17:57:30.903946', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBfbRdS0ZYcGJtgs1Hz7qvtHkGIeVjyqbT/4jrL1j9VJ+NlfkOFwPmMTNuTFt1hAOVvcc7pZ9rfFg3c7MW2TL+U='} 2023-10-21T19:30:28.986 INFO:teuthology.orchestra.console.smithi132:Power off 2023-10-21T19:30:28.986 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:30:29.008 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-10-21T19:30:29.008 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:30:29.026 INFO:teuthology.orchestra.console.smithi191:Power off 2023-10-21T19:30:29.026 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-21T19:30:29.034 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-10-21T19:30:29.046 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2023-10-21T19:30:29.046 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-21T19:30:29.067 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2023-10-21T19:30:29.135 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-10-21T19:30:29.168 INFO:teuthology.orchestra.console.smithi191:Power off completed 2023-10-21T19:30:29.291 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com 2023-10-21T19:30:29.318 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com