2023-07-26T05:34:54.362 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T05:34:54.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:34:54.364 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:34:54.524 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5ae5ca49d0>, signals=[15]) 2023-07-26T05:34:54.526 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2023-07-26T05:34:54.527 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T05:34:54.527 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-26T05:34:54.549 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-07-26T05:34:54.550 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T05:34:54.550 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-07-26T05:34:54.553 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"} 2023-07-26T05:34:54.574 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-07-26T05:34:54.630 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T05:34:54.649 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T05:34:54.677 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T05:34:54.677 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3} 2023-07-26T05:34:54.692 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T05:34:54.693 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 3} 2023-07-26T05:34:54.719 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream 2023-07-26T05:34:54.720 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:34:54.743 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream 2023-07-26T05:34:54.744 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:34:54.760 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T05:34:54.780 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T05:34:54.792 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1} 2023-07-26T05:34:54.818 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-07-26T05:34:54.924 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:34:54.933 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:34:55.011 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-26T05:34:55.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T05:34:55.030 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-26T05:34:55.031 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T05:34:55.043 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T05:34:55.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:34:55.056 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T05:34:55.057 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:34:55.074 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:34:55.079 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:34:59.077 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:34:59.087 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:34:59.189 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:34:59.196 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:35:03.192 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:03.200 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:03.302 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T05:35:03.310 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T05:35:03.403 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-07-26T05:35:03.411 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-26T05:35:03.505 INFO:teuthology.orchestra.console:Power on smithi188 2023-07-26T05:35:03.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T05:35:03.513 INFO:teuthology.orchestra.console:Power on smithi079 2023-07-26T05:35:03.513 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T05:35:03.525 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T05:35:03.526 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:03.537 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T05:35:03.538 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:03.550 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T05:35:03.561 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T05:35:07.553 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:07.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:07.664 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T05:35:07.672 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:35:07.773 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2023-07-26T05:35:07.874 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2023-07-26T05:35:07.874 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:35:11.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T05:35:11.779 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T05:35:11.880 INFO:teuthology.orchestra.console:Power on for smithi188 completed 2023-07-26T05:35:11.981 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-07-26T05:35:11.981 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:35:22.936 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:35:27.036 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:35:37.998 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:35:42.088 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:35:53.068 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:35:57.140 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:36:08.128 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:36:12.189 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:36:23.193 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:36:27.244 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:36:38.260 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:36:42.304 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:36:53.320 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:36:57.368 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:37:08.400 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:37:12.428 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:37:23.472 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:37:27.488 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:37:38.536 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:37:42.548 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-07-26T05:37:42.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:37:42.817 ERROR:teuthology.orchestra.connection:Error authenticating with smithi188.front.sepia.ceph.com: Authentication failed. 2023-07-26T05:37:42.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T05:37:42.820 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T05:37:42.821 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-07-26T05:37:53.590 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None 2023-07-26T05:37:53.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:37:56.720 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:02.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:38:05.776 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:11.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:38:14.832 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:20.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:38:23.888 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:29.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:38:32.944 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:38.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:38:42.000 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79 2023-07-26T05:38:48.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:39:37.712 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-07-26T05:39:37.714 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi188 2023-07-26T05:39:46.720 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-26T05:39:46.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:39:47.000 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-07-26T05:39:47.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-26T05:39:47.239 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T05:39:47.239 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T05:39:47.259 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-07-26T05:39:47.259 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-07-26T05:39:47.318 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-07-26T05:39:47.318 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-07-26T05:39:47.377 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-07-26T05:39:47.378 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-26T05:39:47.480 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-07-26T05:39:47.510 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-07-26T05:39:47.579 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-07-26T05:39:47.648 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-07-26T05:39:47.714 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-07-26T05:39:47.772 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-07-26T05:39:47.772 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2023-07-26T05:39:47.772 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T05:39:47.773 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-07-26T05:39:47.774 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T05:39:47.774 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T05:39:47.774 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T05:39:47.774 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-07-26T05:39:47.776 DEBUG:teuthology.parallel:result is None 2023-07-26T05:39:48.003 WARNING:teuthology.provision.fog.smithi079:timed out 2023-07-26T05:39:54.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:39:54.217 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T05:39:54.217 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T05:39:54.452 INFO:teuthology.provision.fog.smithi079:Node is ready 2023-07-26T05:39:54.452 DEBUG:teuthology.orchestra.run.smithi079:> hostname 2023-07-26T05:39:54.511 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2023-07-26T05:39:54.512 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts 2023-07-26T05:39:54.570 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2023-07-26T05:39:54.571 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-26T05:39:54.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts 2023-07-26T05:39:54.696 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2023-07-26T05:39:54.765 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname 2023-07-26T05:39:54.834 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2023-07-26T05:39:54.903 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-26T05:39:54.960 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-07-26T05:39:54.960 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-07-26T05:39:54.961 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T05:39:54.962 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-07-26T05:39:54.962 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T05:39:54.962 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T05:39:54.962 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T05:39:54.962 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2023-07-26T05:39:54.963 DEBUG:teuthology.parallel:result is None 2023-07-26T05:39:55.115 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2023-07-26T05:39:55.116 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T05:39:55.142 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-07-26T05:39:55.142 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T05:39:55.168 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2023-07-26T05:39:55.168 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-26T05:39:55.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:39:55.233 DEBUG:teuthology.orchestra.run.smithi079:> true 2023-07-26T05:39:55.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2023-07-26T05:39:55.297 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2023-07-26T05:39:55.354 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2023-07-26T05:39:55.355 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2023-07-26T05:39:55.412 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8" 2023-07-26T05:39:55.413 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T05:39:55.414 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T05:39:55.415 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2023-07-26T05:39:55.442 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-07-26T05:39:55.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-26T05:39:55.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T05:39:55.509 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-07-26T05:39:55.582 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-07-26T05:39:55.582 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-07-26T05:39:55.642 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-07-26T05:39:55.643 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8" 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8" 2023-07-26T05:39:55.703 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-07-26T05:39:55.704 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T05:39:55.704 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-07-26T05:39:55.704 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T05:39:55.705 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2023-07-26T05:39:55.705 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T05:39:55.705 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T05:39:55.705 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T05:39:55.706 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-07-26T05:39:55.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:39:55.726 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:39:55.827 INFO:teuthology.dispatcher.supervisor:Running job 7352779 2023-07-26T05:39:55.827 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352779 --name gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi --description orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} -- /home/teuthworker/archive/gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352779/orig.config.yaml 2023-07-26T05:39:55.831 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352779 2023-07-26T05:39:55.831 INFO:teuthology.dispatcher.supervisor:Job PID: 32081 2023-07-26T05:39:55.832 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T05:41:55.932 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:41:55.933 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:43:56.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:43:56.109 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:45:56.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:45:56.286 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:47:56.465 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:47:56.467 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:49:56.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:49:56.645 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:51:56.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:51:56.810 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:53:56.963 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:53:56.963 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:55:57.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:55:57.137 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:57:57.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:57:57.301 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T05:59:57.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T05:59:57.384 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:01:57.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:01:57.543 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:03:57.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:03:57.707 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:05:57.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:05:57.874 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:07:58.041 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:07:58.042 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:09:58.220 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:09:58.221 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:11:58.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:11:58.394 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:13:58.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:13:58.568 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:15:58.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:15:58.742 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:17:58.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:17:58.818 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:19:58.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:19:58.981 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:21:59.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:21:59.162 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:23:59.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:23:59.342 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:25:59.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:25:59.518 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:27:59.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:27:59.653 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:29:59.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:29:59.827 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:32:00.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:32:00.002 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:34:00.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:34:00.192 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:36:00.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T06:36:00.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T06:36:00.433 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T06:36:00.643 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T06:36:00.643 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T06:36:00.698 DEBUG:teuthology.nuke:shortname: smithi079 2023-07-26T06:36:00.699 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T06:36:00.715 DEBUG:teuthology.nuke:shortname: smithi188 2023-07-26T06:36:00.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T06:36:00.720 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 05:34:53.451343', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkuYMfrTVWbKHDYg8ckzgwxUB40cutBi1taKZ8IfFAlLkVZXDKRLE/+HjPdm8DdexgD3oSAFZAH+bRTVmc+OP6Yp8SLLQdmWEiTkKJGSlAUucYVjrc68muHFIC8o7PLEuiHnMu12bU1VC3VuaF+Oy0zLGh77UPe5A5uq5LYjuOwGQO2QbEjQry0lNEHtCXiAzi+GvJF0jyyhvwcRQCAVb4bQh5DrpplIo0JH6pIUMiWW0RKMVR0I6kTl+o9rYkLz6gxRHdkZscCQ0z1rH98WGjP83RPRwvU44dKeyIwBEoOseTwqqLtma5rI069ux0Kn1DSvny3GS4JmyLchwkk9Yy6BZo5ZdBOG9/KRoxafSd+xW/crn04vQVka6JlhSXSzA6hFkHBFZwE1or2AQf+/dmqsWoBcr5D/m7yy59I5TgecFJvg79aA2GNXFR0Out9rlbjCsgItAP0r5TRlWd150fMcOQmHIS5eYAZ00gEwmtbZCMOh1b4IN7xgcXlNxsaeM='} 2023-07-26T06:36:00.742 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-26_05:21:54-orch:cephadm-wip-guits-testing-2-2023-07-25-0836-distro-default-smithi/7352779', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 05:34:53.449632', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmCQt3KSdlEh8CSUdO+dC2lwN1Cc3PS88KKQ0zz2S3Cwh0x7mpnqnepF3Vl/t3uVMviG15Rekyvh96gEnLh2kazzWM1E+ZKrXffnFWZjr4w8jnbgl0N6XbHLuezxtv3qasLio5gA8aE8hiuHe3VGHZtXA9iautc/hnHoUA4u1BWp6TR3jHeuVuIk11doim6UrMtAsahQlpTAKCIdg/EQ5zTn7Kfs5X4zUA97lfUnZcAYq9tDFAajS+JaGZn1oLtjuqAJ03KOI1mU+/kORPdtISNZCNssWf6YXzPh/lFCjD8lUCXU7N/z+sGjKXaZaZrJ0l8WgPgq7lsaji5h06/HG7iozetYjMw4S3Fte1sVL+TaVGtMhGnOR9xQVVVNcihVXJKBkAGzsHibbkN2unTE9HPU8qmsDsMPlH3AN5VfZ7lFzmQWSvhpAvDtS4ZqmNoBBGLyCDSbCgLcWuTel4kVp+Sg7vl00ZmRzzooCQxsb9HK2GEpducttKFe5eYqdCBF8='} 2023-07-26T06:36:00.768 INFO:teuthology.orchestra.console:Power off smithi079 2023-07-26T06:36:00.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T06:36:00.791 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T06:36:00.792 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T06:36:00.811 INFO:teuthology.orchestra.console:Power off smithi188 2023-07-26T06:36:00.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T06:36:00.821 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T06:36:00.834 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T06:36:00.834 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T06:36:00.855 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T06:36:00.923 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2023-07-26T06:36:00.957 INFO:teuthology.orchestra.console:Power off for smithi188 completed 2023-07-26T06:36:01.081 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2023-07-26T06:36:01.106 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com