2023-10-18T11:27:29.314 INFO:root:teuthology version: 0.0.1.dev201+g202b180 2023-10-18T11:27:29.316 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:27:29.453 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc0c2e41670>, signals=[15]) 2023-10-18T11:27:29.455 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-10-18T11:27:29.455 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T11:27:29.456 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-18T11:27:29.483 INFO:teuthology.lock.ops:Start node 'smithi114.front.sepia.ceph.com' reimaging 2023-10-18T11:27:29.483 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: reset os type and version on server 2023-10-18T11:27:29.484 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-18T11:27:29.485 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-10-18T11:27:29.508 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /host {"name": "smithi114"} 2023-10-18T11:27:29.553 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T11:27:29.576 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-18T11:27:29.599 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T11:27:29.599 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 10} 2023-10-18T11:27:29.626 DEBUG:teuthology.provision.fog.smithi114:Requesting image smithi_centos_9.stream (ID 10) 2023-10-18T11:27:29.626 DEBUG:teuthology.provision.fog.smithi114:FOG request: PUT /host/219 {"imageID": 10} 2023-10-18T11:27:29.640 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 9.stream 2023-10-18T11:27:29.640 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:27:29.675 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 9.stream 2023-10-18T11:27:29.675 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:27:29.684 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T11:27:29.716 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /tasktype {"name": "deploy"} 2023-10-18T11:27:29.719 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-10-18T11:27:29.750 DEBUG:teuthology.provision.fog.smithi114:FOG request: POST /host/219/task {"taskTypeID": 1} 2023-10-18T11:27:29.784 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:27:29.802 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:27:29.865 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-18T11:27:29.865 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:27:29.879 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-18T11:27:29.880 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:27:29.896 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-18T11:27:29.898 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:29.906 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-18T11:27:29.907 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:29.921 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T11:27:29.927 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-18T11:27:30.022 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-18T11:27:30.027 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-18T11:27:30.124 INFO:teuthology.orchestra.console.smithi003:Power on 2023-10-18T11:27:30.124 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T11:27:30.134 INFO:teuthology.orchestra.console.smithi114:Power on 2023-10-18T11:27:30.134 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-18T11:27:30.148 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-10-18T11:27:30.148 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:30.157 DEBUG:teuthology.orchestra.console.smithi114:power on output: Chassis Power Control: Up/On 2023-10-18T11:27:30.158 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:30.171 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T11:27:30.179 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-18T11:27:34.174 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:34.182 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:27:34.285 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-10-18T11:27:34.292 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is on 2023-10-18T11:27:34.386 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-10-18T11:27:34.393 INFO:teuthology.orchestra.console.smithi114:Power on completed 2023-10-18T11:27:34.488 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-10-18T11:27:34.488 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:27:34.495 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2023-10-18T11:27:34.495 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:27:49.558 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:27:49.560 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:28:04.622 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:28:04.623 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:28:19.690 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:28:19.692 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:28:34.754 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:28:34.756 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:28:49.818 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:28:49.820 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:29:04.890 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:29:04.892 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:29:19.958 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:29:19.960 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:29:35.026 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:29:35.028 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:29:50.098 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:29:50.100 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:30:05.167 DEBUG:teuthology.provision.fog.smithi114:FOG request: GET /task/active None 2023-10-18T11:30:05.169 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-10-18T11:30:05.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:05.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:23.738 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T11:30:23.740 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-18T11:30:29.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:29.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:32.826 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T11:30:32.827 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-18T11:30:38.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:38.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:41.882 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T11:30:41.883 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-18T11:30:47.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:47.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:50.938 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-10-18T11:30:50.939 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-18T11:30:56.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:30:56.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:31:00.026 WARNING:teuthology.provision.fog.smithi114:[Errno None] Unable to connect to port 22 on 172.21.15.114 2023-10-18T11:31:06.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:31:56.994 WARNING:teuthology.provision.fog.smithi003:timed out 2023-10-18T11:32:03.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:32:03.264 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T11:32:03.265 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T11:32:03.597 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-10-18T11:32:03.597 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-10-18T11:32:03.613 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-10-18T11:32:03.613 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-10-18T11:32:03.668 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-10-18T11:32:03.668 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-18T11:32:03.778 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-10-18T11:32:03.810 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-10-18T11:32:03.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-10-18T11:32:03.951 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-10-18T11:32:04.021 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-18T11:32:04.076 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-10-18T11:32:04.077 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-10-18T11:32:04.077 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-10-18T11:32:04.077 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-10-18T11:32:04.077 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-10-18T11:32:04.077 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-10-18T11:32:04.078 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T11:32:04.078 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-10-18T11:32:04.078 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-10-18T11:32:04.078 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T11:32:04.078 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-10-18T11:32:04.079 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T11:32:04.079 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T11:32:04.079 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T11:32:04.081 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-10-18T11:32:04.083 DEBUG:teuthology.parallel:result is None 2023-10-18T11:32:06.034 WARNING:teuthology.provision.fog.smithi114:timed out 2023-10-18T11:32:12.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:32:12.285 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-18T11:32:12.286 DEBUG:teuthology.orchestra.run.smithi114:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-18T11:32:12.609 INFO:teuthology.provision.fog.smithi114:Node is ready 2023-10-18T11:32:12.610 DEBUG:teuthology.orchestra.run.smithi114:> hostname 2023-10-18T11:32:12.625 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2023-10-18T11:32:12.625 DEBUG:teuthology.orchestra.run.smithi114:> grep smithi114.front.sepia.ceph.com /etc/hosts 2023-10-18T11:32:12.680 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2023-10-18T11:32:12.680 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-18T11:32:12.785 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hosts 2023-10-18T11:32:12.813 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/172.21.15.114/172.21.15.114/g' /etc/hosts 2023-10-18T11:32:12.881 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i -e 's/smithi114.front.sepia.ceph.com/smithi114/g' /etc/hostname 2023-10-18T11:32:12.947 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname smithi114 2023-10-18T11:32:13.013 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-18T11:32:13.068 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-10-18T11:32:13.069 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2023-10-18T11:32:13.069 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-10-18T11:32:13.069 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-10-18T11:32:13.069 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2023-10-18T11:32:13.070 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2023-10-18T11:32:13.070 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T11:32:13.070 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-18T11:32:13.071 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2023-10-18T11:32:13.071 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T11:32:13.071 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-10-18T11:32:13.071 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T11:32:13.072 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T11:32:13.072 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T11:32:13.072 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2023-10-18T11:32:13.073 DEBUG:teuthology.parallel:result is None 2023-10-18T11:32:13.280 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-10-18T11:32:13.280 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T11:32:13.298 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2023-10-18T11:32:13.298 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-18T11:32:13.316 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-10-18T11:32:13.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-18T11:32:13.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:32:13.415 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-10-18T11:32:13.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-10-18T11:32:13.487 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-10-18T11:32:13.544 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-10-18T11:32:13.544 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-10-18T11:32:13.601 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-10-18T11:32:13.602 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2023-10-18T11:32:13.602 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-10-18T11:32:13.602 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-10-18T11:32:13.602 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2023-10-18T11:32:13.603 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2023-10-18T11:32:13.603 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T11:32:13.603 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-10-18T11:32:13.603 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2023-10-18T11:32:13.603 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T11:32:13.604 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-10-18T11:32:13.604 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T11:32:13.604 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T11:32:13.604 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T11:32:13.605 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-10-18T11:32:13.649 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2023-10-18T11:32:13.649 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T11:32:13.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-18T11:32:13.732 DEBUG:teuthology.orchestra.run.smithi114:> true 2023-10-18T11:32:13.796 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2023-10-18T11:32:13.797 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2023-10-18T11:32:13.851 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2023-10-18T11:32:13.851 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2023-10-18T11:32:13.904 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2023-10-18T11:32:13.905 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2023-10-18T11:32:13.905 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2023-10-18T11:32:13.905 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2023-10-18T11:32:13.905 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2023-10-18T11:32:13.906 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2023-10-18T11:32:13.906 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-18T11:32:13.906 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2023-10-18T11:32:13.906 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2023-10-18T11:32:13.906 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-18T11:32:13.907 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2023-10-18T11:32:13.907 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-18T11:32:13.907 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-18T11:32:13.907 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-18T11:32:13.908 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2023-10-18T11:32:13.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:32:14.020 INFO:teuthology.dispatcher.supervisor:Running job 7431510 2023-10-18T11:32:14.021 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_202b180cb047e798fb131047314a862593f45403/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi/7431510 --name yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi --description rgw:notifications/{beast bluestore-bitmap centos_latest fixed-2 ignore-pg-availability overrides tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi/7431510/orig.config.yaml 2023-10-18T11:32:14.024 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi/7431510 2023-10-18T11:32:14.025 INFO:teuthology.dispatcher.supervisor:Job PID: 2609654 2023-10-18T11:32:14.025 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-18T11:34:14.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:36:14.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:38:14.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:40:14.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:42:14.799 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:44:14.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:46:15.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:48:15.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:50:15.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:52:15.635 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:54:15.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:56:15.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-18T11:56:16.021 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-18T11:56:16.120 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-18T11:56:16.120 INFO:teuthology.nuke:Checking targets against current locks 2023-10-18T11:56:16.166 DEBUG:teuthology.nuke:shortname: smithi003 2023-10-18T11:56:16.166 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T11:56:16.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi/7431510', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:27:28.444547', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCi1G+GT1e40tUZVS91VaQJVBjDAFiBSkFVAoZ6CdoSQ95AosZop2qkjJcXAqUe54zJ7S8d3AsVlD2SSEcY5n5Y='} 2023-10-18T11:56:16.194 DEBUG:teuthology.nuke:shortname: smithi114 2023-10-18T11:56:16.195 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-18T11:56:16.217 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-10-18_11:23:04-rgw:notifications-wip-yuval-fix-63205-distro-default-smithi/7431510', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-18 11:27:28.442700', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKJEcw6Nj5gAyVCG9Gxl/BOvc2NxvRDd1+C15KLZ/IhAA2V3Ddnq9EML9cjTLz1Pf4zLTcfApAEGy3B1NjhiEhs='} 2023-10-18T11:56:16.246 INFO:teuthology.orchestra.console.smithi003:Power off 2023-10-18T11:56:16.246 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:56:16.268 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-10-18T11:56:16.268 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:56:16.281 INFO:teuthology.orchestra.console.smithi114:Power off 2023-10-18T11:56:16.282 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-18T11:56:16.291 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-10-18T11:56:16.302 DEBUG:teuthology.orchestra.console.smithi114:power off output: Chassis Power Control: Down/Off 2023-10-18T11:56:16.302 DEBUG:teuthology.orchestra.console.smithi114:pexpect command: ipmitool -H smithi114.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-18T11:56:16.323 DEBUG:teuthology.orchestra.console.smithi114:check power output: Chassis Power is off 2023-10-18T11:56:16.392 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-10-18T11:56:16.424 INFO:teuthology.orchestra.console.smithi114:Power off completed 2023-10-18T11:56:16.545 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com 2023-10-18T11:56:16.570 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com