2023-07-26T10:02:41.897 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-26T10:02:41.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:02:41.899 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:02:42.067 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f63c308b280>, signals=[15]) 2023-07-26T10:02:42.069 INFO:teuthology.lock.ops:Start node 'smithi090.front.sepia.ceph.com' reimaging 2023-07-26T10:02:42.069 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T10:02:42.069 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-26T10:02:43.479 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging 2023-07-26T10:02:43.479 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server 2023-07-26T10:02:43.480 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-26T10:02:43.483 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /host {"name": "smithi090"} 2023-07-26T10:02:45.770 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"} 2023-07-26T10:02:45.827 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T10:02:45.836 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-26T10:02:45.868 DEBUG:teuthology.provision.fog.smithi090:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T10:02:45.868 DEBUG:teuthology.provision.fog.smithi090:FOG request: PUT /host/195 {"imageID": 3} 2023-07-26T10:02:45.874 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_8.stream (ID 3) 2023-07-26T10:02:45.874 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 3} 2023-07-26T10:02:45.911 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 8.stream 2023-07-26T10:02:45.911 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:02:45.923 INFO:teuthology.provision.fog.smithi090:Scheduling deploy of centos 8.stream 2023-07-26T10:02:45.923 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:02:45.959 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T10:02:45.977 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /tasktype {"name": "deploy"} 2023-07-26T10:02:45.991 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1} 2023-07-26T10:02:46.010 DEBUG:teuthology.provision.fog.smithi090:FOG request: POST /host/195/task {"taskTypeID": 1} 2023-07-26T10:02:46.040 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:02:46.077 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:02:46.149 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-26T10:02:46.150 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T10:02:46.172 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-26T10:02:46.173 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T10:02:46.182 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T10:02:46.183 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:46.196 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T10:02:46.198 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:46.210 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:46.225 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:46.312 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-26T10:02:46.327 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-26T10:02:46.414 INFO:teuthology.orchestra.console:Power on smithi164 2023-07-26T10:02:46.414 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T10:02:46.429 INFO:teuthology.orchestra.console:Power on smithi090 2023-07-26T10:02:46.429 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-26T10:02:46.440 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T10:02:46.441 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:46.460 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On 2023-07-26T10:02:46.461 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:46.476 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:46.493 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:50.481 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:50.495 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:50.593 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:50.606 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T10:02:54.596 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:54.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:02:54.718 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T10:02:54.819 INFO:teuthology.orchestra.console:Power on for smithi090 completed 2023-07-26T10:02:54.920 INFO:teuthology.provision.fog.smithi090:Waiting for deploy to finish 2023-07-26T10:02:54.920 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:02:55.706 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:02:59.708 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:00.817 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:04.820 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:05.932 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:09.934 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:09.988 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:03:16.004 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:20.006 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:21.119 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:25.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:26.236 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:30.064 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:03:35.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:36.179 DEBUG:teuthology.orchestra.console:check power output: 2023-07-26T10:03:40.184 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T10:03:40.296 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on 2023-07-26T10:03:40.397 INFO:teuthology.orchestra.console:Power on for smithi164 completed 2023-07-26T10:03:40.498 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish 2023-07-26T10:03:40.498 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:03:50.136 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:04:10.156 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:04:15.165 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:04:30.232 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:04:30.234 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:04:50.308 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:04:50.309 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:05:10.392 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:05:10.393 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:05:25.464 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:05:25.468 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:05:40.532 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:05:40.533 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None 2023-07-26T10:05:40.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:05:43.664 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-26T10:05:49.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:05:52.720 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-26T10:05:55.591 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:05:58.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:01.776 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-26T10:06:07.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:12.785 DEBUG:teuthology.provision.fog.smithi090:FOG request: GET /task/active None 2023-07-26T10:06:17.790 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-26T10:06:17.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:27.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:32.845 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:06:35.924 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164 2023-07-26T10:06:38.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:41.908 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:06:41.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:47.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:06:55.985 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:07:01.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:07:10.068 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:07:16.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:07:39.632 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:07:41.931 WARNING:teuthology.provision.fog.smithi164:timed out 2023-07-26T10:07:45.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:07:47.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:07:52.941 WARNING:teuthology.provision.fog.smithi090:[Errno None] Unable to connect to port 22 on 172.21.15.90 2023-07-26T10:07:53.148 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T10:07:53.149 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T10:07:53.434 INFO:teuthology.provision.fog.smithi164:Node is ready 2023-07-26T10:07:53.435 DEBUG:teuthology.orchestra.run.smithi164:> hostname 2023-07-26T10:07:53.455 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com 2023-07-26T10:07:53.455 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts 2023-07-26T10:07:53.515 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164 2023-07-26T10:07:53.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-26T10:07:53.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts 2023-07-26T10:07:53.687 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts 2023-07-26T10:07:53.756 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname 2023-07-26T10:07:53.824 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164 2023-07-26T10:07:53.893 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-26T10:07:53.951 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-26T10:07:53.952 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T10:07:53.953 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T10:07:53.954 INFO:teuthology.provision.fog.smithi164:Deploy complete! 2023-07-26T10:07:53.956 DEBUG:teuthology.parallel:result is None 2023-07-26T10:07:58.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:08:04.351 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-26T10:08:04.351 DEBUG:teuthology.orchestra.run.smithi090:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-26T10:08:24.689 INFO:teuthology.provision.fog.smithi090:Node is ready 2023-07-26T10:08:24.689 DEBUG:teuthology.orchestra.run.smithi090:> hostname 2023-07-26T10:08:24.713 INFO:teuthology.orchestra.run.smithi090.stdout:smithi090.front.sepia.ceph.com 2023-07-26T10:08:24.714 DEBUG:teuthology.orchestra.run.smithi090:> grep smithi090.front.sepia.ceph.com /etc/hosts 2023-07-26T10:08:24.774 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90 smithi090.front.sepia.ceph.com smithi090 2023-07-26T10:08:24.774 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-26T10:08:24.920 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hosts 2023-07-26T10:08:24.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/172.21.15.90/172.21.15.90/g' /etc/hosts 2023-07-26T10:08:25.022 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i -e 's/smithi090.front.sepia.ceph.com/smithi090/g' /etc/hostname 2023-07-26T10:08:25.093 DEBUG:teuthology.orchestra.run.smithi090:> sudo hostname smithi090 2023-07-26T10:08:25.163 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-26T10:08:25.223 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T10:08:25.224 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T10:08:25.225 INFO:teuthology.provision.fog.smithi090:Deploy complete! 2023-07-26T10:08:25.225 DEBUG:teuthology.parallel:result is None 2023-07-26T10:08:25.412 INFO:teuthology.lock.ops:Checking smithi090.front.sepia.ceph.com 2023-07-26T10:08:25.413 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T10:08:25.437 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com 2023-07-26T10:08:25.437 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-26T10:08:25.456 INFO:teuthology.lock.ops:Updating [smithi090.front.sepia.ceph.com]: set os type and version on server 2023-07-26T10:08:25.456 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-26T10:08:25.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:08:25.524 DEBUG:teuthology.orchestra.run.smithi090:> true 2023-07-26T10:08:25.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2023-07-26T10:08:25.600 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2023-07-26T10:08:25.659 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2023-07-26T10:08:25.660 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2023-07-26T10:08:25.719 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2023-07-26T10:08:25.719 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="8" 2023-07-26T10:08:25.719 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2023-07-26T10:08:25.719 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2023-07-26T10:08:25.719 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="8" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el8" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T10:08:25.720 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T10:08:25.721 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T10:08:25.721 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2023-07-26T10:08:25.746 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server 2023-07-26T10:08:25.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-26T10:08:25.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-26T10:08:25.811 DEBUG:teuthology.orchestra.run.smithi164:> true 2023-07-26T10:08:25.905 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2023-07-26T10:08:25.906 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2023-07-26T10:08:25.964 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2023-07-26T10:08:25.965 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2023-07-26T10:08:26.023 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2023-07-26T10:08:26.023 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2023-07-26T10:08:26.023 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2023-07-26T10:08:26.024 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2023-07-26T10:08:26.024 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2023-07-26T10:08:26.024 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2023-07-26T10:08:26.024 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-26T10:08:26.025 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-26T10:08:26.026 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2023-07-26T10:08:26.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:08:26.056 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:08:26.139 INFO:teuthology.dispatcher.supervisor:Running job 7352617 2023-07-26T10:08:26.140 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi/7352617 --name yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi --description rgw/notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi/7352617/orig.config.yaml 2023-07-26T10:08:26.143 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi/7352617 2023-07-26T10:08:26.144 INFO:teuthology.dispatcher.supervisor:Job PID: 12427 2023-07-26T10:08:26.144 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-26T10:10:26.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:10:26.245 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:12:31.405 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:12:31.405 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:14:36.581 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:14:36.581 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:16:41.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:16:41.753 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:18:46.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:18:46.930 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:20:52.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:20:52.102 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:22:52.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:22:52.279 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:24:53.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:24:53.294 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:26:58.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:26:58.470 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:29:03.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:29:03.650 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:31:08.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:31:08.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:33:08.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:33:08.987 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:35:14.164 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:35:14.164 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:37:19.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:37:19.341 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:39:22.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:39:22.914 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:41:23.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:41:23.089 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:43:28.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:43:28.290 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:45:32.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:45:32.548 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:47:37.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:47:37.720 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:49:38.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:49:38.437 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:51:38.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:51:38.642 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:53:43.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:53:43.827 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:55:49.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:55:49.010 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:57:54.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:57:54.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T10:59:54.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T10:59:54.366 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:01:59.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:01:59.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:04:04.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-26T11:04:04.702 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-26T11:04:09.780 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-26T11:04:19.991 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-26T11:04:19.992 INFO:teuthology.nuke:Checking targets against current locks 2023-07-26T11:04:35.067 DEBUG:teuthology.nuke:shortname: smithi090 2023-07-26T11:04:35.068 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T11:04:45.100 DEBUG:teuthology.nuke:shortname: smithi164 2023-07-26T11:04:45.100 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-26T11:04:45.105 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi/7352617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 10:02:41.100194', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNlC5Piz+Tl75NmaAPj+l9j5rZuHsCDcQiNdy+7geRs4JFIPLv3lOtq7Ks4h0m2YpIQ29KGxdf6VX1TZHz9XSxU='} 2023-07-26T11:04:45.125 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2023-07-26_04:56:51-rgw-wip-yuval-test-gsoc2-distro-default-smithi/7352617', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-26 10:02:41.098646', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdZrO8ulPwk24Cj+8Dy/wypu8mRIJvfjeqtsPmSSUxDFTBUH7evgj2xn/ljDIH6v3MwURNyTCRv8A7qAllVF5gee+ROdvK6TvLss8BospIZqJAOYhqM/rKOfcDyZit0d0AWHeqCKFGZgnq/zC+Ebqr4iQSUMcyNoxiVU3TXST7xfsH+eqPb0tTnlIfpAkxe0+3/rrjovVba+p/wQx/zX9eoyzKk1feaIa2VbQ0llMmv7BsGijszRcBE1pFAUEiwM7wjOJaXJb+zpE9YoHaw5LaAVzrMicxR2hQkgq1kkMLqFCKAAsPrEhj3aEQyK9zBNV941VDtZFWIPHq1tiT90YlSzpy+Dxw6urkaANeSNQq2N6z5nWjIHIEQ3F5jAZ0FXjqMW/t9tm7x/YSX5abL3QBA1aQ48qQVkmdjy19g0+pFzyw1a569aiiWIWPhBnKQNu929DjWBaUQ1f5jGV+VfdaPou7bgFPhQ8SJuO6b2RKzUyOiyaAI8v837z8fXTwgis='} 2023-07-26T11:04:45.157 INFO:teuthology.orchestra.console:Power off smithi090 2023-07-26T11:04:45.157 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T11:04:45.179 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T11:04:45.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi090.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:04:45.196 INFO:teuthology.orchestra.console:Power off smithi164 2023-07-26T11:04:45.197 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-26T11:04:45.207 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:04:45.218 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off 2023-07-26T11:04:45.219 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-26T11:04:45.241 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off 2023-07-26T11:04:45.308 INFO:teuthology.orchestra.console:Power off for smithi090 completed 2023-07-26T11:04:45.343 INFO:teuthology.orchestra.console:Power off for smithi164 completed 2023-07-26T11:05:05.487 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com 2023-07-26T11:05:05.498 INFO:teuthology.lock.ops:unlocked: smithi090.front.sepia.ceph.com