2023-11-16T03:18:36.506 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-16T03:18:36.506 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:18:36.643 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5f6ee82ee0>, signals=[15]) 2023-11-16T03:18:36.644 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-11-16T03:18:36.644 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T03:18:36.644 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-16T03:18:36.667 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-11-16T03:18:36.668 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-11-16T03:18:36.668 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-11-16T03:18:36.669 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"} 2023-11-16T03:18:36.691 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-11-16T03:18:36.753 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T03:18:36.759 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-16T03:18:36.793 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T03:18:36.794 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 3} 2023-11-16T03:18:36.800 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_8.stream (ID 3) 2023-11-16T03:18:36.800 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 3} 2023-11-16T03:18:36.843 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.stream 2023-11-16T03:18:36.843 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:18:36.849 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream 2023-11-16T03:18:36.850 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:18:36.928 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T03:18:36.932 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"} 2023-11-16T03:18:36.970 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-11-16T03:18:36.980 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1} 2023-11-16T03:18:37.023 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:18:37.033 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:18:37.169 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-16T03:18:37.170 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:18:37.188 INFO:teuthology.orchestra.console.smithi146:Power off 2023-11-16T03:18:37.189 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:18:37.202 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-16T03:18:37.203 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:37.215 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-11-16T03:18:37.216 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:37.232 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-16T03:18:37.247 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-11-16T03:18:37.333 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-16T03:18:37.349 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-11-16T03:18:37.434 INFO:teuthology.orchestra.console.smithi143:Power on 2023-11-16T03:18:37.435 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T03:18:37.450 INFO:teuthology.orchestra.console.smithi146:Power on 2023-11-16T03:18:37.450 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-16T03:18:37.461 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On 2023-11-16T03:18:37.462 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:37.475 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-11-16T03:18:37.476 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:37.488 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-16T03:18:37.499 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-11-16T03:18:41.492 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:41.503 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:41.605 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-16T03:18:41.613 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-11-16T03:18:45.610 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:45.617 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:18:45.719 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on 2023-11-16T03:18:45.727 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-11-16T03:18:45.821 INFO:teuthology.orchestra.console.smithi143:Power on completed 2023-11-16T03:18:45.829 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-11-16T03:18:45.923 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-11-16T03:18:45.923 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:18:45.929 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-11-16T03:18:45.930 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:19:01.018 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:19:01.019 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:19:16.105 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:19:16.106 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:19:31.206 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:19:31.208 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:19:46.310 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:19:46.311 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:20:01.404 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:20:01.417 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:20:16.510 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:20:16.512 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:20:31.606 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:20:31.607 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:20:46.713 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:20:46.714 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:21:01.841 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:21:01.843 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:21:16.950 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:21:16.955 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:21:32.078 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None 2023-11-16T03:21:32.081 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-11-16T03:21:32.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:32.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:35.258 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:21:35.262 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:21:41.263 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:41.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:44.318 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:21:44.346 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:21:50.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:50.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:53.402 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:21:53.403 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:21:59.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:21:59.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:02.497 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:22:02.498 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:22:08.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:08.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:11.578 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:22:11.579 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:22:17.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:17.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:20.643 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:22:20.643 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-11-16T03:22:26.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:26.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:29.722 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:22:35.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:22:54.202 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:22:58.324 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T03:22:58.324 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T03:23:00.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:23:03.262 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-11-16T03:23:09.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:23:12.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-16T03:23:12.531 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-16T03:23:23.858 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-11-16T03:23:23.859 DEBUG:teuthology.orchestra.run.smithi143:> hostname 2023-11-16T03:23:23.884 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com 2023-11-16T03:23:23.884 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts 2023-11-16T03:23:23.946 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-11-16T03:23:23.946 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-16T03:23:24.069 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts 2023-11-16T03:23:24.100 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts 2023-11-16T03:23:24.170 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname 2023-11-16T03:23:24.240 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143 2023-11-16T03:23:24.308 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-16T03:23:24.367 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:23:24.368 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:23:24.368 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:23:24.368 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:23:24.368 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:23:24.368 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-11-16T03:23:24.370 DEBUG:teuthology.parallel:result is None 2023-11-16T03:23:37.521 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-11-16T03:23:37.522 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-11-16T03:23:37.546 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-11-16T03:23:37.546 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-11-16T03:23:37.606 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-11-16T03:23:37.606 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-11-16T03:23:37.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-11-16T03:23:37.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-11-16T03:23:37.827 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-11-16T03:23:37.897 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-11-16T03:23:37.966 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-11-16T03:23:38.024 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:23:38.025 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:23:38.026 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-11-16T03:23:38.026 DEBUG:teuthology.parallel:result is None 2023-11-16T03:23:38.214 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-11-16T03:23:38.214 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T03:23:38.240 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-11-16T03:23:38.240 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-16T03:23:38.257 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-11-16T03:23:38.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-16T03:23:38.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:23:38.327 DEBUG:teuthology.orchestra.run.smithi143:> true 2023-11-16T03:23:38.465 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-11-16T03:23:38.466 DEBUG:teuthology.orchestra.run.smithi143:> uname -m 2023-11-16T03:23:38.524 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-11-16T03:23:38.525 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release 2023-11-16T03:23:38.584 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream" 2023-11-16T03:23:38.584 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:23:38.585 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:23:38.586 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-11-16T03:23:38.606 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-11-16T03:23:38.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-16T03:23:38.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-16T03:23:38.673 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-11-16T03:23:38.744 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-11-16T03:23:38.744 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-11-16T03:23:38.803 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-11-16T03:23:38.803 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-16T03:23:38.861 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-11-16T03:23:38.862 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-16T03:23:38.862 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-16T03:23:38.862 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-16T03:23:38.862 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-11-16T03:23:38.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:23:38.979 INFO:teuthology.dispatcher.supervisor:Running job 7460283 2023-11-16T03:23:38.980 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460283 --name teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} -- /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460283/orig.config.yaml 2023-11-16T03:23:38.983 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460283 2023-11-16T03:23:38.983 INFO:teuthology.dispatcher.supervisor:Job PID: 699240 2023-11-16T03:23:38.984 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-16T03:25:39.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:27:39.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:29:39.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:31:39.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:33:39.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:35:39.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:37:40.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:39:40.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:41:40.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-16T03:41:40.540 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-11-16T03:41:40.693 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-16T03:41:40.694 INFO:teuthology.nuke:Checking targets against current locks 2023-11-16T03:41:40.748 DEBUG:teuthology.nuke:shortname: smithi143 2023-11-16T03:41:40.749 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T03:41:40.773 DEBUG:teuthology.nuke:shortname: smithi146 2023-11-16T03:41:40.773 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-16T03:41:40.777 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 03:18:35.660037', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHVMCtB4YDGAR4Mc0cfjIg62RNIML8Yink9yTcfa2+w1mjFg8iIfGM3Nrb9XNmZn4VNRZXHurJCCF9JM7qTpdBM='} 2023-11-16T03:41:40.796 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-16_02:25:09-upgrade:reef-x-main-distro-default-smithi/7460283', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-16 03:18:35.661982', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGyq1rPyRuUVfYDDrsEHkvrgow2IY0LxSlYfJZ4PcvS3cmBlI2a/3xwW/LqXcR7q8h/Z86JV6VGZBDDlLW3psLM='} 2023-11-16T03:41:40.831 INFO:teuthology.orchestra.console.smithi143:Power off 2023-11-16T03:41:40.831 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:41:40.855 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off 2023-11-16T03:41:40.855 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:41:40.872 INFO:teuthology.orchestra.console.smithi146:Power off 2023-11-16T03:41:40.872 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-16T03:41:40.882 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off 2023-11-16T03:41:40.896 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-11-16T03:41:40.896 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-16T03:41:40.920 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-11-16T03:41:40.984 INFO:teuthology.orchestra.console.smithi143:Power off completed 2023-11-16T03:41:41.021 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-11-16T03:41:41.131 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-11-16T03:41:41.166 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com