2023-11-10T11:53:17.699 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-10T11:53:17.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T11:53:17.851 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1b126cca0>, signals=[15]) 2023-11-10T11:53:17.853 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging 2023-11-10T11:53:17.853 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T11:53:17.853 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-10T11:53:17.883 INFO:teuthology.lock.ops:Start node 'smithi125.front.sepia.ceph.com' reimaging 2023-11-10T11:53:17.883 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T11:53:17.884 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-10T11:53:17.885 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"} 2023-11-10T11:53:17.907 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /host {"name": "smithi125"} 2023-11-10T11:53:18.009 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-10T11:53:18.014 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-11-10T11:53:18.055 DEBUG:teuthology.provision.fog.smithi125:Requesting image smithi_centos_8.stream (ID 3) 2023-11-10T11:53:18.056 DEBUG:teuthology.provision.fog.smithi125:FOG request: PUT /host/230 {"imageID": 3} 2023-11-10T11:53:18.059 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_8.stream (ID 3) 2023-11-10T11:53:18.059 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 3} 2023-11-10T11:53:18.125 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 8.stream 2023-11-10T11:53:18.126 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:53:18.129 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of centos 8.stream 2023-11-10T11:53:18.130 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:53:18.166 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T11:53:18.181 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T11:53:18.214 DEBUG:teuthology.provision.fog.smithi125:FOG request: POST /host/230/task {"taskTypeID": 1} 2023-11-10T11:53:18.217 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1} 2023-11-10T11:53:18.305 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:53:18.314 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:53:18.384 INFO:teuthology.orchestra.console.smithi125:Power off 2023-11-10T11:53:18.385 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T11:53:18.397 INFO:teuthology.orchestra.console.smithi023:Power off 2023-11-10T11:53:18.398 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T11:53:18.410 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-11-10T11:53:18.411 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:18.418 DEBUG:teuthology.orchestra.console.smithi023:power off output: Chassis Power Control: Down/Off 2023-11-10T11:53:18.418 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:18.431 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-10T11:53:18.438 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-10T11:53:18.539 INFO:teuthology.orchestra.console.smithi023:Power off completed 2023-11-10T11:53:18.639 INFO:teuthology.orchestra.console.smithi023:Power on 2023-11-10T11:53:18.640 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T11:53:18.660 DEBUG:teuthology.orchestra.console.smithi023:power on output: Chassis Power Control: Up/On 2023-11-10T11:53:18.660 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:18.683 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is off 2023-11-10T11:53:22.434 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:22.546 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-10T11:53:22.684 DEBUG:teuthology.orchestra.console.smithi023:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:22.793 DEBUG:teuthology.orchestra.console.smithi023:check power output: Chassis Power is on 2023-11-10T11:53:22.895 INFO:teuthology.orchestra.console.smithi023:Power on completed 2023-11-10T11:53:22.996 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish 2023-11-10T11:53:22.996 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:53:26.550 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:26.659 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-10T11:53:30.662 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:30.770 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-10T11:53:30.871 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-11-10T11:53:30.972 INFO:teuthology.orchestra.console.smithi125:Power on 2023-11-10T11:53:30.972 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T11:53:30.991 DEBUG:teuthology.orchestra.console.smithi125:power on output: Chassis Power Control: Up/On 2023-11-10T11:53:30.992 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:31.013 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-10T11:53:35.014 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:35.122 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-11-10T11:53:38.113 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:53:39.124 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:39.232 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-11-10T11:53:39.333 INFO:teuthology.orchestra.console.smithi125:Power on completed 2023-11-10T11:53:39.434 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish 2023-11-10T11:53:39.434 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:53:53.289 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:53:54.623 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:54:08.459 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:54:09.806 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:54:23.635 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:54:25.001 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:54:38.798 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:54:40.178 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:54:53.987 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:54:55.372 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:55:09.172 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:55:10.578 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:55:24.407 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:55:25.769 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:55:39.677 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:55:41.086 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:56:01.378 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:56:01.502 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:56:18.717 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:56:19.093 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:56:35.526 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:56:35.927 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:56:50.725 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:56:52.241 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:57:05.907 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:57:08.262 DEBUG:teuthology.provision.fog.smithi125:FOG request: GET /task/active None 2023-11-10T11:57:08.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:11.834 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:57:17.837 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:20.890 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:57:21.108 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:57:26.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:29.978 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:57:35.986 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:36.277 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:57:39.066 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:57:45.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:48.122 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:57:51.448 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None 2023-11-10T11:57:51.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:52.115 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-10T11:57:54.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:57:56.234 ERROR:teuthology.orchestra.connection:Error authenticating with smithi023.front.sepia.ceph.com: AuthenticationException('Authentication failed.') 2023-11-10T11:57:57.178 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:58:03.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:06.234 WARNING:teuthology.provision.fog.smithi125:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-11-10T11:58:12.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:37.690 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:58:43.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:46.746 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:58:52.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:55.802 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:59:01.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:04.858 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:59:10.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:12.239 WARNING:teuthology.provision.fog.smithi125:timed out 2023-11-10T11:59:13.918 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:59:18.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:18.475 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T11:59:18.477 DEBUG:teuthology.orchestra.run.smithi125:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T11:59:18.762 INFO:teuthology.provision.fog.smithi125:Node is ready 2023-11-10T11:59:18.763 DEBUG:teuthology.orchestra.run.smithi125:> hostname 2023-11-10T11:59:18.784 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com 2023-11-10T11:59:18.784 DEBUG:teuthology.orchestra.run.smithi125:> grep smithi125.front.sepia.ceph.com /etc/hosts 2023-11-10T11:59:18.846 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125 2023-11-10T11:59:18.846 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-10T11:59:18.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hosts 2023-11-10T11:59:18.988 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/172.21.15.125/172.21.15.125/g' /etc/hosts 2023-11-10T11:59:19.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i -e 's/smithi125.front.sepia.ceph.com/smithi125/g' /etc/hostname 2023-11-10T11:59:19.136 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname smithi125 2023-11-10T11:59:19.210 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-10T11:59:19.272 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-11-10T11:59:19.272 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-11-10T11:59:19.272 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-11-10T11:59:19.273 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-11-10T11:59:19.273 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-11-10T11:59:19.273 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-11-10T11:59:19.273 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-10T11:59:19.273 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-10T11:59:19.274 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-10T11:59:19.274 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-11-10T11:59:19.274 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T11:59:19.274 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T11:59:19.274 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-10T11:59:19.275 INFO:teuthology.provision.fog.smithi125:Deploy complete! 2023-11-10T11:59:19.277 DEBUG:teuthology.parallel:result is None 2023-11-10T11:59:19.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:22.970 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23 2023-11-10T11:59:28.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:28.974 WARNING:teuthology.provision.fog.smithi023:timed out 2023-11-10T12:00:34.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:35.219 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T12:00:35.220 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T12:00:35.464 INFO:teuthology.provision.fog.smithi023:Node is ready 2023-11-10T12:00:35.464 DEBUG:teuthology.orchestra.run.smithi023:> hostname 2023-11-10T12:00:35.484 INFO:teuthology.orchestra.run.smithi023.stdout:smithi023.front.sepia.ceph.com 2023-11-10T12:00:35.484 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi023.front.sepia.ceph.com /etc/hosts 2023-11-10T12:00:35.544 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.23 smithi023.front.sepia.ceph.com smithi023 2023-11-10T12:00:35.544 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-10T12:00:35.658 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hosts 2023-11-10T12:00:35.690 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.23/172.21.15.23/g' /etc/hosts 2023-11-10T12:00:35.760 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi023.front.sepia.ceph.com/smithi023/g' /etc/hostname 2023-11-10T12:00:35.830 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023 2023-11-10T12:00:35.899 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-10T12:00:35.958 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-11-10T12:00:35.959 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-11-10T12:00:35.959 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-11-10T12:00:35.959 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-11-10T12:00:35.959 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-11-10T12:00:35.959 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:00:35.960 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-10T12:00:35.960 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-11-10T12:00:35.960 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-10T12:00:35.960 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-11-10T12:00:35.960 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:00:35.961 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:00:35.961 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-10T12:00:35.961 INFO:teuthology.provision.fog.smithi023:Deploy complete! 2023-11-10T12:00:35.962 DEBUG:teuthology.parallel:result is None 2023-11-10T12:00:36.110 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com 2023-11-10T12:00:36.111 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T12:00:36.134 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com 2023-11-10T12:00:36.135 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T12:00:36.152 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server 2023-11-10T12:00:36.152 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-10T12:00:36.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:36.222 DEBUG:teuthology.orchestra.run.smithi023:> true 2023-11-10T12:00:36.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com' 2023-11-10T12:00:36.289 DEBUG:teuthology.orchestra.run.smithi023:> uname -m 2023-11-10T12:00:36.347 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64 2023-11-10T12:00:36.347 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release 2023-11-10T12:00:36.404 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream" 2023-11-10T12:00:36.405 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="8" 2023-11-10T12:00:36.405 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos" 2023-11-10T12:00:36.405 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora" 2023-11-10T12:00:36.405 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="8" 2023-11-10T12:00:36.405 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:00:36.406 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-10T12:00:36.406 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31" 2023-11-10T12:00:36.406 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-10T12:00:36.406 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/" 2023-11-10T12:00:36.407 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:00:36.407 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:00:36.407 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-10T12:00:36.407 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server 2023-11-10T12:00:36.426 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server 2023-11-10T12:00:36.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-10T12:00:36.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:36.495 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-11-10T12:00:36.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-11-10T12:00:36.635 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-11-10T12:00:36.695 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-11-10T12:00:36.695 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-11-10T12:00:36.754 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-11-10T12:00:36.754 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-11-10T12:00:36.754 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-11-10T12:00:36.754 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-11-10T12:00:36.755 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-11-10T12:00:36.755 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:00:36.755 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-11-10T12:00:36.755 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-11-10T12:00:36.755 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-11-10T12:00:36.756 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-11-10T12:00:36.756 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:00:36.756 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:00:36.756 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-10T12:00:36.757 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-11-10T12:00:36.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:00:36.872 INFO:teuthology.dispatcher.supervisor:Running job 7453860 2023-11-10T12:00:36.873 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453860 --name rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453860/orig.config.yaml 2023-11-10T12:00:36.876 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453860 2023-11-10T12:00:36.876 INFO:teuthology.dispatcher.supervisor:Job PID: 1931273 2023-11-10T12:00:36.877 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-10T12:02:36.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:04:37.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:06:37.098 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:08:37.162 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:10:37.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:12:37.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:14:37.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:16:37.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:18:37.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:20:37.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:22:37.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:24:37.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:26:37.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:28:37.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:30:37.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:32:38.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:34:38.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:36:38.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:38:38.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:40:38.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:42:38.371 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:44:38.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:46:38.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:48:38.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:50:38.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:52:38.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:54:38.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:56:38.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:58:38.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T13:00:39.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T13:02:39.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T13:04:39.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T13:04:39.230 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-10T13:04:39.370 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi023 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-10_12:45:42-fs-rishabh-unqiue-fsnames-testing-default-smithi/7454019 2023-11-10T13:04:39.371 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/rishabh-2023-11-10_12:45:42-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453982