2023-10-16T19:50:38.197 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-16T19:50:38.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:50:38.373 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f10973b7c10>, signals=[15]) 2023-10-16T19:50:38.374 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-10-16T19:50:38.375 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T19:50:38.375 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-16T19:50:38.401 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-10-16T19:50:38.401 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T19:50:38.402 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-16T19:50:38.403 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-10-16T19:50:38.425 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2023-10-16T19:50:38.426 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2023-10-16T19:50:38.426 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-16T19:50:38.428 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-10-16T19:50:38.451 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /host {"name": "smithi183"} 2023-10-16T19:50:38.479 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T19:50:38.498 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T19:50:38.516 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T19:50:38.516 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 5} 2023-10-16T19:50:38.525 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-10-16T19:50:38.550 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T19:50:38.550 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 5} 2023-10-16T19:50:38.563 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of rhel 8.6 2023-10-16T19:50:38.564 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:50:38.566 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.6 (ID 5) 2023-10-16T19:50:38.567 DEBUG:teuthology.provision.fog.smithi183:FOG request: PUT /host/288 {"imageID": 5} 2023-10-16T19:50:38.599 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-10-16T19:50:38.599 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:50:38.621 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.6 2023-10-16T19:50:38.621 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:50:38.639 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T19:50:38.654 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T19:50:38.670 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-10-16T19:50:38.675 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /tasktype {"name": "deploy"} 2023-10-16T19:50:38.701 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-10-16T19:50:38.715 DEBUG:teuthology.provision.fog.smithi183:FOG request: POST /host/288/task {"taskTypeID": 1} 2023-10-16T19:50:38.719 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:50:38.757 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:50:38.785 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:50:38.827 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-16T19:50:38.828 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:50:38.843 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-16T19:50:38.843 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:50:38.855 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-16T19:50:38.856 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:38.864 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-16T19:50:38.864 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:38.877 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-16T19:50:38.889 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-16T19:50:38.890 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T19:50:38.898 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-16T19:50:38.911 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-16T19:50:38.911 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:38.934 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-16T19:50:38.978 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-16T19:50:38.999 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-16T19:50:39.035 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-16T19:50:39.079 INFO:teuthology.orchestra.console.smithi017:Power on 2023-10-16T19:50:39.079 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T19:50:39.100 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-10-16T19:50:39.101 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:39.108 INFO:teuthology.orchestra.console.smithi175:Power on 2023-10-16T19:50:39.108 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T19:50:39.122 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-16T19:50:39.129 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-10-16T19:50:39.129 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:39.136 INFO:teuthology.orchestra.console.smithi183:Power on 2023-10-16T19:50:39.137 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-16T19:50:39.151 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-16T19:50:39.159 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2023-10-16T19:50:39.160 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:39.182 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-16T19:50:43.126 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:43.152 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:43.184 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:43.237 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-16T19:50:43.262 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-16T19:50:43.293 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-16T19:50:47.242 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:47.263 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:47.294 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T19:50:47.353 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-16T19:50:47.372 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-10-16T19:50:47.403 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-16T19:50:47.454 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-10-16T19:50:47.474 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-10-16T19:50:47.505 INFO:teuthology.orchestra.console.smithi183:Power on completed 2023-10-16T19:50:47.555 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-10-16T19:50:47.556 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:50:47.575 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-10-16T19:50:47.575 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:50:47.606 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2023-10-16T19:50:47.606 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:51:02.638 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:51:02.640 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:51:02.671 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:51:17.717 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:51:17.719 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:51:17.727 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:51:32.786 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:51:32.788 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:51:32.789 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:51:47.866 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:51:47.868 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:51:47.869 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:52:02.942 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:52:02.944 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:52:02.945 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:52:18.018 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:52:18.024 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:52:18.026 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:52:33.082 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:52:33.084 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:52:33.084 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:52:48.154 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:52:48.156 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:52:48.157 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:53:03.224 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:53:03.225 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:53:03.230 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:53:18.291 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-16T19:53:18.292 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:53:18.293 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:53:18.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:33.362 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-10-16T19:53:33.363 DEBUG:teuthology.provision.fog.smithi183:FOG request: GET /task/active None 2023-10-16T19:53:33.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:33.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:36.890 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-16T19:53:42.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:45.946 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-16T19:53:51.742 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-16T19:53:51.743 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-16T19:53:51.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:55.006 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-16T19:53:57.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:53:57.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:00.830 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-16T19:54:00.831 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-16T19:54:01.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:06.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:06.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:09.914 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-16T19:54:09.915 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-16T19:54:15.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:15.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:18.974 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2023-10-16T19:54:18.975 WARNING:teuthology.provision.fog.smithi175:[Errno None] Unable to connect to port 22 on 172.21.15.175 2023-10-16T19:54:24.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:54:24.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:01.046 WARNING:teuthology.provision.fog.smithi017:timed out 2023-10-16T19:55:07.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:07.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T19:55:07.366 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T19:55:07.685 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-10-16T19:55:07.685 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-10-16T19:55:07.704 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-10-16T19:55:07.705 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-10-16T19:55:07.765 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-10-16T19:55:07.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-16T19:55:07.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-10-16T19:55:07.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-10-16T19:55:07.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-10-16T19:55:08.047 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-16T19:55:08.115 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-16T19:55:08.172 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:08.172 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:08.172 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-16T19:55:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-16T19:55:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-10-16T19:55:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:08.173 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:08.174 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:08.174 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-16T19:55:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:08.175 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:08.176 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-10-16T19:55:08.177 DEBUG:teuthology.parallel:result is None 2023-10-16T19:55:24.999 WARNING:teuthology.provision.fog.smithi183:timed out 2023-10-16T19:55:25.000 WARNING:teuthology.provision.fog.smithi175:timed out 2023-10-16T19:55:31.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:31.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:31.345 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T19:55:31.345 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T19:55:31.367 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-16T19:55:31.367 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-16T19:55:31.637 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-10-16T19:55:31.637 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-10-16T19:55:31.656 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175.front.sepia.ceph.com 2023-10-16T19:55:31.657 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175.front.sepia.ceph.com /etc/hosts 2023-10-16T19:55:31.664 INFO:teuthology.provision.fog.smithi183:Node is ready 2023-10-16T19:55:31.665 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2023-10-16T19:55:31.681 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2023-10-16T19:55:31.682 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183.front.sepia.ceph.com /etc/hosts 2023-10-16T19:55:31.714 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-10-16T19:55:31.715 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-16T19:55:31.742 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2023-10-16T19:55:31.743 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-16T19:55:31.833 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hosts 2023-10-16T19:55:31.855 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hosts 2023-10-16T19:55:31.864 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-10-16T19:55:31.883 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2023-10-16T19:55:31.932 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175.front.sepia.ceph.com/smithi175/g' /etc/hostname 2023-10-16T19:55:31.954 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183.front.sepia.ceph.com/smithi183/g' /etc/hostname 2023-10-16T19:55:32.001 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-10-16T19:55:32.024 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2023-10-16T19:55:32.068 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-16T19:55:32.093 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-16T19:55:32.125 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:32.125 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:32.126 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-16T19:55:32.126 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-16T19:55:32.126 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-16T19:55:32.126 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:32.127 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:32.127 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:32.127 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:32.127 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:32.128 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:32.128 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:32.128 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-16T19:55:32.128 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:32.128 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:32.129 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:32.129 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:32.129 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-10-16T19:55:32.130 DEBUG:teuthology.parallel:result is None 2023-10-16T19:55:32.153 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:32.154 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:32.154 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-10-16T19:55:32.154 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-10-16T19:55:32.154 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-10-16T19:55:32.155 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:32.155 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:32.155 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:32.155 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:32.155 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:32.156 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:32.156 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:32.156 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-16T19:55:32.156 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:32.156 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:32.157 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:32.157 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:32.157 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2023-10-16T19:55:32.158 DEBUG:teuthology.parallel:result is None 2023-10-16T19:55:32.374 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-10-16T19:55:32.375 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T19:55:32.397 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-10-16T19:55:32.397 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2023-10-16T19:55:32.398 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-16T19:55:32.424 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-10-16T19:55:32.424 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-16T19:55:32.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:32.494 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-16T19:55:32.629 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-16T19:55:32.630 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-16T19:55:32.687 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-16T19:55:32.688 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-16T19:55:32.745 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:32.745 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:32.746 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-16T19:55:32.746 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-16T19:55:32.746 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.6" 2023-10-16T19:55:32.746 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:32.747 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:32.747 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:32.747 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:32.747 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:32.747 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:32.748 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:32.748 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-16T19:55:32.748 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:32.748 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:32.748 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:32.749 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:32.749 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-16T19:55:32.772 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-10-16T19:55:32.772 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-16T19:55:32.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:32.839 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-10-16T19:55:32.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-10-16T19:55:32.915 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-10-16T19:55:32.973 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-10-16T19:55:32.974 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-10-16T19:55:33.032 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:33.032 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:33.033 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-10-16T19:55:33.033 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-10-16T19:55:33.033 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-10-16T19:55:33.033 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:33.033 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:33.034 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:33.034 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:33.034 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:33.034 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:33.034 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:33.035 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-10-16T19:55:33.035 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:33.035 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:33.035 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:33.035 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:33.036 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-10-16T19:55:33.055 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2023-10-16T19:55:33.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-16T19:55:33.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-16T19:55:33.126 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-16T19:55:33.191 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-16T19:55:33.192 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-16T19:55:33.252 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-16T19:55:33.252 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-16T19:55:33.313 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2023-10-16T19:55:33.313 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2023-10-16T19:55:33.314 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2023-10-16T19:55:33.314 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2023-10-16T19:55:33.314 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2023-10-16T19:55:33.314 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2023-10-16T19:55:33.314 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-10-16T19:55:33.315 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-16T19:55:33.315 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-10-16T19:55:33.315 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2023-10-16T19:55:33.315 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-16T19:55:33.315 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-16T19:55:33.316 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-16T19:55:33.316 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-16T19:55:33.316 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-10-16T19:55:33.316 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-16T19:55:33.316 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-10-16T19:55:33.317 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-16T19:55:33.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:55:33.431 INFO:teuthology.dispatcher.supervisor:Running job 7430100 2023-10-16T19:55:33.431 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100 --name rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/kernel_untar_build}} -- /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100/orig.config.yaml 2023-10-16T19:55:33.434 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100 2023-10-16T19:55:33.435 INFO:teuthology.dispatcher.supervisor:Job PID: 712226 2023-10-16T19:55:33.435 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-16T19:57:33.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T19:59:33.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:01:33.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:03:34.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:05:34.183 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:07:34.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:09:34.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:11:34.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:13:34.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:15:34.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:17:35.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:19:35.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:21:35.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:23:35.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:25:35.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:27:36.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:29:36.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:31:36.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:33:36.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:35:36.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:37:36.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:39:37.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:41:37.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:43:37.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:45:37.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:47:37.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:49:37.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:51:38.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:53:38.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:55:38.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:57:38.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T20:59:38.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:01:38.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:03:39.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:05:39.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:07:39.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:09:39.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:11:39.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:13:39.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:15:40.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:17:40.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:19:41.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:21:41.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:23:41.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:25:41.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:27:41.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:29:41.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:31:42.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:33:42.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:35:42.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:37:42.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:39:42.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:41:42.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:43:42.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:45:43.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:47:43.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:49:43.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:51:43.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:53:43.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:55:44.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:57:44.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T21:59:44.416 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T22:01:44.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T22:03:44.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T22:05:44.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-16T22:05:44.965 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-16T22:05:45.180 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-16T22:05:45.180 INFO:teuthology.nuke:Checking targets against current locks 2023-10-16T22:05:45.235 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-16T22:05:45.235 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T22:05:45.256 DEBUG:teuthology.nuke:shortname: smithi175 2023-10-16T22:05:45.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T22:05:45.259 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:50:37.358515', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T22:05:45.273 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-16T22:05:45.274 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-16T22:05:45.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:50:37.359641', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T22:05:45.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-16_18:49:15-fs-rishabh-2023oct13-testing-default-smithi/7430100', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-16 19:50:37.356704', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-10-16T22:05:45.311 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-16T22:05:45.311 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T22:05:45.332 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-16T22:05:45.332 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T22:05:45.346 INFO:teuthology.orchestra.console.smithi175:Power off 2023-10-16T22:05:45.346 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T22:05:45.359 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-16T22:05:45.360 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-16T22:05:45.368 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-16T22:05:45.368 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-10-16T22:05:45.369 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T22:05:45.380 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-16T22:05:45.380 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-16T22:05:45.389 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-10-16T22:05:45.400 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-16T22:05:45.469 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-16T22:05:45.490 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-10-16T22:05:45.501 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-16T22:05:45.623 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-10-16T22:05:45.641 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com 2023-10-16T22:05:45.648 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com