2023-11-09T18:36:59.024 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-09T18:36:59.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:36:59.192 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6452597670>, signals=[15]) 2023-11-09T18:36:59.193 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging 2023-11-09T18:36:59.194 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T18:36:59.194 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-11-09T18:36:59.211 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging 2023-11-09T18:36:59.211 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T18:36:59.212 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-11-09T18:36:59.213 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"} 2023-11-09T18:36:59.236 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging 2023-11-09T18:36:59.236 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server 2023-11-09T18:36:59.236 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-09T18:36:59.237 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"} 2023-11-09T18:36:59.262 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"} 2023-11-09T18:36:59.285 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T18:36:59.299 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T18:36:59.326 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-09T18:36:59.431 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T18:36:59.432 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 5} 2023-11-09T18:36:59.434 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T18:36:59.435 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 5} 2023-11-09T18:36:59.437 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-09T18:36:59.438 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 5} 2023-11-09T18:36:59.483 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of rhel 8.6 2023-11-09T18:36:59.483 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:36:59.489 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of rhel 8.6 2023-11-09T18:36:59.489 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:36:59.492 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of rhel 8.6 2023-11-09T18:36:59.492 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:36:59.521 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T18:36:59.532 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T18:36:59.535 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"} 2023-11-09T18:36:59.556 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1} 2023-11-09T18:36:59.565 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1} 2023-11-09T18:36:59.567 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1} 2023-11-09T18:36:59.614 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:36:59.618 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:36:59.628 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:36:59.691 INFO:teuthology.orchestra.console.smithi007:Power off 2023-11-09T18:36:59.692 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:36:59.708 INFO:teuthology.orchestra.console.smithi120:Power off 2023-11-09T18:36:59.708 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:36:59.720 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-09T18:36:59.720 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:36:59.730 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-11-09T18:36:59.730 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:36:59.738 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-11-09T18:36:59.738 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:36:59.747 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-09T18:36:59.747 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:36:59.755 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-11-09T18:36:59.759 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-11-09T18:36:59.773 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-09T18:36:59.856 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-11-09T18:36:59.861 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-11-09T18:36:59.874 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-09T18:36:59.957 INFO:teuthology.orchestra.console.smithi120:Power on 2023-11-09T18:36:59.957 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T18:36:59.965 INFO:teuthology.orchestra.console.smithi007:Power on 2023-11-09T18:36:59.966 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T18:36:59.975 INFO:teuthology.orchestra.console.smithi188:Power on 2023-11-09T18:36:59.976 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-09T18:36:59.983 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On 2023-11-09T18:36:59.984 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:36:59.991 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On 2023-11-09T18:36:59.992 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:36:59.999 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On 2023-11-09T18:37:00.000 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:37:00.008 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-11-09T18:37:00.013 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-11-09T18:37:00.020 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-09T18:37:04.010 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:37:04.017 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:37:04.023 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:37:04.119 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on 2023-11-09T18:37:04.125 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-11-09T18:37:04.132 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2023-11-09T18:37:04.221 INFO:teuthology.orchestra.console.smithi120:Power on completed 2023-11-09T18:37:04.233 INFO:teuthology.orchestra.console.smithi188:Power on completed 2023-11-09T18:37:04.323 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish 2023-11-09T18:37:04.323 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:37:04.334 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish 2023-11-09T18:37:04.334 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:37:08.129 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:37:08.238 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-11-09T18:37:08.338 INFO:teuthology.orchestra.console.smithi007:Power on completed 2023-11-09T18:37:08.439 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish 2023-11-09T18:37:08.439 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:37:19.415 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:37:19.425 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:37:23.543 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:37:34.514 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:37:34.516 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:37:38.636 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:37:49.614 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:37:49.615 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:37:53.734 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:38:04.711 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:38:04.712 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:38:08.836 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:38:19.818 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:38:19.819 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:38:23.934 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:38:34.921 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:38:34.923 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:38:39.033 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:38:50.030 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:38:50.032 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:38:54.130 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:39:05.150 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:39:05.154 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:39:09.259 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:39:20.300 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:39:20.301 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:39:24.389 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:39:35.414 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:39:35.415 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:39:39.481 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None 2023-11-09T18:39:39.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:39:50.517 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None 2023-11-09T18:39:50.518 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None 2023-11-09T18:39:50.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:39:50.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:09.082 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-09T18:40:09.083 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-09T18:40:15.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:15.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:18.138 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-09T18:40:18.139 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-09T18:40:24.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:24.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:27.226 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-09T18:40:27.227 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-09T18:40:33.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:33.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:36.282 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-09T18:40:36.283 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188 2023-11-09T18:40:39.574 WARNING:teuthology.provision.fog.smithi007:timed out 2023-11-09T18:40:42.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:42.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:45.338 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120 2023-11-09T18:40:45.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:51.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:40:55.930 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-11-09T18:41:01.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:04.986 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7 2023-11-09T18:41:10.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:11.548 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T18:41:11.549 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T18:41:11.880 INFO:teuthology.provision.fog.smithi007:Node is ready 2023-11-09T18:41:11.880 DEBUG:teuthology.orchestra.run.smithi007:> hostname 2023-11-09T18:41:11.896 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com 2023-11-09T18:41:11.897 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts 2023-11-09T18:41:11.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007 2023-11-09T18:41:11.954 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-11-09T18:41:12.163 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts 2023-11-09T18:41:12.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts 2023-11-09T18:41:12.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname 2023-11-09T18:41:12.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007 2023-11-09T18:41:12.396 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-11-09T18:41:12.452 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:41:12.452 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:41:12.453 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-11-09T18:41:12.453 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-11-09T18:41:12.453 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-11-09T18:41:12.453 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:41:12.454 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:41:12.454 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-11-09T18:41:12.454 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:41:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:41:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:41:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:41:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-11-09T18:41:12.455 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:41:12.456 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:41:12.456 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:41:12.456 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:41:12.457 INFO:teuthology.provision.fog.smithi007:Deploy complete! 2023-11-09T18:41:12.458 DEBUG:teuthology.parallel:result is None 2023-11-09T18:41:42.320 WARNING:teuthology.provision.fog.smithi188:timed out 2023-11-09T18:41:48.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:48.662 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T18:41:48.662 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T18:41:48.949 INFO:teuthology.provision.fog.smithi188:Node is ready 2023-11-09T18:41:48.950 DEBUG:teuthology.orchestra.run.smithi188:> hostname 2023-11-09T18:41:48.968 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com 2023-11-09T18:41:48.968 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts 2023-11-09T18:41:49.026 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188 2023-11-09T18:41:49.026 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-09T18:41:49.150 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts 2023-11-09T18:41:49.179 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts 2023-11-09T18:41:49.247 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname 2023-11-09T18:41:49.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188 2023-11-09T18:41:49.379 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-09T18:41:49.436 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:41:49.436 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:41:49.436 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-11-09T18:41:49.436 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-11-09T18:41:49.437 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-11-09T18:41:49.437 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:41:49.437 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:41:49.437 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-09T18:41:49.437 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:41:49.438 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:41:49.438 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:41:49.438 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:41:49.438 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-09T18:41:49.438 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:41:49.439 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:41:49.439 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:41:49.439 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:41:49.439 INFO:teuthology.provision.fog.smithi188:Deploy complete! 2023-11-09T18:41:49.440 DEBUG:teuthology.parallel:result is None 2023-11-09T18:41:51.349 WARNING:teuthology.provision.fog.smithi120:timed out 2023-11-09T18:41:57.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:58.643 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-09T18:41:58.643 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-09T18:41:58.940 INFO:teuthology.provision.fog.smithi120:Node is ready 2023-11-09T18:41:58.941 DEBUG:teuthology.orchestra.run.smithi120:> hostname 2023-11-09T18:41:58.958 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120 2023-11-09T18:41:58.958 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120 /etc/hosts 2023-11-09T18:41:59.015 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120 2023-11-09T18:41:59.016 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-11-09T18:41:59.125 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hosts 2023-11-09T18:41:59.153 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts 2023-11-09T18:41:59.220 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120/smithi120/g' /etc/hostname 2023-11-09T18:41:59.287 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120 2023-11-09T18:41:59.353 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-11-09T18:41:59.410 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:41:59.411 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:41:59.411 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-11-09T18:41:59.411 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-11-09T18:41:59.411 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-11-09T18:41:59.412 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:41:59.412 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:41:59.412 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-11-09T18:41:59.412 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:41:59.413 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:41:59.413 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:41:59.413 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:41:59.413 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-09T18:41:59.414 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:41:59.414 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:41:59.414 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:41:59.414 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:41:59.415 INFO:teuthology.provision.fog.smithi120:Deploy complete! 2023-11-09T18:41:59.416 DEBUG:teuthology.parallel:result is None 2023-11-09T18:41:59.611 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com 2023-11-09T18:41:59.612 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com 2023-11-09T18:41:59.612 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com 2023-11-09T18:41:59.614 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server 2023-11-09T18:41:59.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-11-09T18:41:59.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:59.680 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-11-09T18:41:59.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-11-09T18:41:59.746 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-11-09T18:41:59.801 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-11-09T18:41:59.802 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-11-09T18:41:59.858 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:41:59.858 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:41:59.859 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-11-09T18:41:59.859 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-11-09T18:41:59.859 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-11-09T18:41:59.859 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:41:59.859 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:41:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-11-09T18:41:59.861 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:41:59.861 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:41:59.861 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:41:59.861 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:41:59.862 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-11-09T18:41:59.891 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server 2023-11-09T18:41:59.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-09T18:41:59.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:41:59.957 DEBUG:teuthology.orchestra.run.smithi120:> true 2023-11-09T18:42:00.027 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2023-11-09T18:42:00.028 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2023-11-09T18:42:00.085 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2023-11-09T18:42:00.086 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2023-11-09T18:42:00.143 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:ID="rhel" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="fedora" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8.6" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:42:00.144 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:42:00.145 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31" 2023-11-09T18:42:00.145 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:42:00.145 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:42:00.145 INFO:teuthology.orchestra.run.smithi120.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:42:00.145 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:42:00.146 INFO:teuthology.orchestra.run.smithi120.stdout: 2023-11-09T18:42:00.146 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:42:00.146 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:42:00.146 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:42:00.147 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:42:00.147 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2023-11-09T18:42:00.166 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server 2023-11-09T18:42:00.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-09T18:42:00.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-09T18:42:00.233 DEBUG:teuthology.orchestra.run.smithi188:> true 2023-11-09T18:42:00.367 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2023-11-09T18:42:00.368 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2023-11-09T18:42:00.426 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2023-11-09T18:42:00.426 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2023-11-09T18:42:00.483 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="Red Hat Enterprise Linux" 2023-11-09T18:42:00.483 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8.6 (Ootpa)" 2023-11-09T18:42:00.483 INFO:teuthology.orchestra.run.smithi188.stdout:ID="rhel" 2023-11-09T18:42:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="fedora" 2023-11-09T18:42:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8.6" 2023-11-09T18:42:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8" 2023-11-09T18:42:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-09T18:42:00.484 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2023-11-09T18:42:00.485 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-09T18:42:00.485 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://www.redhat.com/" 2023-11-09T18:42:00.485 INFO:teuthology.orchestra.run.smithi188.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-09T18:42:00.485 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-09T18:42:00.485 INFO:teuthology.orchestra.run.smithi188.stdout: 2023-11-09T18:42:00.486 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-09T18:42:00.486 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-09T18:42:00.486 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-09T18:42:00.486 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-09T18:42:00.487 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2023-11-09T18:42:00.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:42:00.604 INFO:teuthology.dispatcher.supervisor:Running job 7453027 2023-11-09T18:42:00.605 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027 --name mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027/orig.config.yaml 2023-11-09T18:42:00.608 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027 2023-11-09T18:42:00.609 INFO:teuthology.dispatcher.supervisor:Job PID: 2262160 2023-11-09T18:42:00.609 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-09T18:44:00.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:46:00.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:48:01.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:50:01.219 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:52:01.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:54:01.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:56:01.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-09T18:56:01.772 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-09T18:56:01.975 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-09T18:56:01.976 INFO:teuthology.nuke:Checking targets against current locks 2023-11-09T18:56:02.023 DEBUG:teuthology.nuke:shortname: smithi007 2023-11-09T18:56:02.023 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T18:56:02.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 18:36:58.208178', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T18:56:02.053 DEBUG:teuthology.nuke:shortname: smithi120 2023-11-09T18:56:02.054 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T18:56:02.079 DEBUG:teuthology.nuke:shortname: smithi188 2023-11-09T18:56:02.079 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-09T18:56:02.082 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 18:36:58.206849', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T18:56:02.099 INFO:teuthology.orchestra.console.smithi007:Power off 2023-11-09T18:56:02.099 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:56:02.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-11-09_18:35:30-fs:workload-main-distro-default-smithi/7453027', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 18:36:58.205104', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-09T18:56:02.122 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-11-09T18:56:02.123 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:56:02.141 INFO:teuthology.orchestra.console.smithi120:Power off 2023-11-09T18:56:02.142 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:56:02.150 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-11-09T18:56:02.161 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off 2023-11-09T18:56:02.162 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:56:02.175 INFO:teuthology.orchestra.console.smithi188:Power off 2023-11-09T18:56:02.175 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-09T18:56:02.182 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off 2023-11-09T18:56:02.195 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2023-11-09T18:56:02.196 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-09T18:56:02.217 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2023-11-09T18:56:02.252 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-11-09T18:56:02.284 INFO:teuthology.orchestra.console.smithi120:Power off completed 2023-11-09T18:56:02.318 INFO:teuthology.orchestra.console.smithi188:Power off completed 2023-11-09T18:56:02.456 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com 2023-11-09T18:56:02.457 INFO:teuthology.lock.ops:unlocked: smithi007.front.sepia.ceph.com 2023-11-09T18:56:02.462 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com