2023-08-11T11:58:00.960 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-11T11:58:00.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T11:58:01.155 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc84a531280>, signals=[15]) 2023-08-11T11:58:01.157 INFO:teuthology.lock.ops:Start node 'smithi006.front.sepia.ceph.com' reimaging 2023-08-11T11:58:01.159 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T11:58:01.160 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-08-11T11:58:01.189 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-08-11T11:58:01.189 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T11:58:01.189 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-08-11T11:58:01.191 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /host {"name": "smithi006"} 2023-08-11T11:58:01.213 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2023-08-11T11:58:01.213 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2023-08-11T11:58:01.213 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-08-11T11:58:01.215 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /host {"name": "smithi184"} 2023-08-11T11:58:01.240 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /host {"name": "smithi204"} 2023-08-11T11:58:01.264 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-11T11:58:01.289 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-11T11:58:01.312 DEBUG:teuthology.provision.fog.smithi006:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-11T11:58:01.312 DEBUG:teuthology.provision.fog.smithi006:FOG request: PUT /host/112 {"imageID": 5} 2023-08-11T11:58:01.315 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-08-11T11:58:01.333 DEBUG:teuthology.provision.fog.smithi184:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-11T11:58:01.334 DEBUG:teuthology.provision.fog.smithi184:FOG request: PUT /host/289 {"imageID": 5} 2023-08-11T11:58:01.357 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_rhel_8.6 (ID 5) 2023-08-11T11:58:01.358 DEBUG:teuthology.provision.fog.smithi204:FOG request: PUT /host/308 {"imageID": 5} 2023-08-11T11:58:01.362 INFO:teuthology.provision.fog.smithi006:Scheduling deploy of rhel 8.6 2023-08-11T11:58:01.362 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:01.375 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.6 2023-08-11T11:58:01.375 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:58:01.404 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T11:58:01.407 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of rhel 8.6 2023-08-11T11:58:01.407 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:01.415 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T11:58:01.442 DEBUG:teuthology.provision.fog.smithi006:FOG request: POST /host/112/task {"taskTypeID": 1} 2023-08-11T11:58:01.451 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /tasktype {"name": "deploy"} 2023-08-11T11:58:01.456 DEBUG:teuthology.provision.fog.smithi184:FOG request: POST /host/289/task {"taskTypeID": 1} 2023-08-11T11:58:01.487 DEBUG:teuthology.provision.fog.smithi204:FOG request: POST /host/308/task {"taskTypeID": 1} 2023-08-11T11:58:01.512 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:01.521 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:58:01.537 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:01.598 INFO:teuthology.orchestra.console.smithi184:Power off 2023-08-11T11:58:01.599 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:58:01.617 INFO:teuthology.orchestra.console.smithi204:Power off 2023-08-11T11:58:01.618 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:58:01.634 INFO:teuthology.orchestra.console.smithi006:Power off 2023-08-11T11:58:01.635 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T11:58:01.647 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-08-11T11:58:01.648 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.657 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-08-11T11:58:01.658 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.666 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-08-11T11:58:01.667 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.677 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-11T11:58:01.679 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-11T11:58:01.693 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-08-11T11:58:01.780 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-08-11T11:58:01.780 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-08-11T11:58:01.794 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-08-11T11:58:01.881 INFO:teuthology.orchestra.console.smithi204:Power on 2023-08-11T11:58:01.881 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T11:58:01.892 INFO:teuthology.orchestra.console.smithi184:Power on 2023-08-11T11:58:01.893 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T11:58:01.901 INFO:teuthology.orchestra.console.smithi006:Power on 2023-08-11T11:58:01.902 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-11T11:58:01.914 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2023-08-11T11:58:01.915 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.926 DEBUG:teuthology.orchestra.console.smithi184:power on output: Chassis Power Control: Up/On 2023-08-11T11:58:01.927 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.938 DEBUG:teuthology.orchestra.console.smithi006:power on output: Chassis Power Control: Up/On 2023-08-11T11:58:01.938 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:01.950 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-11T11:58:01.954 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-11T11:58:01.964 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-08-11T11:58:05.952 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:05.960 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:05.968 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:06.062 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-11T11:58:06.070 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-11T11:58:06.080 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-08-11T11:58:06.181 INFO:teuthology.orchestra.console.smithi006:Power on completed 2023-08-11T11:58:06.282 INFO:teuthology.provision.fog.smithi006:Waiting for deploy to finish 2023-08-11T11:58:06.282 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:10.064 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:10.075 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T11:58:10.177 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2023-08-11T11:58:10.190 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2023-08-11T11:58:10.278 INFO:teuthology.orchestra.console.smithi204:Power on completed 2023-08-11T11:58:10.292 INFO:teuthology.orchestra.console.smithi184:Power on completed 2023-08-11T11:58:10.380 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2023-08-11T11:58:10.380 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:10.393 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-08-11T11:58:10.393 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:58:21.348 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:25.428 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:25.444 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:58:36.416 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:40.484 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:40.499 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:58:51.486 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:58:55.543 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:58:55.562 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:59:06.555 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:59:10.604 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:59:10.613 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:59:21.620 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:59:25.664 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:59:25.666 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:59:36.681 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:59:40.736 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T11:59:40.737 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:59:51.752 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T11:59:55.798 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T11:59:55.799 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T12:00:06.832 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T12:00:10.852 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T12:00:10.855 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T12:00:21.904 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T12:00:25.916 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T12:00:25.918 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T12:00:36.972 DEBUG:teuthology.provision.fog.smithi006:FOG request: GET /task/active None 2023-08-11T12:00:37.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:00:37.110 ERROR:teuthology.orchestra.connection:Error authenticating with smithi006.front.sepia.ceph.com: Authentication failed. 2023-08-11T12:00:37.112 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T12:00:37.113 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T12:00:37.114 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-11T12:00:38.120 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-11T12:00:40.968 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T12:00:40.972 DEBUG:teuthology.provision.fog.smithi184:FOG request: GET /task/active None 2023-08-11T12:00:41.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:00:44.084 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:00:50.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:00:53.140 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:00:56.018 DEBUG:teuthology.provision.fog.smithi204:FOG request: GET /task/active None 2023-08-11T12:00:56.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:00:59.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:00:59.152 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:02.224 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:01:05.153 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:08.208 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:08.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:11.280 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:01:14.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:17.264 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:17.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:20.336 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:01:23.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:26.320 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:26.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:29.392 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:01:32.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:35.377 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:35.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:38.448 WARNING:teuthology.provision.fog.smithi184:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-08-11T12:01:41.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:44.439 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:44.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:50.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:01:53.520 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2023-08-11T12:01:59.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:02:28.088 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-11T12:02:28.090 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi006 2023-08-11T12:02:37.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-11T12:02:37.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:02:37.442 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-08-11T12:02:37.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-11T12:02:37.754 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T12:02:37.754 DEBUG:teuthology.orchestra.run.smithi006:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T12:02:37.773 INFO:teuthology.provision.fog.smithi006:Node is ready 2023-08-11T12:02:37.774 DEBUG:teuthology.orchestra.run.smithi006:> hostname 2023-08-11T12:02:37.833 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006.front.sepia.ceph.com 2023-08-11T12:02:37.833 DEBUG:teuthology.orchestra.run.smithi006:> grep smithi006.front.sepia.ceph.com /etc/hosts 2023-08-11T12:02:37.894 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6 smithi006.front.sepia.ceph.com smithi006 2023-08-11T12:02:37.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-08-11T12:02:38.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hosts 2023-08-11T12:02:38.044 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/172.21.15.6/172.21.15.6/g' /etc/hosts 2023-08-11T12:02:38.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i -e 's/smithi006.front.sepia.ceph.com/smithi006/g' /etc/hostname 2023-08-11T12:02:38.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname smithi006 2023-08-11T12:02:38.254 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-08-11T12:02:38.312 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:02:38.312 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:02:38.313 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-08-11T12:02:38.313 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-08-11T12:02:38.313 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-08-11T12:02:38.313 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:02:38.313 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:02:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-08-11T12:02:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:02:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:02:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:02:38.314 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:02:38.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-11T12:02:38.315 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:02:38.315 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:02:38.315 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:02:38.315 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:02:38.316 INFO:teuthology.provision.fog.smithi006:Deploy complete! 2023-08-11T12:02:38.317 DEBUG:teuthology.parallel:result is None 2023-08-11T12:02:44.451 WARNING:teuthology.provision.fog.smithi184:timed out 2023-08-11T12:02:50.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:02:50.800 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T12:02:50.801 DEBUG:teuthology.orchestra.run.smithi184:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T12:02:51.089 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-08-11T12:02:51.089 DEBUG:teuthology.orchestra.run.smithi184:> hostname 2023-08-11T12:02:51.108 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-08-11T12:02:51.109 DEBUG:teuthology.orchestra.run.smithi184:> grep smithi184.front.sepia.ceph.com /etc/hosts 2023-08-11T12:02:51.170 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-08-11T12:02:51.170 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-08-11T12:02:51.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hosts 2023-08-11T12:02:51.357 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/172.21.15.184/172.21.15.184/g' /etc/hosts 2023-08-11T12:02:51.430 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i -e 's/smithi184.front.sepia.ceph.com/smithi184/g' /etc/hostname 2023-08-11T12:02:51.503 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname smithi184 2023-08-11T12:02:51.573 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-08-11T12:02:51.632 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:02:51.633 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:02:51.633 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-08-11T12:02:51.633 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-08-11T12:02:51.633 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-08-11T12:02:51.633 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:02:51.634 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-08-11T12:02:51.635 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:02:51.635 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:02:51.635 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:02:51.635 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:02:51.635 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-08-11T12:02:51.636 DEBUG:teuthology.parallel:result is None 2023-08-11T12:02:59.525 WARNING:teuthology.provision.fog.smithi204:timed out 2023-08-11T12:03:05.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:03:05.858 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-11T12:03:05.858 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-11T12:03:06.179 INFO:teuthology.provision.fog.smithi204:Node is ready 2023-08-11T12:03:06.179 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2023-08-11T12:03:06.197 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204 2023-08-11T12:03:06.198 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204 /etc/hosts 2023-08-11T12:03:06.257 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2023-08-11T12:03:06.258 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-08-11T12:03:06.395 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204/smithi204/g' /etc/hosts 2023-08-11T12:03:06.427 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2023-08-11T12:03:06.495 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204/smithi204/g' /etc/hostname 2023-08-11T12:03:06.563 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2023-08-11T12:03:06.632 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-08-11T12:03:06.689 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:03:06.690 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-08-11T12:03:06.691 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:03:06.691 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:03:06.691 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:03:06.691 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:03:06.691 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2023-08-11T12:03:06.692 DEBUG:teuthology.parallel:result is None 2023-08-11T12:03:06.869 INFO:teuthology.lock.ops:Checking smithi006.front.sepia.ceph.com 2023-08-11T12:03:06.870 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T12:03:06.905 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-08-11T12:03:06.905 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T12:03:06.921 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2023-08-11T12:03:06.922 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-11T12:03:06.948 INFO:teuthology.lock.ops:Updating [smithi006.front.sepia.ceph.com]: set os type and version on server 2023-08-11T12:03:06.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-11T12:03:06.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:03:07.015 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-08-11T12:03:07.093 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-08-11T12:03:07.094 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-08-11T12:03:07.154 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-08-11T12:03:07.154 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-08-11T12:03:07.213 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:03:07.214 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:03:07.214 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-08-11T12:03:07.214 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-08-11T12:03:07.215 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:03:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:03:07.217 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:03:07.218 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-08-11T12:03:07.247 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-08-11T12:03:07.248 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-08-11T12:03:07.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:03:07.316 DEBUG:teuthology.orchestra.run.smithi184:> true 2023-08-11T12:03:07.449 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-08-11T12:03:07.450 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2023-08-11T12:03:07.507 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-08-11T12:03:07.507 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2023-08-11T12:03:07.564 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:03:07.565 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:03:07.565 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-08-11T12:03:07.565 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-08-11T12:03:07.566 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.6" 2023-08-11T12:03:07.566 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:03:07.566 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:03:07.567 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-08-11T12:03:07.568 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:03:07.569 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:03:07.569 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:03:07.569 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:03:07.569 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-08-11T12:03:07.570 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:03:07.570 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:03:07.570 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:03:07.570 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:03:07.571 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-08-11T12:03:07.597 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2023-08-11T12:03:07.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-08-11T12:03:07.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-11T12:03:07.709 DEBUG:teuthology.orchestra.run.smithi204:> true 2023-08-11T12:03:07.784 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2023-08-11T12:03:07.785 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2023-08-11T12:03:07.843 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2023-08-11T12:03:07.844 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2023-08-11T12:03:07.902 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="Red Hat Enterprise Linux" 2023-08-11T12:03:07.902 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8.6 (Ootpa)" 2023-08-11T12:03:07.902 INFO:teuthology.orchestra.run.smithi204.stdout:ID="rhel" 2023-08-11T12:03:07.902 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="fedora" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8.6" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-11T12:03:07.903 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://www.redhat.com/" 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout: 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-11T12:03:07.904 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-11T12:03:07.905 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-11T12:03:07.906 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2023-08-11T12:03:07.930 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:03:08.037 INFO:teuthology.dispatcher.supervisor:Running job 7365747 2023-08-11T12:03:08.037 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747 --name rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747/orig.config.yaml 2023-08-11T12:03:08.041 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747 2023-08-11T12:03:08.042 INFO:teuthology.dispatcher.supervisor:Job PID: 8320 2023-08-11T12:03:08.042 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-11T12:05:08.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:07:08.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:09:08.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:11:08.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:13:08.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:15:08.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:17:09.125 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:19:09.293 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:21:09.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:23:09.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:25:09.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:27:09.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:29:10.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:31:10.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:33:10.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:35:10.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:37:10.753 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:39:10.917 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:41:11.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:43:11.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:45:11.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:47:11.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:49:11.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:51:11.937 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:53:12.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:55:12.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:57:12.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:59:12.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-11T12:59:12.672 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-11T12:59:12.935 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-11T12:59:12.936 INFO:teuthology.nuke:Checking targets against current locks 2023-08-11T12:59:12.984 DEBUG:teuthology.nuke:shortname: smithi006 2023-08-11T12:59:12.985 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:59:13.015 DEBUG:teuthology.nuke:shortname: smithi184 2023-08-11T12:59:13.016 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:59:13.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:58:00.114141', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:59:13.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:58:00.111520', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:59:13.043 DEBUG:teuthology.nuke:shortname: smithi204 2023-08-11T12:59:13.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-11T12:59:13.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi204.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_20:16:46-fs-wip-rishabh-2023Aug1-b4-testing-default-smithi/7365747', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 11:58:00.113291', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-11T12:59:13.080 INFO:teuthology.orchestra.console.smithi006:Power off 2023-08-11T12:59:13.081 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:59:13.098 INFO:teuthology.orchestra.console.smithi184:Power off 2023-08-11T12:59:13.099 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:59:13.120 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-08-11T12:59:13.120 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:59:13.130 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2023-08-11T12:59:13.131 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:59:13.142 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-08-11T12:59:13.155 INFO:teuthology.orchestra.console.smithi204:Power off 2023-08-11T12:59:13.156 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-11T12:59:13.166 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2023-08-11T12:59:13.178 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2023-08-11T12:59:13.178 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-11T12:59:13.200 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2023-08-11T12:59:13.243 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-08-11T12:59:13.267 INFO:teuthology.orchestra.console.smithi184:Power off completed 2023-08-11T12:59:13.301 INFO:teuthology.orchestra.console.smithi204:Power off completed 2023-08-11T12:59:13.395 INFO:teuthology.lock.ops:unlocked: smithi006.front.sepia.ceph.com 2023-08-11T12:59:13.411 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com 2023-08-11T12:59:13.453 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com