2023-08-30T09:28:58.372 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T09:28:58.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:28:58.515 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb8ae4081f0>, signals=[15]) 2023-08-30T09:28:58.516 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-08-30T09:28:58.517 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T09:28:58.517 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-30T09:28:58.545 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-08-30T09:28:58.545 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T09:28:58.546 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-30T09:28:58.547 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-08-30T09:28:58.570 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /host {"name": "smithi178"} 2023-08-30T09:28:58.620 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T09:28:58.645 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-30T09:28:58.667 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T09:28:58.668 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 6} 2023-08-30T09:28:58.687 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-30T09:28:58.687 DEBUG:teuthology.provision.fog.smithi178:FOG request: PUT /host/283 {"imageID": 6} 2023-08-30T09:28:58.727 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of ubuntu 22.04 2023-08-30T09:28:58.727 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:28:58.731 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 22.04 2023-08-30T09:28:58.731 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:28:58.791 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T09:28:58.802 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T09:28:58.824 DEBUG:teuthology.provision.fog.smithi178:FOG request: POST /host/283/task {"taskTypeID": 1} 2023-08-30T09:28:58.834 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-08-30T09:28:58.882 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:28:58.885 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:28:58.990 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-30T09:28:58.991 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:28:59.005 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-30T09:28:59.005 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:28:59.013 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-30T09:28:59.013 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:28:59.026 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-30T09:28:59.026 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:28:59.034 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-30T09:28:59.047 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-30T09:29:03.038 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:03.048 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:03.148 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-30T09:29:03.156 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-30T09:29:07.150 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:07.157 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:07.261 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-30T09:29:07.264 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-30T09:29:07.366 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-30T09:29:07.467 INFO:teuthology.orchestra.console.smithi178:Power on 2023-08-30T09:29:07.467 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T09:29:07.488 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On 2023-08-30T09:29:07.488 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:07.512 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-30T09:29:11.266 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:11.375 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-30T09:29:11.476 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-30T09:29:11.513 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:11.577 INFO:teuthology.orchestra.console.smithi153:Power on 2023-08-30T09:29:11.578 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T09:29:11.598 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-08-30T09:29:11.599 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:11.619 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-30T09:29:11.623 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-30T09:29:15.622 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:15.629 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:29:15.731 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-30T09:29:15.737 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-30T09:29:15.833 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-08-30T09:29:15.838 INFO:teuthology.orchestra.console.smithi178:Power on completed 2023-08-30T09:29:15.934 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-08-30T09:29:15.934 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:29:15.939 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-08-30T09:29:15.940 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:29:31.054 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:29:31.055 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:29:46.158 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:29:46.159 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:30:01.250 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:30:01.251 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:30:16.327 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:30:16.330 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:30:31.405 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:30:31.406 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:30:46.502 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:30:46.503 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:31:01.626 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:31:01.627 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:31:16.742 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:31:16.743 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:31:31.856 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:31:31.857 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:31:46.975 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:31:46.976 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:32:02.101 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:32:02.103 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:32:17.214 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:32:17.218 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:32:32.330 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:32:32.332 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-08-30T09:32:32.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:35.482 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:32:41.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:44.538 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:32:47.429 DEBUG:teuthology.provision.fog.smithi178:FOG request: GET /task/active None 2023-08-30T09:32:47.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:50.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:50.586 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:32:53.598 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:32:56.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:59.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:32:59.642 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:02.682 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:33:05.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:08.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:08.698 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:11.738 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:33:14.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:17.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:17.754 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:20.794 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:33:23.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:26.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:26.814 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:29.850 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:33:32.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:35.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:35.898 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:38.906 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:33:41.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:44.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:44.954 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:33:50.958 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:33:54.014 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:34:00.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:03.418 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:09.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:12.474 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:18.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:19.337 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:25.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:25.344 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:31.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:31.354 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:31.578 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:34:37.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:37.358 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:37.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:37.582 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:34:43.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:43.367 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-30T09:34:43.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:43.586 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:34:49.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:49.572 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T09:34:49.573 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T09:34:49.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:49.589 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:34:50.091 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-08-30T09:34:50.091 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-08-30T09:34:50.096 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-08-30T09:34:50.097 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-08-30T09:34:50.143 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-08-30T09:34:50.144 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-30T09:34:50.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-08-30T09:34:50.291 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-08-30T09:34:50.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-08-30T09:34:50.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-08-30T09:34:50.459 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-30T09:34:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T09:34:50.512 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-30T09:34:50.513 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T09:34:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T09:34:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T09:34:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T09:34:50.514 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-08-30T09:34:50.515 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-08-30T09:34:50.516 DEBUG:teuthology.parallel:result is None 2023-08-30T09:34:55.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:34:55.597 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-30T09:35:01.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:35:01.819 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T09:35:01.823 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T09:35:02.356 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-08-30T09:35:02.357 DEBUG:teuthology.orchestra.run.smithi178:> hostname 2023-08-30T09:35:02.404 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-08-30T09:35:02.405 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts 2023-08-30T09:35:02.456 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-08-30T09:35:02.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-30T09:35:02.599 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts 2023-08-30T09:35:02.613 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts 2023-08-30T09:35:02.668 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname 2023-08-30T09:35:02.730 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178 2023-08-30T09:35:02.787 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-30T09:35:02.836 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T09:35:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-08-30T09:35:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2023-08-30T09:35:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T09:35:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2023-08-30T09:35:02.837 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-08-30T09:35:02.838 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-08-30T09:35:02.838 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T09:35:02.838 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T09:35:02.838 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T09:35:02.839 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T09:35:02.839 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2023-08-30T09:35:02.839 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-08-30T09:35:02.839 DEBUG:teuthology.parallel:result is None 2023-08-30T09:35:03.046 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-08-30T09:35:03.047 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T09:35:03.067 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-08-30T09:35:03.067 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T09:35:03.084 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-08-30T09:35:03.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-30T09:35:03.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:35:03.162 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-30T09:35:03.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-30T09:35:03.402 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-08-30T09:35:03.451 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-08-30T09:35:03.451 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-30T09:35:03.499 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T09:35:03.500 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-30T09:35:03.500 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="22.04" 2023-08-30T09:35:03.500 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T09:35:03.500 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=jammy 2023-08-30T09:35:03.501 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-30T09:35:03.501 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-30T09:35:03.501 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T09:35:03.501 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T09:35:03.502 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T09:35:03.502 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T09:35:03.502 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=jammy 2023-08-30T09:35:03.503 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-30T09:35:03.525 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-08-30T09:35:03.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-30T09:35:03.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T09:35:03.606 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-30T09:35:03.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-30T09:35:03.694 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-08-30T09:35:03.740 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-08-30T09:35:03.740 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-30T09:35:03.788 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-30T09:35:03.788 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-08-30T09:35:03.789 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2023-08-30T09:35:03.789 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-30T09:35:03.789 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2023-08-30T09:35:03.789 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-08-30T09:35:03.789 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-08-30T09:35:03.790 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-30T09:35:03.790 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-30T09:35:03.790 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-30T09:35:03.790 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-30T09:35:03.790 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2023-08-30T09:35:03.791 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-30T09:35:03.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:35:03.898 INFO:teuthology.dispatcher.supervisor:Running job 7382648 2023-08-30T09:35:03.898 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_mkogan@teuthology --archive /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382648 --name mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi --description rgw/verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382648/orig.config.yaml 2023-08-30T09:35:03.901 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382648 2023-08-30T09:35:03.902 INFO:teuthology.dispatcher.supervisor:Job PID: 79241 2023-08-30T09:35:03.902 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T09:37:03.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T09:37:04.046 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T09:37:04.139 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T09:37:04.140 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T09:37:04.174 DEBUG:teuthology.nuke:shortname: smithi153 2023-08-30T09:37:04.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T09:37:04.196 DEBUG:teuthology.nuke:shortname: smithi178 2023-08-30T09:37:04.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T09:37:04.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 09:28:57.518210', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPmmSfj3gFVNLxLETSVdmlx9kjmbAGkPQ59fMGpQbkUG'} 2023-08-30T09:37:04.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mkogan-2023-08-29_15:26:33-rgw-rgw-wip-t62141-valg-supp_i004-distro-default-smithi/7382648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 09:28:57.520117', 'locked_by': 'scheduled_mkogan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEGV//tWDEto1BMcf3BIhbfS7Vgg4obuRTDBJKyzwkn0'} 2023-08-30T09:37:04.240 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-30T09:37:04.241 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:37:04.261 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-30T09:37:04.262 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:37:04.274 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-30T09:37:04.275 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T09:37:04.283 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-30T09:37:04.294 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-30T09:37:04.295 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T09:37:04.316 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-30T09:37:04.384 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-30T09:37:04.417 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-30T09:37:04.530 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2023-08-30T09:37:04.561 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com