2023-08-19T09:56:32.147 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-19T09:56:32.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T09:56:32.310 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe864cac310>, signals=[15]) 2023-08-19T09:56:32.311 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-08-19T09:56:32.312 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-08-19T09:56:32.312 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-08-19T09:56:32.334 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2023-08-19T09:56:32.335 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2023-08-19T09:56:32.335 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-08-19T09:56:32.336 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /host {"name": "smithi039"} 2023-08-19T09:56:32.351 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /host {"name": "smithi086"} 2023-08-19T09:56:32.401 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-19T09:56:32.421 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-08-19T09:56:32.448 DEBUG:teuthology.provision.fog.smithi039:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-19T09:56:32.449 DEBUG:teuthology.provision.fog.smithi039:FOG request: PUT /host/144 {"imageID": 6} 2023-08-19T09:56:32.473 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-08-19T09:56:32.473 DEBUG:teuthology.provision.fog.smithi086:FOG request: PUT /host/191 {"imageID": 6} 2023-08-19T09:56:32.500 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of ubuntu 22.04 2023-08-19T09:56:32.500 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:56:32.522 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of ubuntu 22.04 2023-08-19T09:56:32.522 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:56:32.694 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /tasktype {"name": "deploy"} 2023-08-19T09:56:32.708 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /tasktype {"name": "deploy"} 2023-08-19T09:56:32.743 DEBUG:teuthology.provision.fog.smithi039:FOG request: POST /host/144/task {"taskTypeID": 1} 2023-08-19T09:56:32.758 DEBUG:teuthology.provision.fog.smithi086:FOG request: POST /host/191/task {"taskTypeID": 1} 2023-08-19T09:56:32.816 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:56:33.015 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:56:33.263 INFO:teuthology.orchestra.console.smithi039:Power off 2023-08-19T09:56:33.264 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T09:56:33.286 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-08-19T09:56:33.287 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:33.308 INFO:teuthology.orchestra.console.smithi086:Power off 2023-08-19T09:56:33.309 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T09:56:33.319 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-19T09:56:33.331 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-08-19T09:56:33.332 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:33.353 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-08-19T09:56:37.324 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:37.355 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:37.434 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-19T09:56:37.465 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-08-19T09:56:41.436 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:41.466 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:41.545 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-19T09:56:41.577 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-08-19T09:56:41.647 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-08-19T09:56:41.748 INFO:teuthology.orchestra.console.smithi039:Power on 2023-08-19T09:56:41.748 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-19T09:56:41.770 DEBUG:teuthology.orchestra.console.smithi039:power on output: Chassis Power Control: Up/On 2023-08-19T09:56:41.771 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:41.791 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-19T09:56:45.582 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:45.691 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-08-19T09:56:45.792 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:45.800 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-08-19T09:56:45.901 INFO:teuthology.orchestra.console.smithi086:Power on 2023-08-19T09:56:45.901 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-19T09:56:45.912 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is on 2023-08-19T09:56:45.925 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2023-08-19T09:56:45.925 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:45.947 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-08-19T09:56:46.013 INFO:teuthology.orchestra.console.smithi039:Power on completed 2023-08-19T09:56:46.114 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-08-19T09:56:46.115 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:56:49.952 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T09:56:50.061 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2023-08-19T09:56:50.162 INFO:teuthology.orchestra.console.smithi086:Power on completed 2023-08-19T09:56:50.263 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2023-08-19T09:56:50.264 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:57:01.350 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:57:05.549 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:57:16.603 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:57:20.816 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:57:31.928 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:57:36.074 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:57:47.256 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:57:51.312 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:58:02.596 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:58:06.595 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:58:17.884 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:58:21.868 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:58:33.328 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:58:37.178 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:58:55.101 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:58:55.770 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:59:18.652 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T09:59:19.879 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:59:41.196 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T09:59:41.211 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:00:03.904 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:00:04.720 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:00:22.044 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:00:23.318 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:00:37.556 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:00:40.972 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:00:53.099 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:00:58.556 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:01:08.540 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:01:15.259 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:01:23.949 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:01:32.298 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:01:40.654 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:01:48.680 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:01:57.976 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:02:05.256 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:02:13.976 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:02:21.242 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:02:29.659 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:02:37.104 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:02:45.184 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:02:52.540 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:03:00.532 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:03:07.848 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:03:15.832 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:03:23.064 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:03:31.048 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:03:38.278 DEBUG:teuthology.provision.fog.smithi039:FOG request: GET /task/active None 2023-08-19T10:03:38.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:03:38.546 ERROR:teuthology.orchestra.connection:Error authenticating with smithi039.front.sepia.ceph.com: Authentication failed. 2023-08-19T10:03:38.547 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-19T10:03:38.548 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-19T10:03:38.548 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-19T10:03:46.283 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:04:01.458 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:04:16.620 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:04:31.770 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:04:46.927 DEBUG:teuthology.provision.fog.smithi086:FOG request: GET /task/active None 2023-08-19T10:04:47.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:04:50.128 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:04:56.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:04:59.184 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:05.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:05:08.240 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:14.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:05:17.296 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:23.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:05:26.352 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:32.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:05:35.408 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:41.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:05:44.464 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:05:50.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:09.012 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:15.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:18.069 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:24.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:24.072 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:30.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:30.075 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:36.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:36.078 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:42.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:42.081 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2023-08-19T10:06:48.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:06:48.271 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-19T10:06:48.271 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-19T10:06:48.706 INFO:teuthology.provision.fog.smithi086:Node is ready 2023-08-19T10:06:48.707 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2023-08-19T10:06:48.761 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2023-08-19T10:06:48.762 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi086.front.sepia.ceph.com /etc/hosts 2023-08-19T10:06:48.814 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2023-08-19T10:06:48.814 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-08-19T10:06:48.936 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hosts 2023-08-19T10:06:48.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/172.21.15.86/172.21.15.86/g' /etc/hosts 2023-08-19T10:06:49.008 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi086.front.sepia.ceph.com/smithi086/g' /etc/hostname 2023-08-19T10:06:49.063 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2023-08-19T10:06:49.123 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-08-19T10:06:49.171 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-19T10:06:49.171 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2023-08-19T10:06:49.171 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2023-08-19T10:06:49.171 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-19T10:06:49.171 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-19T10:06:49.172 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2023-08-19T10:06:49.173 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2023-08-19T10:06:49.174 DEBUG:teuthology.parallel:result is None 2023-08-19T10:07:18.128 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-19T10:07:18.130 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi039 2023-08-19T10:07:27.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-19T10:07:27.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:07:27.353 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-08-19T10:07:27.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-19T10:07:27.828 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-19T10:07:27.829 DEBUG:teuthology.orchestra.run.smithi039:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-19T10:07:27.878 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-08-19T10:07:27.879 DEBUG:teuthology.orchestra.run.smithi039:> hostname 2023-08-19T10:07:27.926 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-08-19T10:07:27.926 DEBUG:teuthology.orchestra.run.smithi039:> grep smithi039.front.sepia.ceph.com /etc/hosts 2023-08-19T10:07:27.977 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-08-19T10:07:27.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-08-19T10:07:28.106 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hosts 2023-08-19T10:07:28.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/172.21.15.39/172.21.15.39/g' /etc/hosts 2023-08-19T10:07:28.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i -e 's/smithi039.front.sepia.ceph.com/smithi039/g' /etc/hostname 2023-08-19T10:07:28.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo hostname smithi039 2023-08-19T10:07:28.292 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-08-19T10:07:28.340 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-19T10:07:28.341 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-08-19T10:07:28.341 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2023-08-19T10:07:28.341 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-19T10:07:28.342 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2023-08-19T10:07:28.342 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-08-19T10:07:28.342 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-08-19T10:07:28.342 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-19T10:07:28.343 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-19T10:07:28.344 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-19T10:07:28.344 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-19T10:07:28.344 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2023-08-19T10:07:28.344 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-08-19T10:07:28.345 DEBUG:teuthology.parallel:result is None 2023-08-19T10:07:28.513 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-08-19T10:07:28.514 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-19T10:07:28.544 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2023-08-19T10:07:28.544 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-19T10:07:28.569 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-08-19T10:07:28.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-19T10:07:28.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:07:28.645 DEBUG:teuthology.orchestra.run.smithi039:> true 2023-08-19T10:07:28.736 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-08-19T10:07:28.736 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2023-08-19T10:07:28.785 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-08-19T10:07:28.785 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2023-08-19T10:07:28.831 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Ubuntu" 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="22.04" 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_CODENAME=jammy 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:ID=ubuntu 2023-08-19T10:07:28.832 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE=debian 2023-08-19T10:07:28.833 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-19T10:07:28.833 INFO:teuthology.orchestra.run.smithi039.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-19T10:07:28.833 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-19T10:07:28.833 INFO:teuthology.orchestra.run.smithi039.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-19T10:07:28.833 INFO:teuthology.orchestra.run.smithi039.stdout:UBUNTU_CODENAME=jammy 2023-08-19T10:07:28.834 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-08-19T10:07:28.855 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2023-08-19T10:07:28.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-08-19T10:07:28.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-19T10:07:28.931 DEBUG:teuthology.orchestra.run.smithi086:> true 2023-08-19T10:07:29.148 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2023-08-19T10:07:29.149 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2023-08-19T10:07:29.194 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2023-08-19T10:07:29.195 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2023-08-19T10:07:29.244 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Ubuntu" 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="22.04" 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_CODENAME=jammy 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:ID=ubuntu 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE=debian 2023-08-19T10:07:29.245 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-19T10:07:29.246 INFO:teuthology.orchestra.run.smithi086.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-19T10:07:29.246 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-19T10:07:29.246 INFO:teuthology.orchestra.run.smithi086.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-19T10:07:29.246 INFO:teuthology.orchestra.run.smithi086.stdout:UBUNTU_CODENAME=jammy 2023-08-19T10:07:29.246 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2023-08-19T10:07:29.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:07:29.379 INFO:teuthology.dispatcher.supervisor:Running job 7373407 2023-08-19T10:07:29.380 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373407 --name leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} -- /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373407/orig.config.yaml 2023-08-19T10:07:29.385 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373407 2023-08-19T10:07:29.386 INFO:teuthology.dispatcher.supervisor:Job PID: 30229 2023-08-19T10:07:29.386 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-19T10:09:29.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:11:29.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:13:29.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:15:30.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:17:30.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:19:30.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:21:30.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:23:31.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:25:31.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:27:31.442 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:29:31.598 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:31:31.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:33:31.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-19T10:33:31.991 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-19T10:33:32.095 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-19T10:33:32.096 INFO:teuthology.nuke:Checking targets against current locks 2023-08-19T10:33:32.142 DEBUG:teuthology.nuke:shortname: smithi039 2023-08-19T10:33:32.142 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-19T10:33:32.154 DEBUG:teuthology.nuke:shortname: smithi086 2023-08-19T10:33:32.154 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-19T10:33:32.163 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-19 09:56:31.339070', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBJHujHOEsq5PcZ8PHD76IV9C18MaVfDS9FpdO57QwYMI5qK/YVLRTtIR2behcatrBXa2IZe+Sw3plX3z7CkL+c='} 2023-08-19T10:33:32.173 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-08-19_09:54:24-fs-wip-lusov-cap-throttle-event-distro-default-smithi/7373407', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-19 09:56:31.337746', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBkdXaO1cpv0TluhGZLcEd4+J04Y/z7Xm2+CWyNJvoWSkzOgRCKIf+gzWQsJW57unCGR0FRfM4uBasemV4GQNdE='} 2023-08-19T10:33:32.208 INFO:teuthology.orchestra.console.smithi039:Power off 2023-08-19T10:33:32.209 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T10:33:32.222 INFO:teuthology.orchestra.console.smithi086:Power off 2023-08-19T10:33:32.223 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-19T10:33:32.233 DEBUG:teuthology.orchestra.console.smithi039:power off output: Chassis Power Control: Down/Off 2023-08-19T10:33:32.234 DEBUG:teuthology.orchestra.console.smithi039:pexpect command: ipmitool -H smithi039.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T10:33:32.245 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2023-08-19T10:33:32.246 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-19T10:33:32.254 DEBUG:teuthology.orchestra.console.smithi039:check power output: Chassis Power is off 2023-08-19T10:33:32.265 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2023-08-19T10:33:32.356 INFO:teuthology.orchestra.console.smithi039:Power off completed 2023-08-19T10:33:32.366 INFO:teuthology.orchestra.console.smithi086:Power off completed 2023-08-19T10:33:32.506 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2023-08-19T10:33:32.515 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com