2023-11-03T04:58:06.655 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T04:58:06.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T04:58:06.800 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca30721d30>, signals=[15]) 2023-11-03T04:58:06.802 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-11-03T04:58:06.802 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T04:58:06.802 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-11-03T04:58:06.838 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging 2023-11-03T04:58:06.838 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T04:58:06.839 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-03T04:58:06.840 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-11-03T04:58:06.863 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /host {"name": "smithi081"} 2023-11-03T04:58:06.915 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-03T04:58:06.940 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-03T04:58:06.960 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-03T04:58:06.961 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 6} 2023-11-03T04:58:06.980 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-03T04:58:06.981 DEBUG:teuthology.provision.fog.smithi081:FOG request: PUT /host/186 {"imageID": 6} 2023-11-03T04:58:07.008 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of ubuntu 22.04 2023-11-03T04:58:07.008 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:58:07.028 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of ubuntu 22.04 2023-11-03T04:58:07.028 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:58:07.085 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T04:58:07.094 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T04:58:07.120 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-11-03T04:58:07.130 DEBUG:teuthology.provision.fog.smithi081:FOG request: POST /host/186/task {"taskTypeID": 1} 2023-11-03T04:58:07.180 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:58:07.188 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:58:07.281 INFO:teuthology.orchestra.console.smithi062:Power off 2023-11-03T04:58:07.282 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T04:58:07.297 INFO:teuthology.orchestra.console.smithi081:Power off 2023-11-03T04:58:07.297 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T04:58:07.309 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-11-03T04:58:07.310 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:07.321 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-11-03T04:58:07.322 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:07.335 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-11-03T04:58:07.345 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-03T04:58:07.436 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-11-03T04:58:07.446 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-11-03T04:58:07.538 INFO:teuthology.orchestra.console.smithi062:Power on 2023-11-03T04:58:07.538 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T04:58:07.548 INFO:teuthology.orchestra.console.smithi081:Power on 2023-11-03T04:58:07.548 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T04:58:07.559 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-11-03T04:58:07.560 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:07.572 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On 2023-11-03T04:58:07.572 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:07.584 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-11-03T04:58:07.592 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-03T04:58:11.586 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:11.594 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:11.696 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-11-03T04:58:11.705 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-03T04:58:15.698 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:15.706 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T04:58:15.809 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-11-03T04:58:15.816 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2023-11-03T04:58:15.910 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-11-03T04:58:15.918 INFO:teuthology.orchestra.console.smithi081:Power on completed 2023-11-03T04:58:16.012 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-11-03T04:58:16.012 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:58:16.019 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2023-11-03T04:58:16.019 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:58:31.106 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:58:31.107 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:58:46.192 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:58:46.193 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:59:01.290 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:59:01.292 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:59:16.387 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:59:16.800 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:59:31.907 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:59:31.909 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T04:59:47.038 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T04:59:47.040 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:00:02.158 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:00:02.160 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:00:17.285 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:00:17.287 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:00:32.403 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:00:32.405 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:00:47.506 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:00:47.508 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:01:02.633 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:01:02.635 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:01:17.750 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:01:17.799 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:01:32.925 DEBUG:teuthology.provision.fog.smithi081:FOG request: GET /task/active None 2023-11-03T05:01:32.929 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-11-03T05:01:33.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:33.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:36.090 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:01:36.091 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:01:42.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:42.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:45.146 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:01:45.178 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:01:51.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:51.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:01:54.234 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:01:54.235 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:00.239 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:00.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:03.290 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:02:03.291 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:09.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:09.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:12.346 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:02:12.378 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:18.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:18.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:21.406 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:02:21.438 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:27.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:27.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:37.691 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:43.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:45.882 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:02:46.746 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:02:51.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:52.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:02:54.970 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:02:55.802 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:03:00.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:00.976 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:03:01.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:01.807 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:03:06.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:06.982 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:03:07.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:07.812 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:03:12.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:12.989 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:03:13.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:13.816 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:03:18.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:18.998 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:03:19.818 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:19.820 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81 2023-11-03T05:03:25.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:25.008 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-11-03T05:03:25.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:26.083 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T05:03:26.084 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T05:03:26.493 INFO:teuthology.provision.fog.smithi081:Node is ready 2023-11-03T05:03:26.493 DEBUG:teuthology.orchestra.run.smithi081:> hostname 2023-11-03T05:03:26.541 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2023-11-03T05:03:26.542 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts 2023-11-03T05:03:26.594 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2023-11-03T05:03:26.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-11-03T05:03:26.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts 2023-11-03T05:03:26.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts 2023-11-03T05:03:26.766 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname 2023-11-03T05:03:26.825 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081 2023-11-03T05:03:26.880 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-03T05:03:26.930 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T05:03:26.930 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-11-03T05:03:26.930 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2023-11-03T05:03:26.930 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T05:03:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2023-11-03T05:03:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-11-03T05:03:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-11-03T05:03:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T05:03:26.931 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T05:03:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T05:03:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T05:03:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2023-11-03T05:03:26.933 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2023-11-03T05:03:26.934 DEBUG:teuthology.parallel:result is None 2023-11-03T05:03:31.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:31.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T05:03:31.372 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T05:03:31.579 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-11-03T05:03:31.580 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-11-03T05:03:31.626 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2023-11-03T05:03:31.626 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi062.front.sepia.ceph.com /etc/hosts 2023-11-03T05:03:31.675 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2023-11-03T05:03:31.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-11-03T05:03:31.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hosts 2023-11-03T05:03:31.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.62/172.21.15.62/g' /etc/hosts 2023-11-03T05:03:31.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi062.front.sepia.ceph.com/smithi062/g' /etc/hostname 2023-11-03T05:03:31.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-11-03T05:03:32.012 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-11-03T05:03:32.056 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T05:03:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-11-03T05:03:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-11-03T05:03:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T05:03:32.057 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-11-03T05:03:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-11-03T05:03:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-11-03T05:03:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T05:03:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T05:03:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T05:03:32.059 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T05:03:32.059 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-11-03T05:03:32.059 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-11-03T05:03:32.060 DEBUG:teuthology.parallel:result is None 2023-11-03T05:03:32.242 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-11-03T05:03:32.243 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T05:03:32.271 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2023-11-03T05:03:32.271 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T05:03:32.296 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-11-03T05:03:32.296 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-11-03T05:03:32.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:32.370 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-11-03T05:03:32.478 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-11-03T05:03:32.478 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-11-03T05:03:32.525 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-11-03T05:03:32.525 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-11-03T05:03:32.576 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T05:03:32.577 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-11-03T05:03:32.577 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-11-03T05:03:32.577 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T05:03:32.577 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-11-03T05:03:32.578 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-11-03T05:03:32.578 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-11-03T05:03:32.578 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T05:03:32.578 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T05:03:32.578 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T05:03:32.579 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T05:03:32.579 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-11-03T05:03:32.579 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-11-03T05:03:32.603 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2023-11-03T05:03:32.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-03T05:03:32.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T05:03:32.677 DEBUG:teuthology.orchestra.run.smithi081:> true 2023-11-03T05:03:32.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2023-11-03T05:03:32.807 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2023-11-03T05:03:32.853 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2023-11-03T05:03:32.853 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2023-11-03T05:03:32.901 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T05:03:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2023-11-03T05:03:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2023-11-03T05:03:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T05:03:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2023-11-03T05:03:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2023-11-03T05:03:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2023-11-03T05:03:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T05:03:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T05:03:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T05:03:32.903 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T05:03:32.904 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2023-11-03T05:03:32.904 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2023-11-03T05:03:32.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:03:33.011 INFO:teuthology.dispatcher.supervisor:Running job 7444279 2023-11-03T05:03:33.011 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444279 --name leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes prefetch_entire_dirfrags/no races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mds 2-workunit/fs/snaps}} -- /home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444279/orig.config.yaml 2023-11-03T05:03:33.014 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444279 2023-11-03T05:03:33.015 INFO:teuthology.dispatcher.supervisor:Job PID: 583462 2023-11-03T05:03:33.015 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T05:05:33.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:07:33.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:09:33.483 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:11:33.646 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:13:33.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:15:33.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:17:34.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:19:34.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:21:34.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:23:34.656 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:25:34.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:27:35.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:29:35.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:31:35.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:33:35.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:35:35.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:37:35.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T05:37:35.913 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T05:37:36.062 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T05:37:36.062 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T05:37:36.123 DEBUG:teuthology.nuke:shortname: smithi062 2023-11-03T05:37:36.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T05:37:36.130 DEBUG:teuthology.nuke:shortname: smithi081 2023-11-03T05:37:36.130 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T05:37:36.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 04:58:05.824294', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHRfSNs1VsoI97OBhaYa0lXQYuu9b5c/B7uvDe46nJefPU0iVprhiQpckIRE7GqOOlGX9q4iW3WE1DZr2SZhhEg='} 2023-11-03T05:37:36.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-11-02_12:51:57-fs-wip-lusov-balance-after-stop-distro-default-smithi/7444279', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 04:58:05.822977', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLo2LGY/zl4PwtcaCOykSfcAHfka5QwrNes+tQqbEylypsJcg4hIt9iuB9c3BfN+WslHeMqZoOQqKSlAtBSDznY='} 2023-11-03T05:37:36.184 INFO:teuthology.orchestra.console.smithi062:Power off 2023-11-03T05:37:36.185 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T05:37:36.200 INFO:teuthology.orchestra.console.smithi081:Power off 2023-11-03T05:37:36.201 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T05:37:36.209 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-11-03T05:37:36.210 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T05:37:36.221 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2023-11-03T05:37:36.222 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T05:37:36.230 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-11-03T05:37:36.242 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2023-11-03T05:37:36.331 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-11-03T05:37:36.344 INFO:teuthology.orchestra.console.smithi081:Power off completed 2023-11-03T05:37:36.485 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com 2023-11-03T05:37:36.494 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com