2024-04-01T10:54:32.087 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-01T10:54:32.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T10:54:32.259 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f97d562fc10>, signals=[15]) 2024-04-01T10:54:32.259 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2024-04-01T10:54:32.260 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T10:54:32.260 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-04-01T10:54:32.287 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2024-04-01T10:54:32.287 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T10:54:32.287 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-01T10:54:32.311 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2024-04-01T10:54:32.311 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2024-04-01T10:54:32.311 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-01T10:54:32.408 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T10:54:32.428 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T10:54:32.434 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-01T10:54:32.450 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of ubuntu 22.04 2024-04-01T10:54:32.468 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of ubuntu 22.04 2024-04-01T10:54:32.471 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of ubuntu 22.04 2024-04-01T10:54:32.729 INFO:teuthology.orchestra.console.smithi132:Power off 2024-04-01T10:54:32.729 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T10:54:32.745 INFO:teuthology.orchestra.console.smithi107:Power off 2024-04-01T10:54:32.745 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T10:54:32.756 INFO:teuthology.orchestra.console.smithi049:Power off 2024-04-01T10:54:32.757 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-01T10:54:32.766 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-04-01T10:54:32.766 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:32.774 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2024-04-01T10:54:32.775 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:32.783 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2024-04-01T10:54:32.783 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:32.791 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-01T10:54:32.794 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-01T10:54:32.804 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-01T10:54:32.892 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-04-01T10:54:32.895 INFO:teuthology.orchestra.console.smithi107:Power off completed 2024-04-01T10:54:32.905 INFO:teuthology.orchestra.console.smithi049:Power off completed 2024-04-01T10:54:32.993 INFO:teuthology.orchestra.console.smithi132:Power on 2024-04-01T10:54:32.994 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T10:54:33.002 INFO:teuthology.orchestra.console.smithi107:Power on 2024-04-01T10:54:33.002 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T10:54:33.010 INFO:teuthology.orchestra.console.smithi049:Power on 2024-04-01T10:54:33.010 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-01T10:54:33.019 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On 2024-04-01T10:54:33.020 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:33.029 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2024-04-01T10:54:33.029 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:33.037 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2024-04-01T10:54:33.038 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:33.049 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-01T10:54:33.051 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2024-04-01T10:54:33.062 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-01T10:54:37.053 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:37.061 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:37.068 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:37.163 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-01T10:54:37.170 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2024-04-01T10:54:37.175 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2024-04-01T10:54:37.271 INFO:teuthology.orchestra.console.smithi107:Power on completed 2024-04-01T10:54:37.371 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2024-04-01T10:54:41.168 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:41.176 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-01T10:54:41.277 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-01T10:54:41.284 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2024-04-01T10:54:41.378 INFO:teuthology.orchestra.console.smithi132:Power on completed 2024-04-01T10:54:41.385 INFO:teuthology.orchestra.console.smithi049:Power on completed 2024-04-01T10:54:41.479 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2024-04-01T10:54:41.486 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2024-04-01T10:57:53.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:57:56.798 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:57:57.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:00.766 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:02.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:05.854 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:06.768 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:09.822 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:11.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:14.910 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:15.824 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:18.878 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:20.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:23.970 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:24.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:27.938 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:29.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:33.054 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:33.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:36.994 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:39.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:42.110 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:42.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:42.996 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:45.982 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:58:46.050 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:58:48.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:51.166 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-04-01T10:58:51.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:52.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:58:55.038 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:58:57.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:01.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:04.094 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:10.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:13.154 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:19.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:22.238 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:23.550 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:59:28.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:29.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:29.556 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:59:31.294 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:35.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:35.561 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:59:37.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:40.354 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:41.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:41.565 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132 2024-04-01T10:59:46.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:47.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:47.832 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T10:59:47.833 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T10:59:48.378 INFO:teuthology.provision.fog.smithi132:Node is ready 2024-04-01T10:59:48.378 DEBUG:teuthology.orchestra.run.smithi132:> hostname 2024-04-01T10:59:48.429 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2024-04-01T10:59:48.429 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2024-04-01T10:59:48.476 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2024-04-01T10:59:48.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-01T10:59:48.625 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2024-04-01T10:59:48.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2024-04-01T10:59:48.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2024-04-01T10:59:48.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2024-04-01T10:59:48.808 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2024-04-01T10:59:48.856 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T10:59:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T10:59:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T10:59:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T10:59:48.857 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2024-04-01T10:59:48.858 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2024-04-01T10:59:48.860 DEBUG:teuthology.parallel:result is None 2024-04-01T10:59:49.442 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T10:59:55.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T10:59:57.174 WARNING:teuthology.provision.fog.smithi107:timed out 2024-04-01T10:59:58.526 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T11:00:03.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:00:03.489 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T11:00:03.489 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T11:00:03.914 INFO:teuthology.provision.fog.smithi107:Node is ready 2024-04-01T11:00:03.914 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2024-04-01T11:00:03.960 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2024-04-01T11:00:03.960 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2024-04-01T11:00:04.008 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2024-04-01T11:00:04.009 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-04-01T11:00:04.126 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2024-04-01T11:00:04.139 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2024-04-01T11:00:04.197 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2024-04-01T11:00:04.252 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2024-04-01T11:00:04.312 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-01T11:00:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T11:00:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-04-01T11:00:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-04-01T11:00:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T11:00:04.360 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T11:00:04.361 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-04-01T11:00:04.361 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2024-04-01T11:00:04.362 DEBUG:teuthology.parallel:result is None 2024-04-01T11:00:04.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:00:07.582 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T11:00:13.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:00:16.673 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T11:00:22.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:22.687 WARNING:teuthology.provision.fog.smithi049:timed out 2024-04-01T11:01:28.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:31.778 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T11:01:37.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:37.783 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2024-04-01T11:01:43.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:43.986 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-01T11:01:43.986 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-01T11:01:44.411 INFO:teuthology.provision.fog.smithi049:Node is ready 2024-04-01T11:01:44.411 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2024-04-01T11:01:44.457 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2024-04-01T11:01:44.457 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2024-04-01T11:01:44.506 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2024-04-01T11:01:44.506 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-04-01T11:01:44.646 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2024-04-01T11:01:44.661 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2024-04-01T11:01:44.721 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2024-04-01T11:01:44.782 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2024-04-01T11:01:44.837 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-04-01T11:01:44.890 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-04-01T11:01:44.891 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T11:01:44.891 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T11:01:44.891 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T11:01:44.891 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T11:01:44.891 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2024-04-01T11:01:44.891 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2024-04-01T11:01:44.891 DEBUG:teuthology.parallel:result is None 2024-04-01T11:01:45.126 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2024-04-01T11:01:45.127 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T11:01:45.151 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2024-04-01T11:01:45.151 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T11:01:45.167 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2024-04-01T11:01:45.167 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-01T11:01:45.185 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2024-04-01T11:01:45.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-01T11:01:45.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:45.266 DEBUG:teuthology.orchestra.run.smithi049:> true 2024-04-01T11:01:45.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2024-04-01T11:01:45.374 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2024-04-01T11:01:45.420 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2024-04-01T11:01:45.421 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="Ubuntu" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="22.04" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_CODENAME=jammy 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:ID=ubuntu 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE=debian 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T11:01:45.469 INFO:teuthology.orchestra.run.smithi049.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T11:01:45.470 INFO:teuthology.orchestra.run.smithi049.stdout:UBUNTU_CODENAME=jammy 2024-04-01T11:01:45.470 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2024-04-01T11:01:45.492 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2024-04-01T11:01:45.492 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-01T11:01:45.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:45.571 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-04-01T11:01:45.782 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-04-01T11:01:45.782 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-04-01T11:01:45.826 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-04-01T11:01:45.827 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-04-01T11:01:45.870 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T11:01:45.870 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Ubuntu" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="22.04" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_CODENAME=jammy 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:ID=ubuntu 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE=debian 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T11:01:45.871 INFO:teuthology.orchestra.run.smithi107.stdout:UBUNTU_CODENAME=jammy 2024-04-01T11:01:45.871 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-04-01T11:01:45.893 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2024-04-01T11:01:45.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-01T11:01:45.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-01T11:01:45.973 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-01T11:01:46.198 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-01T11:01:46.198 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-01T11:01:46.245 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-01T11:01:46.245 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-01T11:01:46.289 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-01T11:01:46.290 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2024-04-01T11:01:46.291 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-01T11:01:46.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:01:46.403 INFO:teuthology.dispatcher.supervisor:Running job 7626124 2024-04-01T11:01:46.403 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_pdiazbou@teuthology --archive /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626124 --name pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626124/orig.config.yaml 2024-04-01T11:01:46.406 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626124 2024-04-01T11:01:46.406 INFO:teuthology.dispatcher.supervisor:Job PID: 2126077 2024-04-01T11:01:46.407 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-01T11:03:46.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:05:46.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:07:46.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:09:47.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:11:47.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:13:47.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:15:47.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:17:47.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:19:47.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:21:48.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:23:48.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:25:48.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-01T11:25:48.449 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-04-01T11:25:48.590 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi049 but it was locked by another job: /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626176 2024-04-01T11:25:48.590 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626175 2024-04-01T11:25:48.590 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi132 but it was locked by another job: /home/teuthworker/archive/pdiazbou-2024-03-27_11:08:38-rados-wip-pereman2-blob_use_tracker_t-power-of-two-distro-default-smithi/7626175