2024-03-13T22:15:41.623 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T22:15:41.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:15:41.818 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f31f8b8dc10>, signals=[15]) 2024-03-13T22:15:41.819 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2024-03-13T22:15:41.819 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T22:15:41.819 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-03-13T22:15:41.844 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-03-13T22:15:41.844 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T22:15:41.844 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-03-13T22:15:41.868 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2024-03-13T22:15:41.869 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2024-03-13T22:15:41.869 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-03-13T22:15:41.961 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-13T22:15:41.974 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-13T22:15:42.005 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-03-13T22:15:42.013 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of ubuntu 22.04 2024-03-13T22:15:42.021 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of ubuntu 22.04 2024-03-13T22:15:42.062 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of ubuntu 22.04 2024-03-13T22:15:42.361 INFO:teuthology.orchestra.console.smithi042:Power off 2024-03-13T22:15:42.362 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T22:15:42.380 INFO:teuthology.orchestra.console.smithi173:Power off 2024-03-13T22:15:42.380 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T22:15:42.398 INFO:teuthology.orchestra.console.smithi169:Power off 2024-03-13T22:15:42.398 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-13T22:15:42.407 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-03-13T22:15:42.407 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.415 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-03-13T22:15:42.415 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.426 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-03-13T22:15:42.427 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.437 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-03-13T22:15:42.439 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-03-13T22:15:42.453 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-13T22:15:42.539 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-03-13T22:15:42.540 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-03-13T22:15:42.555 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-03-13T22:15:42.640 INFO:teuthology.orchestra.console.smithi173:Power on 2024-03-13T22:15:42.640 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T22:15:42.650 INFO:teuthology.orchestra.console.smithi042:Power on 2024-03-13T22:15:42.650 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T22:15:42.663 INFO:teuthology.orchestra.console.smithi169:Power on 2024-03-13T22:15:42.663 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-13T22:15:42.672 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2024-03-13T22:15:42.672 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.685 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On 2024-03-13T22:15:42.685 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.695 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-03-13T22:15:42.696 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:42.708 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-03-13T22:15:42.712 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-03-13T22:15:42.716 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-13T22:15:46.710 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:46.718 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:46.726 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:46.820 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-03-13T22:15:46.828 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-13T22:15:46.834 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-03-13T22:15:46.929 INFO:teuthology.orchestra.console.smithi173:Power on completed 2024-03-13T22:15:47.030 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2024-03-13T22:15:50.824 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:50.834 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-13T22:15:50.948 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-03-13T22:15:50.985 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-03-13T22:15:51.048 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-03-13T22:15:51.086 INFO:teuthology.orchestra.console.smithi042:Power on completed 2024-03-13T22:15:51.149 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-03-13T22:15:51.187 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2024-03-13T22:18:52.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:18:55.519 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:01.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:03.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:04.606 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:06.526 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:10.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:12.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:13.666 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:15.582 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:19.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:21.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:22.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:22.754 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:24.642 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:25.662 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:19:28.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:30.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:31.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:31.838 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:33.730 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:34.722 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:19:37.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:39.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:40.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:40.894 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:19:42.818 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:43.806 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:19:46.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:48.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:49.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:51.902 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:19:52.866 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:19:57.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:19:58.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:00.962 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:20:01.950 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:20:06.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:07.953 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:11.006 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:20:17.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:20.066 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:20:26.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:38.559 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:20:44.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:44.565 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:20:46.902 WARNING:teuthology.provision.fog.smithi042:timed out 2024-03-13T22:20:50.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:50.571 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:20:52.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:54.834 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-03-13T22:20:56.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:20:56.576 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:20:57.506 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:21:00.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:01.032 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T22:21:01.032 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T22:21:01.515 INFO:teuthology.provision.fog.smithi042:Node is ready 2024-03-13T22:21:01.515 DEBUG:teuthology.orchestra.run.smithi042:> hostname 2024-03-13T22:21:01.564 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2024-03-13T22:21:01.564 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2024-03-13T22:21:01.612 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2024-03-13T22:21:01.612 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-03-13T22:21:01.723 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2024-03-13T22:21:01.738 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2024-03-13T22:21:01.792 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2024-03-13T22:21:01.848 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-03-13T22:21:01.907 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="22.04" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:01.956 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:01.957 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2024-03-13T22:21:01.958 DEBUG:teuthology.parallel:result is None 2024-03-13T22:21:02.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:02.579 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-13T22:21:03.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:03.510 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:21:08.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:08.799 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T22:21:08.799 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T22:21:09.231 INFO:teuthology.provision.fog.smithi173:Node is ready 2024-03-13T22:21:09.231 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2024-03-13T22:21:09.276 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2024-03-13T22:21:09.277 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2024-03-13T22:21:09.324 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2024-03-13T22:21:09.325 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-03-13T22:21:09.463 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2024-03-13T22:21:09.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2024-03-13T22:21:09.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:09.514 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:21:09.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2024-03-13T22:21:09.597 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2024-03-13T22:21:09.659 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-03-13T22:21:09.708 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="22.04" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:09.709 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:09.709 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2024-03-13T22:21:09.710 DEBUG:teuthology.parallel:result is None 2024-03-13T22:21:15.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:15.517 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:21:21.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:21.521 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-03-13T22:21:27.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:27.705 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-13T22:21:27.705 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-13T22:21:28.215 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-03-13T22:21:28.215 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-03-13T22:21:28.263 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-03-13T22:21:28.263 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-03-13T22:21:28.311 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-03-13T22:21:28.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-03-13T22:21:28.439 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-03-13T22:21:28.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-03-13T22:21:28.511 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-03-13T22:21:28.568 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-03-13T22:21:28.622 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:28.671 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:28.672 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:28.672 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:28.672 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:28.672 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-03-13T22:21:28.672 DEBUG:teuthology.parallel:result is None 2024-03-13T22:21:28.913 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2024-03-13T22:21:28.913 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T22:21:28.935 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-03-13T22:21:28.935 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T22:21:28.960 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2024-03-13T22:21:28.960 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-13T22:21:28.986 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2024-03-13T22:21:28.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-13T22:21:28.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:29.067 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-03-13T22:21:29.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-03-13T22:21:29.298 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-03-13T22:21:29.344 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-03-13T22:21:29.344 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-03-13T22:21:29.391 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Ubuntu" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="22.04" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:ID=ubuntu 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE=debian 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:29.392 INFO:teuthology.orchestra.run.smithi042.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:29.393 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-03-13T22:21:29.419 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-03-13T22:21:29.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-03-13T22:21:29.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:29.498 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-03-13T22:21:29.606 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-03-13T22:21:29.606 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-03-13T22:21:29.656 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-03-13T22:21:29.656 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-03-13T22:21:29.702 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:29.703 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:29.704 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-03-13T22:21:29.727 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2024-03-13T22:21:29.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-13T22:21:29.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T22:21:29.807 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-03-13T22:21:29.926 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-13T22:21:29.927 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-03-13T22:21:29.976 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-03-13T22:21:29.976 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-03-13T22:21:30.024 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-13T22:21:30.024 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Ubuntu" 2024-03-13T22:21:30.024 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="22.04" 2024-03-13T22:21:30.024 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-13T22:21:30.024 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_CODENAME=jammy 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:ID=ubuntu 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE=debian 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-13T22:21:30.025 INFO:teuthology.orchestra.run.smithi173.stdout:UBUNTU_CODENAME=jammy 2024-03-13T22:21:30.025 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-03-13T22:21:30.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:21:30.144 INFO:teuthology.dispatcher.supervisor:Running job 7597915 2024-03-13T22:21:30.145 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7597915 --name yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} -- /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7597915/orig.config.yaml 2024-03-13T22:21:30.147 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-13_19:25:03-rados-wip-yuri6-testing-2024-03-12-0858-distro-default-smithi/7597915 2024-03-13T22:21:30.148 INFO:teuthology.dispatcher.supervisor:Job PID: 448453 2024-03-13T22:21:30.148 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-13T22:23:30.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:25:30.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:27:30.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:29:30.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:31:30.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:33:31.111 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:35:31.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:37:31.459 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T22:37:31.528 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1