2024-04-08T13:36:15.543 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-08T13:36:15.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:36:15.691 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd9bc9a1c10>, signals=[15]) 2024-04-08T13:36:15.692 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2024-04-08T13:36:15.692 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T13:36:15.692 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-08T13:36:15.718 INFO:teuthology.lock.ops:Start node 'smithi148.front.sepia.ceph.com' reimaging 2024-04-08T13:36:15.718 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: reset os type and version on server 2024-04-08T13:36:15.719 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-04-08T13:36:15.835 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-08T13:36:15.848 DEBUG:teuthology.provision.fog.smithi148:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-04-08T13:36:15.897 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of ubuntu 22.04 2024-04-08T13:36:15.901 INFO:teuthology.provision.fog.smithi148:Scheduling deploy of ubuntu 22.04 2024-04-08T13:36:16.104 INFO:teuthology.orchestra.console.smithi148:Power off 2024-04-08T13:36:16.104 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T13:36:16.121 INFO:teuthology.orchestra.console.smithi087:Power off 2024-04-08T13:36:16.122 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-08T13:36:16.130 DEBUG:teuthology.orchestra.console.smithi148:power off output: Chassis Power Control: Down/Off 2024-04-08T13:36:16.130 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:16.142 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2024-04-08T13:36:16.142 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:16.151 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-04-08T13:36:16.163 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-08T13:36:16.252 INFO:teuthology.orchestra.console.smithi148:Power off completed 2024-04-08T13:36:16.353 INFO:teuthology.orchestra.console.smithi148:Power on 2024-04-08T13:36:16.353 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T13:36:16.375 DEBUG:teuthology.orchestra.console.smithi148:power on output: Chassis Power Control: Up/On 2024-04-08T13:36:16.376 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:16.398 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-04-08T13:36:20.168 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:20.277 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-08T13:36:20.399 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:20.508 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is off 2024-04-08T13:36:24.278 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:24.387 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-08T13:36:24.488 INFO:teuthology.orchestra.console.smithi087:Power off completed 2024-04-08T13:36:24.509 DEBUG:teuthology.orchestra.console.smithi148:pexpect command: ipmitool -H smithi148.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:24.589 INFO:teuthology.orchestra.console.smithi087:Power on 2024-04-08T13:36:24.590 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-08T13:36:24.611 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2024-04-08T13:36:24.612 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:24.620 DEBUG:teuthology.orchestra.console.smithi148:check power output: Chassis Power is on 2024-04-08T13:36:24.637 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-08T13:36:24.721 INFO:teuthology.orchestra.console.smithi148:Power on completed 2024-04-08T13:36:24.821 INFO:teuthology.provision.fog.smithi148:Waiting for deploy to finish 2024-04-08T13:36:28.638 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:28.747 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2024-04-08T13:36:32.751 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-08T13:36:32.861 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2024-04-08T13:36:32.962 INFO:teuthology.orchestra.console.smithi087:Power on completed 2024-04-08T13:36:33.063 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2024-04-08T13:39:40.773 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:39:43.838 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:39:49.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:39:49.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:39:52.098 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:39:52.898 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:39:58.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:39:58.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:01.182 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:40:01.982 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:07.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:07.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:10.238 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:40:11.038 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:16.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:17.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:19.294 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:40:20.094 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:25.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:26.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:28.350 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:40:29.150 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:34.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:35.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:37.410 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:40:38.210 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:43.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:44.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:40:47.269 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:40:53.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:01.854 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:07.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:10.946 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:16.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:16.953 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:22.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:22.962 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:24.895 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:41:28.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:28.972 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:30.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:30.900 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:41:34.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:34.976 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:36.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:36.905 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:41:40.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:40.984 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2024-04-08T13:41:42.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:42.910 WARNING:teuthology.provision.fog.smithi148:[Errno None] Unable to connect to port 22 on 172.21.15.148 2024-04-08T13:41:46.987 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:47.269 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T13:41:47.269 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T13:41:47.702 INFO:teuthology.provision.fog.smithi087:Node is ready 2024-04-08T13:41:47.702 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2024-04-08T13:41:47.751 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2024-04-08T13:41:47.751 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2024-04-08T13:41:47.803 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2024-04-08T13:41:47.804 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-04-08T13:41:47.947 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2024-04-08T13:41:47.961 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2024-04-08T13:41:48.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2024-04-08T13:41:48.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2024-04-08T13:41:48.126 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-08T13:41:48.179 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-08T13:41:48.179 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-04-08T13:41:48.179 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-04-08T13:41:48.179 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-08T13:41:48.179 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-08T13:41:48.180 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-04-08T13:41:48.181 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2024-04-08T13:41:48.182 DEBUG:teuthology.parallel:result is None 2024-04-08T13:41:48.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:49.096 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-08T13:41:49.097 DEBUG:teuthology.orchestra.run.smithi148:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-08T13:41:49.566 INFO:teuthology.provision.fog.smithi148:Node is ready 2024-04-08T13:41:49.566 DEBUG:teuthology.orchestra.run.smithi148:> hostname 2024-04-08T13:41:49.613 INFO:teuthology.orchestra.run.smithi148.stdout:smithi148.front.sepia.ceph.com 2024-04-08T13:41:49.613 DEBUG:teuthology.orchestra.run.smithi148:> grep smithi148.front.sepia.ceph.com /etc/hosts 2024-04-08T13:41:49.661 INFO:teuthology.orchestra.run.smithi148.stdout:172.21.15.148 smithi148.front.sepia.ceph.com smithi148 2024-04-08T13:41:49.661 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-04-08T13:41:49.791 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hosts 2024-04-08T13:41:49.804 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/172.21.15.148/172.21.15.148/g' /etc/hosts 2024-04-08T13:41:49.860 DEBUG:teuthology.orchestra.run.smithi148:> sudo sed -i -e 's/smithi148.front.sepia.ceph.com/smithi148/g' /etc/hostname 2024-04-08T13:41:49.920 DEBUG:teuthology.orchestra.run.smithi148:> sudo hostname smithi148 2024-04-08T13:41:49.980 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-04-08T13:41:50.025 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-08T13:41:50.025 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-08T13:41:50.026 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-04-08T13:41:50.026 INFO:teuthology.provision.fog.smithi148:Deploy complete! 2024-04-08T13:41:50.027 DEBUG:teuthology.parallel:result is None 2024-04-08T13:41:50.210 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2024-04-08T13:41:50.210 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T13:41:50.286 INFO:teuthology.lock.ops:Checking smithi148.front.sepia.ceph.com 2024-04-08T13:41:50.287 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-08T13:41:50.371 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2024-04-08T13:41:50.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-08T13:41:50.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:50.449 DEBUG:teuthology.orchestra.run.smithi087:> true 2024-04-08T13:41:50.578 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2024-04-08T13:41:50.579 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2024-04-08T13:41:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2024-04-08T13:41:50.627 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2024-04-08T13:41:50.679 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-08T13:41:50.679 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="22.04" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=jammy 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-08T13:41:50.680 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=jammy 2024-04-08T13:41:50.680 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2024-04-08T13:41:50.703 INFO:teuthology.lock.ops:Updating [smithi148.front.sepia.ceph.com]: set os type and version on server 2024-04-08T13:41:50.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-08T13:41:50.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-08T13:41:50.783 DEBUG:teuthology.orchestra.run.smithi148:> true 2024-04-08T13:41:50.882 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi148.front.sepia.ceph.com' 2024-04-08T13:41:50.883 DEBUG:teuthology.orchestra.run.smithi148:> uname -m 2024-04-08T13:41:50.929 INFO:teuthology.orchestra.run.smithi148.stdout:x86_64 2024-04-08T13:41:50.929 DEBUG:teuthology.orchestra.run.smithi148:> cat /etc/os-release 2024-04-08T13:41:50.980 INFO:teuthology.orchestra.run.smithi148.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:NAME="Ubuntu" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_ID="22.04" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:VERSION_CODENAME=jammy 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:ID=ubuntu 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:ID_LIKE=debian 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-08T13:41:50.981 INFO:teuthology.orchestra.run.smithi148.stdout:UBUNTU_CODENAME=jammy 2024-04-08T13:41:50.982 INFO:teuthology.lock.ops:Updating smithi148.front.sepia.ceph.com on lock server 2024-04-08T13:41:51.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:41:51.104 INFO:teuthology.dispatcher.supervisor:Running job 7645821 2024-04-08T13:41:51.104 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-08_13:18:29-fs:multifs-rishabh-mds-health-testing-default-smithi/7645821 --name rishabh-2024-04-08_13:18:29-fs:multifs-rishabh-mds-health-testing-default-smithi --description fs:multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health} tasks/failover} -- /home/teuthworker/archive/rishabh-2024-04-08_13:18:29-fs:multifs-rishabh-mds-health-testing-default-smithi/7645821/orig.config.yaml 2024-04-08T13:41:51.107 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-08_13:18:29-fs:multifs-rishabh-mds-health-testing-default-smithi/7645821 2024-04-08T13:41:51.108 INFO:teuthology.dispatcher.supervisor:Job PID: 657366 2024-04-08T13:41:51.108 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-08T13:43:51.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:45:51.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:47:51.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:49:51.751 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:51:51.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:53:52.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:55:52.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:57:52.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T13:59:52.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:01:52.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:03:52.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:05:53.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:07:53.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:09:53.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:11:53.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:13:53.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:15:53.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:17:54.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:19:54.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:21:54.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:23:54.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:25:54.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:27:54.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:29:55.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:31:55.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:33:55.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:35:55.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:37:55.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:39:55.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:41:56.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:43:56.298 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:45:56.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:47:56.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:49:56.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:51:56.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-08T14:51:56.988 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1