2024-01-31T23:37:09.497 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-01-31T23:37:09.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:37:09.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe2e8db4c10>, signals=[15]) 2024-01-31T23:37:09.677 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2024-01-31T23:37:09.678 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T23:37:09.678 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-01-31T23:37:09.696 INFO:teuthology.lock.ops:Start node 'smithi046.front.sepia.ceph.com' reimaging 2024-01-31T23:37:09.696 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T23:37:09.696 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-01-31T23:37:09.720 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2024-01-31T23:37:09.720 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2024-01-31T23:37:09.720 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-31T23:37:09.816 DEBUG:teuthology.provision.fog.smithi032:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-31T23:37:09.825 DEBUG:teuthology.provision.fog.smithi046:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-31T23:37:09.855 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of ubuntu 22.04 2024-01-31T23:37:09.872 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_ubuntu_22.04 (ID 6) 2024-01-31T23:37:09.881 INFO:teuthology.provision.fog.smithi046:Scheduling deploy of ubuntu 22.04 2024-01-31T23:37:09.921 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of ubuntu 22.04 2024-01-31T23:37:10.073 INFO:teuthology.orchestra.console.smithi032:Power off 2024-01-31T23:37:10.074 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T23:37:10.103 DEBUG:teuthology.orchestra.console.smithi032:power off output: Chassis Power Control: Down/Off 2024-01-31T23:37:10.104 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:10.118 INFO:teuthology.orchestra.console.smithi046:Power off 2024-01-31T23:37:10.118 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T23:37:10.131 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-01-31T23:37:10.141 DEBUG:teuthology.orchestra.console.smithi046:power off output: Chassis Power Control: Down/Off 2024-01-31T23:37:10.141 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:10.159 INFO:teuthology.orchestra.console.smithi084:Power off 2024-01-31T23:37:10.159 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-31T23:37:10.167 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-31T23:37:10.180 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off 2024-01-31T23:37:10.180 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:10.202 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-31T23:37:14.136 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:14.168 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:14.204 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:14.245 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-01-31T23:37:14.278 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-31T23:37:14.313 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-31T23:37:18.248 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.279 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.314 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.358 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-01-31T23:37:18.388 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-31T23:37:18.424 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-31T23:37:18.460 INFO:teuthology.orchestra.console.smithi032:Power off completed 2024-01-31T23:37:18.489 INFO:teuthology.orchestra.console.smithi046:Power off completed 2024-01-31T23:37:18.525 INFO:teuthology.orchestra.console.smithi084:Power off completed 2024-01-31T23:37:18.560 INFO:teuthology.orchestra.console.smithi032:Power on 2024-01-31T23:37:18.561 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T23:37:18.586 DEBUG:teuthology.orchestra.console.smithi032:power on output: Chassis Power Control: Up/On 2024-01-31T23:37:18.587 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.594 INFO:teuthology.orchestra.console.smithi046:Power on 2024-01-31T23:37:18.594 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T23:37:18.608 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-01-31T23:37:18.617 DEBUG:teuthology.orchestra.console.smithi046:power on output: Chassis Power Control: Up/On 2024-01-31T23:37:18.617 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.626 INFO:teuthology.orchestra.console.smithi084:Power on 2024-01-31T23:37:18.626 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-31T23:37:18.640 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-31T23:37:18.649 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On 2024-01-31T23:37:18.650 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:18.670 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-31T23:37:22.613 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:22.642 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:22.671 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:22.722 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is off 2024-01-31T23:37:22.750 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is off 2024-01-31T23:37:22.785 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off 2024-01-31T23:37:26.724 DEBUG:teuthology.orchestra.console.smithi032:pexpect command: ipmitool -H smithi032.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:26.752 DEBUG:teuthology.orchestra.console.smithi046:pexpect command: ipmitool -H smithi046.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:26.786 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-31T23:37:26.836 DEBUG:teuthology.orchestra.console.smithi032:check power output: Chassis Power is on 2024-01-31T23:37:26.861 DEBUG:teuthology.orchestra.console.smithi046:check power output: Chassis Power is on 2024-01-31T23:37:26.937 INFO:teuthology.orchestra.console.smithi032:Power on completed 2024-01-31T23:37:26.948 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on 2024-01-31T23:37:26.962 INFO:teuthology.orchestra.console.smithi046:Power on completed 2024-01-31T23:37:27.038 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2024-01-31T23:37:27.049 INFO:teuthology.orchestra.console.smithi084:Power on completed 2024-01-31T23:37:27.063 INFO:teuthology.provision.fog.smithi046:Waiting for deploy to finish 2024-01-31T23:37:27.150 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2024-01-31T23:40:28.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:31.164 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-31T23:40:37.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:40.224 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-31T23:40:43.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:43.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:46.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:46.236 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:40:46.236 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:40:49.312 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-31T23:40:52.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:52.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:55.292 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:40:55.292 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:40:55.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:40:58.368 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-31T23:41:01.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:01.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:04.352 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:41:04.352 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:41:04.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:07.420 WARNING:teuthology.provision.fog.smithi032:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-01-31T23:41:10.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:10.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:13.436 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:41:13.436 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:41:19.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:19.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:22.492 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:41:22.524 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:41:28.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:28.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:31.548 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:41:31.580 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84 2024-01-31T23:41:37.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:41:37.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:13.461 WARNING:teuthology.provision.fog.smithi032:timed out 2024-01-31T23:42:19.465 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:19.698 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T23:42:19.699 DEBUG:teuthology.orchestra.run.smithi032:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T23:42:20.193 INFO:teuthology.provision.fog.smithi032:Node is ready 2024-01-31T23:42:20.193 DEBUG:teuthology.orchestra.run.smithi032:> hostname 2024-01-31T23:42:20.238 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2024-01-31T23:42:20.239 DEBUG:teuthology.orchestra.run.smithi032:> grep smithi032.front.sepia.ceph.com /etc/hosts 2024-01-31T23:42:20.291 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2024-01-31T23:42:20.292 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-01-31T23:42:20.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hosts 2024-01-31T23:42:20.428 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/172.21.15.32/172.21.15.32/g' /etc/hosts 2024-01-31T23:42:20.483 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i -e 's/smithi032.front.sepia.ceph.com/smithi032/g' /etc/hostname 2024-01-31T23:42:20.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo hostname smithi032 2024-01-31T23:42:20.594 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-01-31T23:42:20.646 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:42:20.646 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-01-31T23:42:20.646 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-01-31T23:42:20.646 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:42:20.647 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:42:20.648 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2024-01-31T23:42:20.649 DEBUG:teuthology.parallel:result is None 2024-01-31T23:42:37.572 WARNING:teuthology.provision.fog.smithi046:timed out 2024-01-31T23:42:37.583 WARNING:teuthology.provision.fog.smithi084:timed out 2024-01-31T23:42:43.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:43.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:43.857 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T23:42:43.857 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T23:42:44.306 INFO:teuthology.provision.fog.smithi084:Node is ready 2024-01-31T23:42:44.306 DEBUG:teuthology.orchestra.run.smithi084:> hostname 2024-01-31T23:42:44.352 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2024-01-31T23:42:44.352 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi084.front.sepia.ceph.com /etc/hosts 2024-01-31T23:42:44.401 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2024-01-31T23:42:44.401 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-31T23:42:44.515 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hosts 2024-01-31T23:42:44.529 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.84/172.21.15.84/g' /etc/hosts 2024-01-31T23:42:44.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi084.front.sepia.ceph.com/smithi084/g' /etc/hostname 2024-01-31T23:42:44.645 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084 2024-01-31T23:42:44.704 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-01-31T23:42:44.752 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:42:44.753 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:42:44.753 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:42:44.753 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:42:44.753 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:42:44.753 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2024-01-31T23:42:44.754 DEBUG:teuthology.parallel:result is None 2024-01-31T23:42:46.652 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:42:52.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:52.661 WARNING:teuthology.provision.fog.smithi046:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-01-31T23:42:58.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:42:58.866 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-31T23:42:58.867 DEBUG:teuthology.orchestra.run.smithi046:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-31T23:42:59.447 INFO:teuthology.provision.fog.smithi046:Node is ready 2024-01-31T23:42:59.448 DEBUG:teuthology.orchestra.run.smithi046:> hostname 2024-01-31T23:42:59.494 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046.front.sepia.ceph.com 2024-01-31T23:42:59.495 DEBUG:teuthology.orchestra.run.smithi046:> grep smithi046.front.sepia.ceph.com /etc/hosts 2024-01-31T23:42:59.543 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46 smithi046.front.sepia.ceph.com smithi046 2024-01-31T23:42:59.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-01-31T23:42:59.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hosts 2024-01-31T23:42:59.700 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/172.21.15.46/172.21.15.46/g' /etc/hosts 2024-01-31T23:42:59.760 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i -e 's/smithi046.front.sepia.ceph.com/smithi046/g' /etc/hostname 2024-01-31T23:42:59.815 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname smithi046 2024-01-31T23:42:59.870 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:42:59.919 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:42:59.920 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:42:59.920 INFO:teuthology.provision.fog.smithi046:Deploy complete! 2024-01-31T23:42:59.920 DEBUG:teuthology.parallel:result is None 2024-01-31T23:43:00.160 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2024-01-31T23:43:00.161 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T23:43:00.184 INFO:teuthology.lock.ops:Checking smithi046.front.sepia.ceph.com 2024-01-31T23:43:00.184 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T23:43:00.200 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2024-01-31T23:43:00.200 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-31T23:43:00.218 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2024-01-31T23:43:00.218 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-31T23:43:00.219 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:43:00.302 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-01-31T23:43:00.536 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-01-31T23:43:00.536 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-01-31T23:43:00.581 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-01-31T23:43:00.582 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-01-31T23:43:00.630 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:43:00.631 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:43:00.631 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-01-31T23:43:00.650 INFO:teuthology.lock.ops:Updating [smithi046.front.sepia.ceph.com]: set os type and version on server 2024-01-31T23:43:00.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-31T23:43:00.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:43:00.733 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-01-31T23:43:00.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-01-31T23:43:00.836 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-01-31T23:43:00.886 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-01-31T23:43:00.886 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-01-31T23:43:00.938 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:43:00.938 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="Ubuntu" 2024-01-31T23:43:00.938 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="22.04" 2024-01-31T23:43:00.938 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:43:00.938 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_CODENAME=jammy 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:ID=ubuntu 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE=debian 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:43:00.939 INFO:teuthology.orchestra.run.smithi046.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:43:00.940 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-01-31T23:43:02.676 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2024-01-31T23:43:02.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-31T23:43:02.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-31T23:43:02.759 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-01-31T23:43:02.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-01-31T23:43:02.976 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-01-31T23:43:03.023 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-01-31T23:43:03.024 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-01-31T23:43:03.071 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Ubuntu" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="22.04" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_CODENAME=jammy 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:ID=ubuntu 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE=debian 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.ubuntu.com/" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-01-31T23:43:03.072 INFO:teuthology.orchestra.run.smithi084.stdout:UBUNTU_CODENAME=jammy 2024-01-31T23:43:03.073 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-01-31T23:43:03.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:43:03.186 INFO:teuthology.dispatcher.supervisor:Running job 7540802 2024-01-31T23:43:03.187 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-01-31_19:19:23-rados-wip-yuri7-testing-2024-01-29-1434-distro-default-smithi/7540802 --name yuriw-2024-01-31_19:19:23-rados-wip-yuri7-testing-2024-01-29-1434-distro-default-smithi --description rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} -- /home/teuthworker/archive/yuriw-2024-01-31_19:19:23-rados-wip-yuri7-testing-2024-01-29-1434-distro-default-smithi/7540802/orig.config.yaml 2024-01-31T23:43:03.190 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-01-31_19:19:23-rados-wip-yuri7-testing-2024-01-29-1434-distro-default-smithi/7540802 2024-01-31T23:43:03.191 INFO:teuthology.dispatcher.supervisor:Job PID: 1799604 2024-01-31T23:43:03.191 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-31T23:45:03.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:47:03.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:49:03.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:51:03.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:53:03.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:55:04.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:57:04.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-31T23:57:04.360 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-31T23:57:04.471 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-01-31_19:19:23-rados-wip-yuri7-testing-2024-01-29-1434-distro-default-smithi/7540838 2024-01-31T23:57:04.471 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi046 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-01-31_19:20:14-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7540841 2024-01-31T23:57:04.471 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi084 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-01-31_19:20:14-rados-wip-yuri3-testing-2024-01-29-1434-distro-default-smithi/7540841