2024-01-11T17:55:24.501 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-11T17:55:24.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T17:55:24.645 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f579c464f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f579d408c10>, signals=[15])
2024-01-11T17:55:24.646 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-01-11T17:55:24.646 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-01-11T17:55:24.646 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-01-11T17:55:24.662 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2024-01-11T17:55:24.662 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2024-01-11T17:55:24.662 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-01-11T17:55:24.786 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-11T17:55:24.797 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_ubuntu_22.04 (ID 6)
2024-01-11T17:55:24.838 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of ubuntu 22.04
2024-01-11T17:55:24.842 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of ubuntu 22.04
2024-01-11T17:55:25.087 INFO:teuthology.orchestra.console.smithi181:Power off
2024-01-11T17:55:25.088 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-11T17:55:25.103 INFO:teuthology.orchestra.console.smithi150:Power off
2024-01-11T17:55:25.104 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-11T17:55:25.112 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-01-11T17:55:25.113 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:25.123 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-01-11T17:55:25.124 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:25.134 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-11T17:55:25.150 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-11T17:55:29.138 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:29.151 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:29.247 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-11T17:55:29.260 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-11T17:55:33.249 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:33.261 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:33.357 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-11T17:55:33.369 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-11T17:55:33.458 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-01-11T17:55:33.559 INFO:teuthology.orchestra.console.smithi181:Power on
2024-01-11T17:55:33.559 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-11T17:55:33.581 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2024-01-11T17:55:33.581 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:33.604 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-11T17:55:37.372 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:37.481 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-11T17:55:37.581 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-01-11T17:55:37.605 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:37.683 INFO:teuthology.orchestra.console.smithi150:Power on
2024-01-11T17:55:37.683 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-11T17:55:37.705 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-01-11T17:55:37.705 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:37.714 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-11T17:55:37.725 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-11T17:55:41.716 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:41.725 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T17:55:41.826 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-01-11T17:55:41.834 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-01-11T17:55:41.927 INFO:teuthology.orchestra.console.smithi181:Power on completed
2024-01-11T17:55:41.935 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-01-11T17:55:42.028 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2024-01-11T17:55:42.036 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-01-11T17:58:58.082 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:58:58.084 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:16.544 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T17:59:16.545 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-11T17:59:22.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:22.550 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:25.632 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T17:59:25.632 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-11T17:59:31.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:31.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:34.716 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T17:59:34.716 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-11T17:59:40.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:40.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:43.776 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T17:59:43.776 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-01-11T17:59:49.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:49.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T17:59:52.860 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T17:59:58.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:00:01.951 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-01-11T18:00:07.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:00:49.821 WARNING:teuthology.provision.fog.smithi181:timed out
2024-01-11T18:00:55.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:00:56.115 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-11T18:00:56.115 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-11T18:00:56.530 INFO:teuthology.provision.fog.smithi181:Node is ready
2024-01-11T18:00:56.530 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2024-01-11T18:00:56.578 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2024-01-11T18:00:56.579 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2024-01-11T18:00:56.626 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2024-01-11T18:00:56.626 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-01-11T18:00:56.736 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2024-01-11T18:00:56.749 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2024-01-11T18:00:56.809 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2024-01-11T18:00:56.866 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-01-11T18:00:56.920 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04"
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2024-01-11T18:00:56.965 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2024-01-11T18:00:56.966 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-11T18:00:56.966 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-11T18:00:56.966 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-11T18:00:56.966 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-11T18:00:56.966 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy
2024-01-11T18:00:56.967 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2024-01-11T18:00:56.968 DEBUG:teuthology.parallel:result is None
2024-01-11T18:01:07.966 WARNING:teuthology.provision.fog.smithi150:timed out
2024-01-11T18:01:13.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:01:14.176 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-11T18:01:14.176 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-11T18:01:14.611 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-01-11T18:01:14.611 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-01-11T18:01:14.656 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-01-11T18:01:14.656 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-01-11T18:01:14.705 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-01-11T18:01:14.705 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-01-11T18:01:14.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-01-11T18:01:14.861 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-01-11T18:01:14.916 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-01-11T18:01:14.972 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-01-11T18:01:15.032 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-11T18:01:15.081 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2024-01-11T18:01:15.082 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-01-11T18:01:15.082 DEBUG:teuthology.parallel:result is None
2024-01-11T18:01:15.265 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-01-11T18:01:15.265 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-11T18:01:15.290 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2024-01-11T18:01:15.290 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-11T18:01:15.308 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-01-11T18:01:15.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-01-11T18:01:15.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:01:15.389 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-01-11T18:01:15.475 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-01-11T18:01:15.475 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-01-11T18:01:15.524 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-01-11T18:01:15.524 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2024-01-11T18:01:15.576 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2024-01-11T18:01:15.579 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-11T18:01:15.579 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-11T18:01:15.579 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-11T18:01:15.579 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-11T18:01:15.579 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2024-01-11T18:01:15.579 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-01-11T18:01:15.598 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2024-01-11T18:01:15.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-01-11T18:01:15.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-11T18:01:15.679 DEBUG:teuthology.orchestra.run.smithi181:> true
2024-01-11T18:01:15.936 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-01-11T18:01:15.936 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2024-01-11T18:01:15.984 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2024-01-11T18:01:15.984 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-01-11T18:01:16.032 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Ubuntu"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="22.04"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_CODENAME=jammy
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:ID=ubuntu
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE=debian
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.ubuntu.com/"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2024-01-11T18:01:16.033 INFO:teuthology.orchestra.run.smithi181.stdout:UBUNTU_CODENAME=jammy
2024-01-11T18:01:16.033 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-01-11T18:01:16.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:01:16.147 INFO:teuthology.dispatcher.supervisor:Running job 7513789
2024-01-11T18:01:16.147 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_rraja@teuthology --archive /home/teuthworker/archive/rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi/7513789 --name rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi --description rbd:mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-compare-mirror-images-nbd} -- /home/teuthworker/archive/rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi/7513789/orig.config.yaml
2024-01-11T18:01:16.150 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi/7513789
2024-01-11T18:01:16.151 INFO:teuthology.dispatcher.supervisor:Job PID: 3475995
2024-01-11T18:01:16.151 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-11T18:03:16.242 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:05:16.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:07:16.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:09:16.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:11:16.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:13:17.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:15:17.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:17:17.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:19:17.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:21:17.758 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:23:17.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:25:18.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:27:18.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:29:18.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:31:18.577 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:33:18.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:35:18.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:37:19.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:39:19.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:41:19.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:43:19.540 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:45:19.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:47:19.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:49:20.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:51:20.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:53:20.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:55:20.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:57:20.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T18:59:21.681 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:01:21.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:03:22.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:05:22.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:07:22.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:09:22.504 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:11:22.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:13:22.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:15:23.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:17:23.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:19:23.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:21:23.500 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:23:23.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:25:23.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:27:24.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:29:24.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:31:24.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:33:24.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:35:24.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:37:24.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:39:25.012 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:41:25.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:43:25.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:45:25.524 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:47:25.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:49:25.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:51:25.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:53:26.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:55:26.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:57:26.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T19:59:26.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:01:26.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:03:27.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:05:27.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:07:27.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:09:27.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:11:27.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:13:27.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:15:27.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:17:28.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:19:28.480 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:21:28.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:23:28.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-11T20:23:28.809 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-11T20:23:28.985 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-11T20:23:28.985 INFO:teuthology.nuke:Checking targets against current locks
2024-01-11T20:23:29.034 DEBUG:teuthology.nuke:shortname: smithi150
2024-01-11T20:23:29.034 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-11T20:23:29.056 DEBUG:teuthology.nuke:shortname: smithi181
2024-01-11T20:23:29.056 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-11T20:23:29.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi/7513789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 17:55:23.439056', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIM1PyNSrH2Ogb7JsM0PimN8rFhSwZ7IAG1UKtvmnYow0pu4TLhbbYAbZUkQNjbWtYBfzN4P8OBVNEgpguuD7k='}
2024-01-11T20:23:29.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi181.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rraja-2024-01-11_17:50:00-rbd:mirror-main-distro-default-smithi/7513789', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-11 17:55:23.437804', 'locked_by': 'scheduled_rraja@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLX2HmoPoX7Wk1io6T6zba4vh2eVDGdl2xfRYZpIbZIHeTdzi179KymvP7wciHgj5E7EEaJiek48m+3mMR3QMFM='}
2024-01-11T20:23:29.104 INFO:teuthology.orchestra.console.smithi150:Power off
2024-01-11T20:23:29.105 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-11T20:23:29.121 INFO:teuthology.orchestra.console.smithi181:Power off
2024-01-11T20:23:29.121 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-11T20:23:29.130 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-01-11T20:23:29.130 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T20:23:29.143 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-01-11T20:23:29.143 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-11T20:23:29.152 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-01-11T20:23:29.164 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-01-11T20:23:29.253 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-01-11T20:23:29.265 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-01-11T20:23:29.399 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com
2024-01-11T20:23:29.407 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com