2023-12-09T08:26:32.020 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-09T08:26:32.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:26:32.153 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1dc6a4ddf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1dc7b44550>, signals=[15])
2023-12-09T08:26:32.153 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-12-09T08:26:32.154 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-12-09T08:26:32.154 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-12-09T08:26:32.171 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-12-09T08:26:32.171 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-12-09T08:26:32.171 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-09T08:26:32.285 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-09T08:26:32.304 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_ubuntu_22.04 (ID 6)
2023-12-09T08:26:32.334 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of ubuntu 22.04
2023-12-09T08:26:32.341 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of ubuntu 22.04
2023-12-09T08:26:32.822 INFO:teuthology.orchestra.console.smithi132:Power off
2023-12-09T08:26:32.822 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-09T08:26:32.837 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-09T08:26:32.837 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-09T08:26:32.845 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-12-09T08:26:32.846 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:32.857 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-09T08:26:32.858 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:32.866 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-09T08:26:32.877 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-09T08:26:32.978 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-09T08:26:33.078 INFO:teuthology.orchestra.console.smithi150:Power on
2023-12-09T08:26:33.079 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-09T08:26:33.100 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2023-12-09T08:26:33.100 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:33.120 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-09T08:26:36.871 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:36.980 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-09T08:26:37.122 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:37.230 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-09T08:26:40.984 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:41.094 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-09T08:26:41.231 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:41.340 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-09T08:26:41.440 INFO:teuthology.orchestra.console.smithi150:Power on completed
2023-12-09T08:26:41.541 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-12-09T08:26:45.098 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:45.207 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-09T08:26:45.308 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-12-09T08:26:45.408 INFO:teuthology.orchestra.console.smithi132:Power on
2023-12-09T08:26:45.408 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-09T08:26:45.429 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2023-12-09T08:26:45.429 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:45.449 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-09T08:26:49.454 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T08:26:49.562 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-12-09T08:26:49.662 INFO:teuthology.orchestra.console.smithi132:Power on completed
2023-12-09T08:26:49.763 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-12-09T08:30:22.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:30:26.050 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:30:32.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:30:35.106 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:30:41.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:30:44.162 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:30:50.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:30:53.250 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:30:59.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:31:02.338 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:31:08.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:31:11.426 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-12-09T08:31:17.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:31:46.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:31:49.410 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:31:55.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:31:58.498 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:04.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:07.586 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:13.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:16.642 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:17.432 WARNING:teuthology.provision.fog.smithi132:timed out
2023-12-09T08:32:22.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:23.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:23.656 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-09T08:32:23.657 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-09T08:32:24.101 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-12-09T08:32:24.102 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-12-09T08:32:24.149 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2023-12-09T08:32:24.149 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2023-12-09T08:32:24.197 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2023-12-09T08:32:24.197 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-12-09T08:32:24.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2023-12-09T08:32:24.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-12-09T08:32:24.400 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2023-12-09T08:32:24.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-12-09T08:32:24.512 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-12-09T08:32:24.561 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-09T08:32:24.561 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu"
2023-12-09T08:32:24.561 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04"
2023-12-09T08:32:24.561 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-09T08:32:24.561 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-09T08:32:24.562 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy
2023-12-09T08:32:24.563 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-12-09T08:32:24.564 DEBUG:teuthology.parallel:result is None
2023-12-09T08:32:25.730 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:31.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:34.786 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:40.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:43.874 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:49.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:32:52.962 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:32:58.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:33:30.467 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:33:36.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:33:36.472 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:33:42.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:33:42.480 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:33:48.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:33:48.489 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:33:54.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:33:54.492 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2023-12-09T08:34:00.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:34:00.818 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-09T08:34:00.819 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-09T08:34:01.411 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-12-09T08:34:01.411 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-12-09T08:34:01.456 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-12-09T08:34:01.456 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-12-09T08:34:01.505 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-12-09T08:34:01.505 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-09T08:34:01.613 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-12-09T08:34:01.627 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-12-09T08:34:01.681 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-12-09T08:34:01.736 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-09T08:34:01.791 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2023-12-09T08:34:01.837 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-09T08:34:01.838 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2023-12-09T08:34:01.838 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-12-09T08:34:01.839 DEBUG:teuthology.parallel:result is None
2023-12-09T08:34:02.049 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2023-12-09T08:34:02.050 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-09T08:34:02.075 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-12-09T08:34:02.076 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-09T08:34:02.093 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2023-12-09T08:34:02.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-12-09T08:34:02.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:34:02.174 DEBUG:teuthology.orchestra.run.smithi132:> true
2023-12-09T08:34:02.399 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-12-09T08:34:02.399 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2023-12-09T08:34:02.447 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2023-12-09T08:34:02.447 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-12-09T08:34:02.499 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-09T08:34:02.500 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-09T08:34:02.501 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy
2023-12-09T08:34:02.501 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-12-09T08:34:02.526 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-12-09T08:34:02.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-09T08:34:02.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-09T08:34:02.596 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-12-09T08:34:02.694 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-09T08:34:02.694 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-12-09T08:34:02.740 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-12-09T08:34:02.740 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS"
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu"
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04"
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)"
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/"
2023-12-09T08:34:02.789 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2023-12-09T08:34:02.790 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2023-12-09T08:34:02.790 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2023-12-09T08:34:02.790 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy
2023-12-09T08:34:02.790 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-09T08:34:02.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:34:02.895 INFO:teuthology.dispatcher.supervisor:Running job 7485342
2023-12-09T08:34:02.895 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_alimasa@teuthology --archive /home/teuthworker/archive/alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7485342 --name alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7485342/orig.config.yaml
2023-12-09T08:34:02.898 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7485342
2023-12-09T08:34:02.899 INFO:teuthology.dispatcher.supervisor:Job PID: 3075813
2023-12-09T08:34:02.899 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-09T08:36:02.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:38:03.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:40:03.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:42:03.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:44:03.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:46:03.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:48:04.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:50:04.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:52:04.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:54:04.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:56:04.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T08:58:04.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:00:05.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:02:05.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:04:05.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:06:05.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:08:05.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:10:06.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:12:06.300 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:14:06.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:16:06.616 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:18:06.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:20:06.926 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:22:07.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:24:07.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:26:07.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:28:07.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:30:07.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:32:07.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:34:08.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:36:08.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:38:08.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:40:08.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:42:08.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:44:08.769 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:46:08.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:48:09.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:50:09.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:52:09.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:54:09.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:56:09.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T09:58:09.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:00:09.978 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:02:10.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:04:10.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:06:10.440 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:08:10.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:10:10.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:12:10.826 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:14:11.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:16:11.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:18:11.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:20:11.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:22:11.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:24:11.750 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:26:11.922 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:28:12.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:30:12.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:32:12.338 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:34:12.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:36:12.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:38:12.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:40:12.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:42:13.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-09T10:42:13.290 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-09T10:42:13.456 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-09T10:42:13.456 INFO:teuthology.nuke:Checking targets against current locks
2023-12-09T10:42:13.506 DEBUG:teuthology.nuke:shortname: smithi132
2023-12-09T10:42:13.507 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-09T10:42:13.525 DEBUG:teuthology.nuke:shortname: smithi150
2023-12-09T10:42:13.526 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-09T10:42:13.530 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7485342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 08:26:31.204250', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMRMOpfSQPpf+4XEvg8qJ5IDUPu/WNFzrCmkWWpqWZ2ibzEsH63HCsc9uddNkD/tZBLprKoM0PmuUP7G9Pov9HQ='}
2023-12-09T10:42:13.554 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/alimasa-2023-12-09_08:25:06-rgw-wip-alimasa-multi-pubsub-etag-test-distro-default-smithi/7485342', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-09 08:26:31.205558', 'locked_by': 'scheduled_alimasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGeJ2fVJYO61PX79f6ToPoQHTU9n1r0PNBC/buUppvOWG/xO3DkVj5xjPIu1LAbVB0YTvbv2LYXoJiIfaqotzJI='}
2023-12-09T10:42:13.586 INFO:teuthology.orchestra.console.smithi132:Power off
2023-12-09T10:42:13.587 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-09T10:42:13.612 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-12-09T10:42:13.613 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T10:42:13.631 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-09T10:42:13.632 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-09T10:42:13.641 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-12-09T10:42:13.654 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-09T10:42:13.655 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-09T10:42:13.677 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-09T10:42:13.742 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-12-09T10:42:13.779 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-09T10:42:13.889 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com
2023-12-09T10:42:13.922 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com