2023-12-14T02:35:45.086 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T02:35:45.086 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:35:45.267 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0e227064c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0e2365e940>, signals=[15])
2023-12-14T02:35:45.268 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2023-12-14T02:35:45.268 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T02:35:45.268 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-14T02:35:45.294 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2023-12-14T02:35:45.294 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T02:35:45.295 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-12-14T02:35:45.318 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging
2023-12-14T02:35:45.318 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T02:35:45.319 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-12-14T02:35:45.429 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_8.stream (ID 3)
2023-12-14T02:35:45.433 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_8.stream (ID 3)
2023-12-14T02:35:45.454 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3)
2023-12-14T02:35:45.473 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream
2023-12-14T02:35:45.476 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 8.stream
2023-12-14T02:35:45.505 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream
2023-12-14T02:35:45.743 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-14T02:35:45.743 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:35:45.758 INFO:teuthology.orchestra.console.smithi191:Power off
2023-12-14T02:35:45.758 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:35:45.770 INFO:teuthology.orchestra.console.smithi188:Power off
2023-12-14T02:35:45.770 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:35:45.779 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2023-12-14T02:35:45.779 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:45.787 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-14T02:35:45.787 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:45.795 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off
2023-12-14T02:35:45.796 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:45.805 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-12-14T02:35:45.808 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-14T02:35:45.819 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2023-12-14T02:35:49.809 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:49.817 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:49.825 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:49.920 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-12-14T02:35:49.927 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-14T02:35:49.936 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2023-12-14T02:35:53.921 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:53.929 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:53.936 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:54.031 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-12-14T02:35:54.037 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-14T02:35:54.048 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2023-12-14T02:35:58.036 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.043 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.055 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.146 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-12-14T02:35:58.157 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-14T02:35:58.167 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2023-12-14T02:35:58.247 INFO:teuthology.orchestra.console.smithi191:Power off completed
2023-12-14T02:35:58.258 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-14T02:35:58.268 INFO:teuthology.orchestra.console.smithi188:Power off completed
2023-12-14T02:35:58.348 INFO:teuthology.orchestra.console.smithi191:Power on
2023-12-14T02:35:58.348 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T02:35:58.360 INFO:teuthology.orchestra.console.smithi150:Power on
2023-12-14T02:35:58.361 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T02:35:58.371 INFO:teuthology.orchestra.console.smithi188:Power on
2023-12-14T02:35:58.371 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T02:35:58.383 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On
2023-12-14T02:35:58.383 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.393 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2023-12-14T02:35:58.397 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.411 DEBUG:teuthology.orchestra.console.smithi188:power on output: Chassis Power Control: Up/On
2023-12-14T02:35:58.412 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:35:58.419 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-12-14T02:35:58.426 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-14T02:35:58.438 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2023-12-14T02:36:02.422 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:36:02.435 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:36:02.446 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:36:02.537 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-12-14T02:36:02.548 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2023-12-14T02:36:02.555 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2023-12-14T02:36:02.649 INFO:teuthology.orchestra.console.smithi150:Power on completed
2023-12-14T02:36:02.750 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2023-12-14T02:36:06.541 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:36:06.556 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:36:06.651 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on
2023-12-14T02:36:06.666 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on
2023-12-14T02:36:06.752 INFO:teuthology.orchestra.console.smithi191:Power on completed
2023-12-14T02:36:06.767 INFO:teuthology.orchestra.console.smithi188:Power on completed
2023-12-14T02:36:06.853 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish
2023-12-14T02:36:06.868 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2023-12-14T02:38:37.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:38:40.757 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:38:46.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:38:48.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:38:49.842 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:38:52.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:38:55.829 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:38:55.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:38:58.901 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:39:01.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:04.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:04.913 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:39:07.957 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:39:10.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:13.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:13.969 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:39:17.009 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:39:19.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:23.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:23.029 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:39:26.065 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:39:29.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:32.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:32.085 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:39:35.121 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-12-14T02:39:38.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:41.123 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:39:41.141 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191
2023-12-14T02:39:47.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:40:19.263 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: AuthenticationException('Authentication timeout.')
2023-12-14T02:40:38.710 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e221a95e0>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:40:41.125 WARNING:teuthology.provision.fog.smithi188:timed out
2023-12-14T02:40:45.804 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e222e7730>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:40:47.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:40:47.145 WARNING:teuthology.provision.fog.smithi191:timed out
2023-12-14T02:40:47.427 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T02:40:47.428 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T02:40:47.687 INFO:teuthology.provision.fog.smithi188:Node is ready
2023-12-14T02:40:47.687 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2023-12-14T02:40:47.706 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2023-12-14T02:40:47.707 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts
2023-12-14T02:40:47.767 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2023-12-14T02:40:47.768 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-12-14T02:40:47.878 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts
2023-12-14T02:40:47.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts
2023-12-14T02:40:47.977 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname
2023-12-14T02:40:48.046 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-12-14T02:40:48.114 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-12-14T02:40:48.172 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-12-14T02:40:48.172 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-12-14T02:40:48.172 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-12-14T02:40:48.172 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:40:48.172 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:40:48.173 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:40:48.174 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2023-12-14T02:40:48.175 DEBUG:teuthology.parallel:result is None
2023-12-14T02:40:53.147 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:40:53.331 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T02:40:53.331 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T02:40:53.565 INFO:teuthology.provision.fog.smithi191:Node is ready
2023-12-14T02:40:53.743 DEBUG:teuthology.orchestra.run.smithi191:> hostname
2023-12-14T02:40:53.762 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com
2023-12-14T02:40:53.763 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts
2023-12-14T02:40:53.822 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191
2023-12-14T02:40:53.823 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-12-14T02:40:53.919 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts
2023-12-14T02:40:53.948 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts
2023-12-14T02:40:54.017 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname
2023-12-14T02:40:54.084 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191
2023-12-14T02:40:54.151 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-12-14T02:40:54.208 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:40:54.209 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:40:54.210 INFO:teuthology.provision.fog.smithi191:Deploy complete!
2023-12-14T02:40:54.213 DEBUG:teuthology.parallel:result is None
2023-12-14T02:40:55.821 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e222986a0>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:41:08.840 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e221542e0>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:41:09.394 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-12-14T02:41:24.859 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e22154d00>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:41:43.997 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e22157790>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:42:06.014 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e22157f10>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:42:31.031 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e2215c940>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:42:59.049 ERROR:teuthology.orchestra.connection:Error authenticating with smithi150.front.sepia.ceph.com: BadHostKeyException('smithi150.front.sepia.ceph.com', <paramiko.ecdsakey.ECDSAKey object at 0x7f0e22161340>, <paramiko.ed25519key.Ed25519Key object at 0x7f0e221de880>) (No SSH private key found!)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/connection.py", line 106, in connect
    ssh.connect(**connect_args)
  File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 438, in connect
    raise BadHostKeyException(hostname, server_key, our_key)
paramiko.ssh_exception.BadHostKeyException: Host key for server 'smithi150.front.sepia.ceph.com' does not match: got 'AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE=', expected 'AAAAC3NzaC1lZDI1NTE5AAAAIJcx+xsm9ejAzx3YlLMcx2v+NxtVOehv0/a+TIxfUZSq'
2023-12-14T02:42:59.049 WARNING:teuthology.provision.fog.smithi150:'connect to smithi150.front.sepia.ceph.com' reached maximum tries (11) after waiting for 145 seconds
2023-12-14T02:43:05.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:43:05.249 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T02:43:05.249 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T02:43:05.542 INFO:teuthology.provision.fog.smithi150:Node is ready
2023-12-14T02:43:05.542 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2023-12-14T02:43:05.563 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2023-12-14T02:43:05.563 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2023-12-14T02:43:05.623 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2023-12-14T02:43:05.623 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-14T02:43:05.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2023-12-14T02:43:05.768 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2023-12-14T02:43:05.838 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2023-12-14T02:43:05.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2023-12-14T02:43:05.975 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:43:06.033 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-12-14T02:43:06.034 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:43:06.034 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:43:06.034 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:43:06.034 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:43:06.034 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:43:06.034 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2023-12-14T02:43:06.035 DEBUG:teuthology.parallel:result is None
2023-12-14T02:43:06.149 ERROR:teuthology.misc:smithi150.front.sepia.ceph.com: Connection closed by remote host
2023-12-14T02:43:06.224 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2023-12-14T02:43:06.225 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T02:43:06.243 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2023-12-14T02:43:06.244 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T02:43:06.268 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com
2023-12-14T02:43:06.268 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T02:43:06.286 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2023-12-14T02:43:06.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-14T02:43:06.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:43:06.353 DEBUG:teuthology.orchestra.run.smithi150:> true
2023-12-14T02:43:06.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2023-12-14T02:43:06.423 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2023-12-14T02:43:06.482 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2023-12-14T02:43:06.482 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2023-12-14T02:43:06.539 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:43:06.540 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:43:06.541 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:43:06.541 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2023-12-14T02:43:06.560 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2023-12-14T02:43:06.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-12-14T02:43:06.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:43:06.627 DEBUG:teuthology.orchestra.run.smithi188:> true
2023-12-14T02:43:06.765 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-12-14T02:43:06.765 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2023-12-14T02:43:06.824 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2023-12-14T02:43:06.825 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:43:06.883 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:43:06.884 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:43:06.884 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-12-14T02:43:06.902 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server
2023-12-14T02:43:06.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-12-14T02:43:06.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T02:43:06.973 DEBUG:teuthology.orchestra.run.smithi191:> true
2023-12-14T02:43:07.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com'
2023-12-14T02:43:07.113 DEBUG:teuthology.orchestra.run.smithi191:> uname -m
2023-12-14T02:43:07.173 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64
2023-12-14T02:43:07.173 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T02:43:07.232 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/"
2023-12-14T02:43:07.233 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T02:43:07.233 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T02:43:07.233 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T02:43:07.233 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server
2023-12-14T02:43:07.262 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:43:07.348 INFO:teuthology.dispatcher.supervisor:Running job 7490983
2023-12-14T02:43:07.348 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983 --name yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_host_drain} -- /home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983/orig.config.yaml
2023-12-14T02:43:07.351 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983
2023-12-14T02:43:07.351 INFO:teuthology.dispatcher.supervisor:Job PID: 1221449
2023-12-14T02:43:07.351 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T02:45:07.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:47:07.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:49:07.734 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:51:07.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:53:08.070 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:55:08.234 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T02:55:08.303 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T02:55:08.424 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T02:55:08.424 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T02:55:08.477 DEBUG:teuthology.nuke:shortname: smithi150
2023-12-14T02:55:08.478 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T02:55:08.509 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 02:35:44.221835', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIZmI81C+zmIiE3x41JgbdlYZIOfGYKCQReOeZhqyAO9WmrWIlyHG+aKWV3NKV7Mrky+YrqyLuqjPuqFLVb+SBE='}
2023-12-14T02:55:08.510 DEBUG:teuthology.nuke:shortname: smithi188
2023-12-14T02:55:08.510 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T02:55:08.538 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 02:35:44.218087', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGBrozMD56mG5xCVK0hOzHlHm3nwiRTkOmr6Wl6bAvtrxGiGuixSSzZriVkG+5Fe1RFqxE/Hj3mKZ6HEA49iDok='}
2023-12-14T02:55:08.543 DEBUG:teuthology.nuke:shortname: smithi191
2023-12-14T02:55:08.544 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T02:55:08.575 INFO:teuthology.orchestra.console.smithi150:Power off
2023-12-14T02:55:08.575 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:55:08.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-13_20:42:37-rados-wip-yuri10-testing-2023-12-12-1229-distro-default-smithi/7490983', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 02:35:44.220069', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBImBZX42dvSh790dkrcmC0wlrcciv/QaauD2pQjAadhTeuCPHp6vQrXqO9/3DsXT3GiPAHTE/hd6o5A31a5/ak0='}
2023-12-14T02:55:08.606 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2023-12-14T02:55:08.606 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:55:08.642 INFO:teuthology.orchestra.console.smithi188:Power off
2023-12-14T02:55:08.642 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:55:08.657 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2023-12-14T02:55:08.669 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off
2023-12-14T02:55:08.670 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:55:08.690 INFO:teuthology.orchestra.console.smithi191:Power off
2023-12-14T02:55:08.690 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T02:55:08.700 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off
2023-12-14T02:55:08.716 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off
2023-12-14T02:55:08.717 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T02:55:08.740 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off
2023-12-14T02:55:08.759 INFO:teuthology.orchestra.console.smithi150:Power off completed
2023-12-14T02:55:08.801 INFO:teuthology.orchestra.console.smithi188:Power off completed
2023-12-14T02:55:08.842 INFO:teuthology.orchestra.console.smithi191:Power off completed
2023-12-14T02:55:08.909 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com
2023-12-14T02:55:08.955 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com
2023-12-14T02:55:08.984 INFO:teuthology.lock.ops:unlocked: smithi191.front.sepia.ceph.com