2023-07-31T14:50:54.005 INFO:root:teuthology version: 0.0.1.dev172+g6114016
2023-07-31T14:50:54.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T14:50:54.157 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f081b730820>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f081b00ae50>, signals=[15])
2023-07-31T14:50:54.158 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging
2023-07-31T14:50:54.158 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server
2023-07-31T14:50:54.159 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-07-31T14:50:54.183 INFO:teuthology.lock.ops:Start node 'smithi097.front.sepia.ceph.com' reimaging
2023-07-31T14:50:54.184 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: reset os type and version on server
2023-07-31T14:50:54.184 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-31T14:50:54.185 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /host {"name": "smithi044"}
2023-07-31T14:50:54.208 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /host {"name": "smithi097"}
2023-07-31T14:50:54.254 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-31T14:50:54.275 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-31T14:50:54.296 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10)
2023-07-31T14:50:54.297 DEBUG:teuthology.provision.fog.smithi044:FOG request: PUT /host/149 {"imageID": 10}
2023-07-31T14:50:54.320 DEBUG:teuthology.provision.fog.smithi097:Requesting image smithi_centos_9.stream (ID 10)
2023-07-31T14:50:54.321 DEBUG:teuthology.provision.fog.smithi097:FOG request: PUT /host/202 {"imageID": 10}
2023-07-31T14:50:54.336 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream
2023-07-31T14:50:54.336 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:50:54.358 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of centos 9.stream
2023-07-31T14:50:54.359 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:50:54.375 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /tasktype {"name": "deploy"}
2023-07-31T14:50:54.399 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /tasktype {"name": "deploy"}
2023-07-31T14:50:54.403 DEBUG:teuthology.provision.fog.smithi044:FOG request: POST /host/149/task {"taskTypeID": 1}
2023-07-31T14:50:54.429 DEBUG:teuthology.provision.fog.smithi097:FOG request: POST /host/202/task {"taskTypeID": 1}
2023-07-31T14:50:54.456 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:50:54.479 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:50:54.530 INFO:teuthology.orchestra.console.smithi044:Power off
2023-07-31T14:50:54.531 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-31T14:50:54.556 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-07-31T14:50:54.557 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:50:54.572 INFO:teuthology.orchestra.console.smithi097:Power off
2023-07-31T14:50:54.572 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-31T14:50:54.582 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-07-31T14:50:54.595 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-07-31T14:50:54.596 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:50:54.617 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-07-31T14:50:54.683 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-07-31T14:50:54.784 INFO:teuthology.orchestra.console.smithi044:Power on
2023-07-31T14:50:54.784 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-31T14:50:54.806 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On
2023-07-31T14:50:54.807 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:50:54.829 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-07-31T14:50:58.620 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:50:58.729 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-07-31T14:50:58.831 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:50:58.939 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-07-31T14:51:02.734 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:51:02.843 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-07-31T14:51:02.941 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:51:03.049 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on
2023-07-31T14:51:03.150 INFO:teuthology.orchestra.console.smithi044:Power on completed
2023-07-31T14:51:03.250 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish
2023-07-31T14:51:03.250 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:51:06.847 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:51:06.956 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-07-31T14:51:07.057 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-07-31T14:51:07.158 INFO:teuthology.orchestra.console.smithi097:Power on
2023-07-31T14:51:07.158 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-31T14:51:07.176 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On
2023-07-31T14:51:07.177 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:51:07.195 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-07-31T14:51:11.199 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T14:51:11.308 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on
2023-07-31T14:51:11.409 INFO:teuthology.orchestra.console.smithi097:Power on completed
2023-07-31T14:51:11.510 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2023-07-31T14:51:11.510 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:51:18.327 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:51:26.586 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:51:33.394 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:51:41.660 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:51:48.470 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:51:56.735 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:52:03.536 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:52:11.808 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:52:18.605 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:52:26.872 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:52:33.676 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:52:41.939 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:52:48.750 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:52:57.004 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:53:03.829 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:53:12.070 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:53:18.900 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:53:27.148 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:53:33.971 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None
2023-07-31T14:53:34.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:53:34.101 ERROR:teuthology.orchestra.connection:Error authenticating with smithi044.front.sepia.ceph.com: Authentication failed.
2023-07-31T14:53:34.139 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-31T14:53:34.139 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-31T14:53:34.140 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-31T14:53:42.218 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:53:57.272 DEBUG:teuthology.provision.fog.smithi097:FOG request: GET /task/active None
2023-07-31T14:53:57.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:54:15.667 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:54:21.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:54:24.720 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:54:30.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:54:33.776 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:54:39.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:54:42.832 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:54:48.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:07.376 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:55:13.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:16.432 WARNING:teuthology.provision.fog.smithi097:[Errno None] Unable to connect to port 22 on 172.21.15.97
2023-07-31T14:55:22.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:24.626 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-31T14:55:24.627 DEBUG:teuthology.orchestra.run.smithi097:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-31T14:55:26.320 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-31T14:55:26.337 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi044
2023-07-31T14:55:35.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-07-31T14:55:35.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:35.561 DEBUG:teuthology.orchestra.run.smithi044:> true
2023-07-31T14:55:35.886 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-07-31T14:55:35.887 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-31T14:55:35.887 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-31T14:55:35.901 INFO:teuthology.provision.fog.smithi044:Node is ready
2023-07-31T14:55:35.901 DEBUG:teuthology.orchestra.run.smithi044:> hostname
2023-07-31T14:55:35.956 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com
2023-07-31T14:55:35.957 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts
2023-07-31T14:55:36.012 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044
2023-07-31T14:55:36.012 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-07-31T14:55:36.133 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts
2023-07-31T14:55:36.165 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts
2023-07-31T14:55:36.237 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname
2023-07-31T14:55:36.308 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044
2023-07-31T14:55:36.378 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-07-31T14:55:36.433 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2023-07-31T14:55:36.433 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2023-07-31T14:55:36.433 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2023-07-31T14:55:36.434 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-31T14:55:36.435 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2023-07-31T14:55:36.435 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-31T14:55:36.435 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-31T14:55:36.435 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-31T14:55:36.435 INFO:teuthology.provision.fog.smithi044:Deploy complete!
2023-07-31T14:55:36.437 DEBUG:teuthology.parallel:result is None
2023-07-31T14:55:49.812 INFO:teuthology.provision.fog.smithi097:Node is ready
2023-07-31T14:55:49.812 DEBUG:teuthology.orchestra.run.smithi097:> hostname
2023-07-31T14:55:49.831 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2023-07-31T14:55:49.831 DEBUG:teuthology.orchestra.run.smithi097:> grep smithi097.front.sepia.ceph.com /etc/hosts
2023-07-31T14:55:49.887 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2023-07-31T14:55:49.887 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-31T14:55:50.012 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hosts
2023-07-31T14:55:50.041 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/172.21.15.97/172.21.15.97/g' /etc/hosts
2023-07-31T14:55:50.109 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i -e 's/smithi097.front.sepia.ceph.com/smithi097/g' /etc/hostname
2023-07-31T14:55:50.177 DEBUG:teuthology.orchestra.run.smithi097:> sudo hostname smithi097
2023-07-31T14:55:50.243 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-31T14:55:50.297 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2023-07-31T14:55:50.297 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-31T14:55:50.298 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2023-07-31T14:55:50.299 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-31T14:55:50.299 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2023-07-31T14:55:50.299 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-31T14:55:50.299 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-31T14:55:50.299 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-31T14:55:50.299 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2023-07-31T14:55:50.300 DEBUG:teuthology.parallel:result is None
2023-07-31T14:55:50.490 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com
2023-07-31T14:55:50.491 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-31T14:55:50.512 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2023-07-31T14:55:50.512 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-31T14:55:50.529 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server
2023-07-31T14:55:50.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-07-31T14:55:50.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:50.624 DEBUG:teuthology.orchestra.run.smithi044:> true
2023-07-31T14:55:50.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com'
2023-07-31T14:55:50.810 DEBUG:teuthology.orchestra.run.smithi044:> uname -m
2023-07-31T14:55:50.865 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64
2023-07-31T14:55:50.865 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release
2023-07-31T14:55:50.919 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream"
2023-07-31T14:55:50.919 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9"
2023-07-31T14:55:50.919 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos"
2023-07-31T14:55:50.919 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-31T14:55:50.920 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/"
2023-07-31T14:55:50.921 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-31T14:55:50.921 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-31T14:55:50.921 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-31T14:55:50.921 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server
2023-07-31T14:55:50.945 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2023-07-31T14:55:50.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-31T14:55:50.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-31T14:55:51.027 DEBUG:teuthology.orchestra.run.smithi097:> true
2023-07-31T14:55:51.051 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com'
2023-07-31T14:55:51.052 DEBUG:teuthology.orchestra.run.smithi097:> uname -m
2023-07-31T14:55:51.105 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2023-07-31T14:55:51.106 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release
2023-07-31T14:55:51.159 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="CentOS Stream"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="9"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:ID="centos"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE="rhel fedora"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="9"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:PLATFORM_ID="platform:el9"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-31T14:55:51.160 INFO:teuthology.orchestra.run.smithi097.stdout:ANSI_COLOR="0;31"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:LOGO="fedora-logo-icon"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://centos.org/"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-31T14:55:51.161 INFO:teuthology.orchestra.run.smithi097.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-31T14:55:51.162 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2023-07-31T14:55:51.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T14:55:51.267 INFO:teuthology.dispatcher.supervisor:Running job 7357621
2023-07-31T14:55:51.268 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi/7357621 --name cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability notify omap_limits overrides realms/two-zonegroup supported-random-distro$/{centos_latest} tasks/test_multi} -- /home/teuthworker/archive/cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi/7357621/orig.config.yaml
2023-07-31T14:55:51.271 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi/7357621
2023-07-31T14:55:51.271 INFO:teuthology.dispatcher.supervisor:Job PID: 7574
2023-07-31T14:55:51.272 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-31T14:57:51.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T14:59:51.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:01:51.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:03:51.890 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:05:52.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:07:52.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:09:52.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:11:52.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:13:52.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:15:52.850 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:17:52.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:19:53.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:21:53.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:23:53.482 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:25:53.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:27:53.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:29:53.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:31:54.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:33:54.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:35:54.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:37:54.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:39:54.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:41:54.702 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:43:54.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:45:55.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:47:55.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:49:55.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:51:55.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:53:55.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:55:55.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:57:56.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T15:59:56.253 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:01:56.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:04:00.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:06:15.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:08:20.627 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:10:25.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:12:31.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:14:31.169 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:16:36.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:18:41.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:20:46.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:22:51.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:24:57.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:27:02.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:29:07.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:31:10.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:33:15.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:35:20.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:37:22.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:39:27.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:41:32.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:43:37.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:45:38.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:47:43.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:49:47.428 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:51:52.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:53:57.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:55:57.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T16:58:03.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:00:08.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:02:13.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:04:13.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:06:13.901 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:08:14.081 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-31T17:08:14.252 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-31T17:08:14.421 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-31T17:08:14.422 INFO:teuthology.nuke:Checking targets against current locks
2023-07-31T17:08:14.477 DEBUG:teuthology.nuke:shortname: smithi044
2023-07-31T17:08:14.477 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-31T17:08:14.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi/7357621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-31 14:50:53.153704', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEf8ySyvYkmHxYk8i1mGTCNoAqHXwWxtlSUnrn4zcbhEvpmDriDv4zEMjJosQnVVbmhZMFpg7fUUAJFZMGrd/So='}
2023-07-31T17:08:14.503 DEBUG:teuthology.nuke:shortname: smithi097
2023-07-31T17:08:14.503 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-31T17:08:14.528 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2023-07-31_14:49:57-rgw-main-distro-default-smithi/7357621', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-31 14:50:53.155097', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW6ofqwI8A6VoDggxGvdl1hJ/35Xazphq2yOko5FS5vkBR4DHy798NOKPNvYicaTgkDYDD2RZTHzrfL1RjG5qA='}
2023-07-31T17:08:14.562 INFO:teuthology.orchestra.console.smithi044:Power off
2023-07-31T17:08:14.563 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-31T17:08:14.587 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off
2023-07-31T17:08:14.588 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T17:08:14.605 INFO:teuthology.orchestra.console.smithi097:Power off
2023-07-31T17:08:14.606 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-31T17:08:14.615 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off
2023-07-31T17:08:14.628 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off
2023-07-31T17:08:14.629 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-31T17:08:14.650 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off
2023-07-31T17:08:14.716 INFO:teuthology.orchestra.console.smithi044:Power off completed
2023-07-31T17:08:14.752 INFO:teuthology.orchestra.console.smithi097:Power off completed
2023-07-31T17:08:14.870 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com
2023-07-31T17:08:14.902 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com