2023-07-11T09:17:24.491 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-11T09:17:24.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:17:24.493 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:17:39.324 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f398da885e0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f398ecad8b0>, signals=[15])
2023-07-11T09:17:39.326 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2023-07-11T09:17:39.326 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T09:17:39.326 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2023-07-11T09:17:44.273 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging
2023-07-11T09:17:44.273 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server
2023-07-11T09:17:44.274 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2023-07-11T09:17:44.275 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"}
2023-07-11T09:17:48.848 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /host {"name": "smithi121"}
2023-07-11T09:18:03.925 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T09:18:08.933 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-11T09:18:13.975 DEBUG:teuthology.provision.fog.smithi121:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T09:18:13.975 DEBUG:teuthology.provision.fog.smithi121:FOG request: PUT /host/226 {"imageID": 3}
2023-07-11T09:18:18.982 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3)
2023-07-11T09:18:18.982 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 3}
2023-07-11T09:18:24.040 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream
2023-07-11T09:18:24.040 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None
2023-07-11T09:18:29.046 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of centos 8.stream
2023-07-11T09:18:29.046 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:18:34.089 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T09:18:34.094 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"}
2023-07-11T09:18:34.125 DEBUG:teuthology.provision.fog.smithi121:FOG request: POST /host/226/task {"taskTypeID": 1}
2023-07-11T09:18:34.133 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1}
2023-07-11T09:18:34.184 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:18:34.214 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None
2023-07-11T09:18:42.345 INFO:teuthology.orchestra.console:Power off smithi026
2023-07-11T09:18:42.346 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:18:42.361 INFO:teuthology.orchestra.console:Power off smithi121
2023-07-11T09:18:42.362 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:18:42.371 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:42.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:42.500 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2023-07-11T09:18:42.602 INFO:teuthology.orchestra.console:Power on smithi121
2023-07-11T09:18:42.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T09:18:42.627 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:46.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:46.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:51.508 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:51.763 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:56.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:56.873 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:18:57.083 INFO:teuthology.orchestra.console:Power on for smithi121 completed
2023-07-11T09:18:57.184 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2023-07-11T09:18:57.184 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:19:02.289 INFO:teuthology.orchestra.console:Power off for smithi026 completed
2023-07-11T09:19:02.390 INFO:teuthology.orchestra.console:Power on smithi026
2023-07-11T09:19:02.390 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-11T09:19:12.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:17.256 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:19:22.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:27.377 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:32.488 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:37.336 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:19:42.342 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:47.453 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:52.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:19:52.792 INFO:teuthology.orchestra.console:Power on for smithi026 completed
2023-07-11T09:19:52.894 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2023-07-11T09:19:52.894 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None
2023-07-11T09:19:52.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:19:57.414 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:20:11.376 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2023-07-11T09:20:12.474 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:20:17.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:20:37.556 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:20:42.638 ERROR:teuthology.orchestra.connection:Error authenticating with smithi026.front.sepia.ceph.com: Authentication failed.
2023-07-11T09:20:42.641 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:20:42.641 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:20:42.643 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:43.649 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:44.655 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:45.663 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:46.670 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:47.676 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:48.683 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:49.691 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:50.697 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:51.703 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:52.710 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:53.716 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:54.722 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:55.728 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:56.733 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:57.627 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:20:58.318 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:20:59.324 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:00.329 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:01.335 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:02.339 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:03.345 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:04.351 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:05.357 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:06.363 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:07.369 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:08.374 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:09.380 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:10.388 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:11.394 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:12.399 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:13.384 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:21:18.389 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:19.395 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:20.400 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:21.405 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:22.412 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:23.418 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:24.424 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:25.429 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:26.436 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:27.442 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:28.448 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:29.454 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:30.460 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:31.465 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:32.472 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:33.455 DEBUG:teuthology.provision.fog.smithi121:FOG request: GET /task/active None
2023-07-11T09:21:33.479 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:33.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:21:34.485 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:35.491 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:36.499 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented')
2023-07-11T09:21:36.592 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:21:42.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:21:50.676 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:21:56.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:21:59.764 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:22:05.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:22:13.840 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:22:19.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:22:22.896 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:22:28.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:22:52.400 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:22:58.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:23:01.456 WARNING:teuthology.provision.fog.smithi121:[Errno None] Unable to connect to port 22 on 172.21.15.121
2023-07-11T09:23:07.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:23:12.859 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:23:12.859 DEBUG:teuthology.orchestra.run.smithi121:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:23:25.424 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-07-11T09:23:25.425 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi026
2023-07-11T09:23:28.129 INFO:teuthology.provision.fog.smithi121:Node is ready
2023-07-11T09:23:28.130 DEBUG:teuthology.orchestra.run.smithi121:> hostname
2023-07-11T09:23:28.154 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2023-07-11T09:23:28.155 DEBUG:teuthology.orchestra.run.smithi121:> grep smithi121.front.sepia.ceph.com /etc/hosts
2023-07-11T09:23:28.224 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2023-07-11T09:23:28.224 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2023-07-11T09:23:28.340 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hosts
2023-07-11T09:23:28.371 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/172.21.15.121/172.21.15.121/g' /etc/hosts
2023-07-11T09:23:28.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i -e 's/smithi121.front.sepia.ceph.com/smithi121/g' /etc/hostname
2023-07-11T09:23:28.509 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname smithi121
2023-07-11T09:23:28.576 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2023-07-11T09:23:28.634 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream"
2023-07-11T09:23:28.634 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8"
2023-07-11T09:23:28.634 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos"
2023-07-11T09:23:28.634 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:23:28.635 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:23:28.636 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:23:28.636 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:23:28.637 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2023-07-11T09:23:28.638 DEBUG:teuthology.parallel:result is None
2023-07-11T09:23:34.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-07-11T09:23:34.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:23:34.715 DEBUG:teuthology.orchestra.run.smithi026:> true
2023-07-11T09:23:34.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-07-11T09:23:34.973 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-11T09:23:34.973 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-11T09:23:34.992 INFO:teuthology.provision.fog.smithi026:Node is ready
2023-07-11T09:23:34.992 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2023-07-11T09:23:35.054 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2023-07-11T09:23:35.054 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2023-07-11T09:23:35.116 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2023-07-11T09:23:35.117 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2023-07-11T09:23:35.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2023-07-11T09:23:35.265 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2023-07-11T09:23:35.337 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2023-07-11T09:23:35.409 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2023-07-11T09:23:35.480 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2023-07-11T09:23:35.542 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2023-07-11T09:23:35.542 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8"
2023-07-11T09:23:35.542 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:23:35.543 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:23:35.544 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:23:35.544 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:23:35.544 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:23:35.544 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2023-07-11T09:23:35.545 DEBUG:teuthology.parallel:result is None
2023-07-11T09:23:45.706 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2023-07-11T09:23:45.707 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T09:23:50.731 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2023-07-11T09:23:50.731 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-11T09:23:55.765 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2023-07-11T09:23:55.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-07-11T09:23:55.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:24:00.843 DEBUG:teuthology.orchestra.run.smithi026:> true
2023-07-11T09:24:00.980 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2023-07-11T09:24:00.980 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2023-07-11T09:24:01.038 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2023-07-11T09:24:01.039 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2023-07-11T09:24:01.097 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:24:01.098 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2023-07-11T09:24:01.099 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:24:01.099 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:24:01.099 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:24:01.099 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:24:01.099 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:24:01.100 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2023-07-11T09:24:06.129 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2023-07-11T09:24:06.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2023-07-11T09:24:06.130 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-11T09:24:11.202 DEBUG:teuthology.orchestra.run.smithi121:> true
2023-07-11T09:24:11.339 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com'
2023-07-11T09:24:11.339 DEBUG:teuthology.orchestra.run.smithi121:> uname -m
2023-07-11T09:24:11.397 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2023-07-11T09:24:11.397 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release
2023-07-11T09:24:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream"
2023-07-11T09:24:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8"
2023-07-11T09:24:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos"
2023-07-11T09:24:11.455 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-11T09:24:11.456 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-11T09:24:11.457 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-11T09:24:11.457 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2023-07-11T09:24:15.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:24:15.519 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:24:15.615 INFO:teuthology.dispatcher.supervisor:Running job 7333573
2023-07-11T09:24:15.616 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333573 --name gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi --description orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} -- /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333573/orig.config.yaml
2023-07-11T09:24:15.621 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333573
2023-07-11T09:24:15.622 INFO:teuthology.dispatcher.supervisor:Job PID: 7739
2023-07-11T09:24:15.622 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-11T09:26:15.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:26:15.723 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:28:20.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:28:20.897 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:30:26.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:30:26.086 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:32:31.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:32:31.118 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:34:36.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:34:36.362 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:36:41.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:36:41.537 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:38:46.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:38:46.711 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:40:51.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:40:51.894 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:42:57.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:42:57.061 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:45:02.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:45:02.256 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:47:07.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:47:07.440 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:49:12.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-11T09:49:12.722 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-11T09:49:13.078 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-11T09:49:13.178 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-11T09:49:13.179 INFO:teuthology.nuke:Checking targets against current locks
2023-07-11T09:49:13.239 DEBUG:teuthology.nuke:shortname: smithi026
2023-07-11T09:49:13.240 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T09:49:13.264 DEBUG:teuthology.nuke:shortname: smithi121
2023-07-11T09:49:13.265 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-11T09:49:13.269 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 09:17:23.614488', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmVwKYa8Fw5b5Uow15yDwFiRar5E2+5GuRe3gbzyf3alpkEmnRrhJA0H90cfhUM+t/5MsKfeVcVSzPGumv77lDQJihZOwIfe1sFtmobgREQL2o2E/rKaY0LB0uwINBKjMdylEg6FwsvnI8B1qcP/ShT7uQNxZ+TBabIqj4/sW1Q3MFsBiOF/lFwRvj3cU769Czwt4hhn87XOUDbZXGnxlTf7mmKnErMQE+eOAAf0+/J2CT381N+vEvETJuJsMea0pH0SxEe4hz8dsUrI/cloJLMMy0pYv0GpoAay4R7ud5EHRAgxogU/ju2TPxGueZqz5S3BlH5Gjtv97/Rlp7M3IVSTSRg/wFVjiwHLtrmTi18tao9r3kqh5sEWbcj0NcWuOta8j+ALdKjE0rdtNUPwEmtdfW7R/aYhSIvKQ6z0btpj2VE5VuPM2C5xZFVRTYrRzNvPpJdzN7Zy0juo55SAsDzG6l/j8oupSScnp5sfRyFKtC3KSJ1NnfRKDwlddJQbM='}
2023-07-11T09:49:13.294 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2023-07-11_07:33:56-orch:cephadm-guits-cv-refactor-osd-objectstore-distro-default-smithi/7333573', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-11 09:17:23.612730', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu1UsaJzc8oTXB8L5cOE89kVU+54UBczyftz4432lC5KevhDdLhoA6AknEVlFuA1W6jx9BGV9kBSaR4irX+HSjfjKY7Qrl1BKWAo+EgvwwU1o36g7YGi9bsDxRbmwdOF2nMO9fcqCjK6g5zHU7VGw5a3/GIRVN21K1Z2WVRvpcXv7v3vdlcBb97fzdSJJbedLKllKYYkntvQKgoYr5jYrv0UXjLxiuqa+9QfaVaeEcmSSSPg+UVo1/L+QatJB88WmZPdI6JMlxm1kf1yTYiq9FOPcbqq/4VSx76ybl8u3QXSPLe8tVsuv6DuYa1DD1qreynXZNqmKni7udH3mPNvRmwogXUG6dxv8GahKQ1RlqX0LagKv8twwZ43IfRwJexTYYnO301B0jzMBViINkjOSwwWdp6SDl7Xc8MS6KFu5Yk25rW0w843vi3ctCC7GEs+PPbNZxuvU4mV/XfwVdihZXG38rL9sDPYp6dlmWdknQ+zT985c92kcmc3ZDCWd5wFM='}
2023-07-11T09:49:13.326 INFO:teuthology.orchestra.console:Power off smithi026
2023-07-11T09:49:13.327 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:49:13.350 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:49:13.369 INFO:teuthology.orchestra.console:Power off smithi121
2023-07-11T09:49:13.370 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-11T09:49:13.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi121.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-11T09:49:13.483 INFO:teuthology.orchestra.console:Power off for smithi026 completed
2023-07-11T09:49:13.516 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2023-07-11T09:49:13.644 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com
2023-07-11T09:49:13.670 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com