2023-06-22T14:56:33.612 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-22T14:56:33.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T14:56:33.615 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T14:56:33.775 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f57a917e670>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f57aa39b8b0>, signals=[15])
2023-06-22T14:56:33.777 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging
2023-06-22T14:56:33.777 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server
2023-06-22T14:56:33.777 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-06-22T14:56:33.801 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-06-22T14:56:33.801 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-06-22T14:56:33.802 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-06-22T14:56:33.803 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"}
2023-06-22T14:56:33.829 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-06-22T14:56:33.873 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-06-22T14:56:33.894 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-06-22T14:56:33.920 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10)
2023-06-22T14:56:33.945 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 10}
2023-06-22T14:56:33.948 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10)
2023-06-22T14:56:33.949 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 10}
2023-06-22T14:56:33.988 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream
2023-06-22T14:56:33.988 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:56:33.991 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream
2023-06-22T14:56:33.991 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:56:34.033 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-06-22T14:56:34.036 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"}
2023-06-22T14:56:34.067 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1}
2023-06-22T14:56:34.072 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-06-22T14:56:34.126 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:56:34.133 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:56:34.227 INFO:teuthology.orchestra.console:Power off smithi019
2023-06-22T14:56:34.228 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T14:56:34.245 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-22T14:56:34.246 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T14:56:34.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:34.271 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:34.384 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2023-06-22T14:56:34.393 INFO:teuthology.orchestra.console:Power off for smithi107 completed
2023-06-22T14:56:34.485 INFO:teuthology.orchestra.console:Power on smithi019
2023-06-22T14:56:34.486 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-22T14:56:34.495 INFO:teuthology.orchestra.console:Power on smithi107
2023-06-22T14:56:34.496 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-06-22T14:56:34.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:34.522 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:38.536 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:38.547 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T14:56:38.750 INFO:teuthology.orchestra.console:Power on for smithi019 completed
2023-06-22T14:56:38.758 INFO:teuthology.orchestra.console:Power on for smithi107 completed
2023-06-22T14:56:38.852 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish
2023-06-22T14:56:38.852 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:56:38.860 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-06-22T14:56:38.860 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:56:53.928 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:56:53.930 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:57:29.013 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:57:29.015 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:57:44.994 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:57:50.001 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:58:10.100 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:58:10.101 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:58:35.200 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:58:35.201 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:59:00.260 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:59:05.267 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None
2023-06-22T14:59:05.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:08.404 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-06-22T14:59:14.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:17.488 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-06-22T14:59:20.349 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-06-22T14:59:20.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:23.472 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-22T14:59:23.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:26.544 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-06-22T14:59:29.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:34.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:39.488 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-22T14:59:42.544 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19
2023-06-22T14:59:45.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:48.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T14:59:53.553 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-22T14:59:59.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:00:02.608 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-22T15:00:08.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:00:11.664 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-06-22T15:00:17.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:00:53.581 WARNING:teuthology.provision.fog.smithi019:timed out
2023-06-22T15:00:59.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:01:04.798 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-22T15:01:04.799 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-22T15:01:05.116 INFO:teuthology.provision.fog.smithi019:Node is ready
2023-06-22T15:01:05.116 DEBUG:teuthology.orchestra.run.smithi019:> hostname
2023-06-22T15:01:05.131 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com
2023-06-22T15:01:05.131 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts
2023-06-22T15:01:05.186 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019
2023-06-22T15:01:05.186 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-06-22T15:01:05.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts
2023-06-22T15:01:05.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts
2023-06-22T15:01:05.405 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname
2023-06-22T15:01:05.476 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019
2023-06-22T15:01:05.547 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2023-06-22T15:01:05.601 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2023-06-22T15:01:05.601 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2023-06-22T15:01:05.601 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2023-06-22T15:01:05.602 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2023-06-22T15:01:05.602 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2023-06-22T15:01:05.602 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2023-06-22T15:01:05.602 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2023-06-22T15:01:05.602 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-06-22T15:01:05.603 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-22T15:01:05.604 INFO:teuthology.provision.fog.smithi019:Deploy complete!
2023-06-22T15:01:05.605 DEBUG:teuthology.parallel:result is None
2023-06-22T15:01:22.691 WARNING:teuthology.provision.fog.smithi107:timed out
2023-06-22T15:01:28.696 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:01:28.904 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-06-22T15:01:28.905 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-06-22T15:01:29.210 INFO:teuthology.provision.fog.smithi107:Node is ready
2023-06-22T15:01:29.211 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2023-06-22T15:01:29.225 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com
2023-06-22T15:01:29.226 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts
2023-06-22T15:01:29.279 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2023-06-22T15:01:29.280 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-06-22T15:01:29.390 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts
2023-06-22T15:01:29.418 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2023-06-22T15:01:29.485 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname
2023-06-22T15:01:29.552 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-06-22T15:01:29.619 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-06-22T15:01:29.673 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2023-06-22T15:01:29.673 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-06-22T15:01:29.674 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2023-06-22T15:01:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-06-22T15:01:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2023-06-22T15:01:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T15:01:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-06-22T15:01:29.675 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-22T15:01:29.676 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2023-06-22T15:01:29.676 DEBUG:teuthology.parallel:result is None
2023-06-22T15:01:49.849 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com
2023-06-22T15:01:49.850 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-22T15:01:54.875 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2023-06-22T15:01:54.875 INFO:teuthology.lock.ops:New key found. Updating...
2023-06-22T15:01:56.560 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server
2023-06-22T15:01:56.561 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com'
2023-06-22T15:01:56.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:02:01.666 DEBUG:teuthology.orchestra.run.smithi019:> true
2023-06-22T15:02:01.851 DEBUG:teuthology.orchestra.run.smithi019:> uname -m
2023-06-22T15:02:01.906 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64
2023-06-22T15:02:01.907 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release
2023-06-22T15:02:01.962 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream"
2023-06-22T15:02:01.962 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31"
2023-06-22T15:02:01.963 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon"
2023-06-22T15:02:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-06-22T15:02:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/"
2023-06-22T15:02:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T15:02:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-06-22T15:02:01.964 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-22T15:02:01.965 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server
2023-06-22T15:02:06.990 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2023-06-22T15:02:06.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2023-06-22T15:02:06.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-06-22T15:02:12.079 DEBUG:teuthology.orchestra.run.smithi107:> true
2023-06-22T15:02:12.207 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2023-06-22T15:02:12.261 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2023-06-22T15:02:12.262 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-06-22T15:02:12.315 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream"
2023-06-22T15:02:12.315 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9"
2023-06-22T15:02:12.315 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-06-22T15:02:12.316 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon"
2023-06-22T15:02:12.317 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-06-22T15:02:12.317 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/"
2023-06-22T15:02:12.317 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-06-22T15:02:12.317 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-06-22T15:02:12.317 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-06-22T15:02:12.318 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-06-22T15:02:17.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:02:17.347 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:02:22.453 INFO:teuthology.dispatcher.supervisor:Running job 7311724
2023-06-22T15:02:22.453 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311724 --name lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311724/orig.config.yaml
2023-06-22T15:02:22.457 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311724
2023-06-22T15:02:22.458 INFO:teuthology.dispatcher.supervisor:Job PID: 19357
2023-06-22T15:02:22.458 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-06-22T15:04:22.507 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:04:22.508 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:06:27.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:06:27.681 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:08:27.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:08:27.854 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:10:33.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:10:33.029 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:12:37.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:12:37.618 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:14:42.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:14:42.793 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:16:47.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-06-22T15:16:47.966 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-06-22T15:16:53.039 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-06-22T15:17:03.153 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-06-22T15:17:03.153 INFO:teuthology.nuke:Checking targets against current locks
2023-06-22T15:17:07.993 DEBUG:teuthology.nuke:shortname: smithi019
2023-06-22T15:17:07.994 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-22T15:17:08.002 DEBUG:teuthology.nuke:shortname: smithi107
2023-06-22T15:17:08.002 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-06-22T15:17:08.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 14:56:32.721330', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHBn5HuuOgyFe2c00A2GqVHbFU8fMYDc9qDZ3yO4fd2qJxqbrSTOy3WzRZNZEeTyaG8Z7hMEkId/FNFA9GSKVRM='}
2023-06-22T15:17:08.023 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2023-06-22_14:52:49-rados-wip-yuri2-testing-2023-06-12-1303-distro-default-smithi/7311724', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-22 14:56:32.722793', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGPappiNO5Alo+nvSnpbQQ1JPhE1mz2hjloQKSOxU4+gonJXGVcwWgazwH7CFlnZvqN8ZDcZyRxzk8QiZajWEVQ='}
2023-06-22T15:17:08.061 INFO:teuthology.orchestra.console:Power off smithi019
2023-06-22T15:17:08.062 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T15:17:08.077 INFO:teuthology.orchestra.console:Power off smithi107
2023-06-22T15:17:08.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-06-22T15:17:13.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:13.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:18.104 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:18.137 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:23.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:23.249 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:23.452 INFO:teuthology.orchestra.console:Power off for smithi019 completed
2023-06-22T15:17:23.599 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com
2023-06-22T15:17:28.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:33.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:38.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:43.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:48.812 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:53.944 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:17:59.055 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:04.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:09.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:14.393 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:19.507 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:24.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-06-22T15:18:25.778 WARNING:teuthology.contextutil:'wait for power off' reached maximum tries (16) after waiting for 60.0 seconds
2023-06-22T15:18:25.779 ERROR:teuthology.orchestra.console:Failed to power off smithi107
2023-06-22T15:18:35.400 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com