2023-07-16T11:36:55.250 INFO:root:teuthology version: 0.0.1.dev147+gff9991b
2023-07-16T11:36:55.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:36:55.252 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:36:55.406 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f26c67f65b0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f26c617aee0>, signals=[15])
2023-07-16T11:36:55.408 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging
2023-07-16T11:36:55.409 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server
2023-07-16T11:36:55.410 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-16T11:36:55.432 INFO:teuthology.lock.ops:Start node 'smithi188.front.sepia.ceph.com' reimaging
2023-07-16T11:36:55.432 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: reset os type and version on server
2023-07-16T11:36:55.433 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-16T11:36:55.434 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"}
2023-07-16T11:36:55.457 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /host {"name": "smithi188"}
2023-07-16T11:36:55.510 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-16T11:36:55.528 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-16T11:36:55.552 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3)
2023-07-16T11:36:55.553 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 3}
2023-07-16T11:36:55.570 DEBUG:teuthology.provision.fog.smithi188:Requesting image smithi_centos_8.stream (ID 3)
2023-07-16T11:36:55.570 DEBUG:teuthology.provision.fog.smithi188:FOG request: PUT /host/293 {"imageID": 3}
2023-07-16T11:36:55.590 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream
2023-07-16T11:36:55.590 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:36:55.620 INFO:teuthology.provision.fog.smithi188:Scheduling deploy of centos 8.stream
2023-07-16T11:36:55.620 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:36:55.639 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"}
2023-07-16T11:36:55.666 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /tasktype {"name": "deploy"}
2023-07-16T11:36:55.670 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1}
2023-07-16T11:36:55.714 DEBUG:teuthology.provision.fog.smithi188:FOG request: POST /host/293/task {"taskTypeID": 1}
2023-07-16T11:36:55.732 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:36:55.767 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:36:55.815 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-16T11:36:55.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T11:36:55.837 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:36:55.856 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-16T11:36:55.857 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T11:36:55.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:36:55.966 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-16T11:36:56.007 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-16T11:36:56.068 INFO:teuthology.orchestra.console:Power on smithi003
2023-07-16T11:36:56.069 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-16T11:36:56.090 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:36:56.108 INFO:teuthology.orchestra.console:Power on smithi188
2023-07-16T11:36:56.109 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-16T11:36:56.133 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:37:00.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:37:00.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:37:04.236 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:37:04.269 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T11:37:04.447 INFO:teuthology.orchestra.console:Power on for smithi003 completed
2023-07-16T11:37:04.479 INFO:teuthology.orchestra.console:Power on for smithi188 completed
2023-07-16T11:37:04.549 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish
2023-07-16T11:37:04.550 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:37:04.580 INFO:teuthology.provision.fog.smithi188:Waiting for deploy to finish
2023-07-16T11:37:04.581 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:37:19.622 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:37:19.632 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:37:34.696 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:37:34.698 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:37:49.768 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:37:49.769 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:38:04.842 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:38:04.844 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:38:19.912 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:38:19.913 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:38:34.984 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:38:34.986 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:38:50.056 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:38:50.057 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:39:05.125 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:39:05.126 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:39:20.200 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:39:20.201 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:39:35.280 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:39:35.281 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None
2023-07-16T11:39:35.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:39:38.416 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:39:44.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:39:47.473 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:39:50.356 DEBUG:teuthology.provision.fog.smithi188:FOG request: GET /task/active None
2023-07-16T11:39:50.415 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:39:53.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:39:53.492 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:39:56.528 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:39:59.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:02.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:02.576 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:40:05.588 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:40:08.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:11.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:11.632 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:40:14.676 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:40:17.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:20.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:20.688 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:40:23.760 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3
2023-07-16T11:40:26.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:29.744 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:40:29.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:35.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:40:38.804 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:40:44.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:03.220 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:41:09.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:12.308 WARNING:teuthology.provision.fog.smithi188:[Errno None] Unable to connect to port 22 on 172.21.15.188
2023-07-16T11:41:18.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:20.608 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-16T11:41:20.609 DEBUG:teuthology.orchestra.run.smithi188:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-16T11:41:29.764 WARNING:teuthology.provision.fog.smithi003:timed out
2023-07-16T11:41:35.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:36.040 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-16T11:41:36.040 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-16T11:41:36.317 INFO:teuthology.provision.fog.smithi003:Node is ready
2023-07-16T11:41:36.318 DEBUG:teuthology.orchestra.run.smithi003:> hostname
2023-07-16T11:41:36.338 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com
2023-07-16T11:41:36.338 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts
2023-07-16T11:41:36.402 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003
2023-07-16T11:41:36.402 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-16T11:41:36.515 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts
2023-07-16T11:41:36.545 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts
2023-07-16T11:41:36.617 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname
2023-07-16T11:41:36.689 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003
2023-07-16T11:41:36.759 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-16T11:41:36.821 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:41:36.822 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:41:36.823 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:41:36.824 INFO:teuthology.provision.fog.smithi003:Deploy complete!
2023-07-16T11:41:36.825 DEBUG:teuthology.parallel:result is None
2023-07-16T11:41:45.764 INFO:teuthology.provision.fog.smithi188:Node is ready
2023-07-16T11:41:45.764 DEBUG:teuthology.orchestra.run.smithi188:> hostname
2023-07-16T11:41:45.789 INFO:teuthology.orchestra.run.smithi188.stdout:smithi188.front.sepia.ceph.com
2023-07-16T11:41:45.790 DEBUG:teuthology.orchestra.run.smithi188:> grep smithi188.front.sepia.ceph.com /etc/hosts
2023-07-16T11:41:45.850 INFO:teuthology.orchestra.run.smithi188.stdout:172.21.15.188 smithi188.front.sepia.ceph.com smithi188
2023-07-16T11:41:45.851 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-16T11:41:45.970 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hosts
2023-07-16T11:41:46.002 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/172.21.15.188/172.21.15.188/g' /etc/hosts
2023-07-16T11:41:46.071 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i -e 's/smithi188.front.sepia.ceph.com/smithi188/g' /etc/hostname
2023-07-16T11:41:46.142 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname smithi188
2023-07-16T11:41:46.211 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-16T11:41:46.270 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-16T11:41:46.270 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-07-16T11:41:46.270 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:41:46.271 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:41:46.272 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:41:46.272 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:41:46.272 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:41:46.272 INFO:teuthology.provision.fog.smithi188:Deploy complete!
2023-07-16T11:41:46.273 DEBUG:teuthology.parallel:result is None
2023-07-16T11:41:46.463 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com
2023-07-16T11:41:46.464 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-16T11:41:46.508 INFO:teuthology.lock.ops:Checking smithi188.front.sepia.ceph.com
2023-07-16T11:41:46.509 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-16T11:41:46.535 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server
2023-07-16T11:41:46.535 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-16T11:41:46.536 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:46.604 DEBUG:teuthology.orchestra.run.smithi003:> true
2023-07-16T11:41:46.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com'
2023-07-16T11:41:46.683 DEBUG:teuthology.orchestra.run.smithi003:> uname -m
2023-07-16T11:41:46.745 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64
2023-07-16T11:41:46.746 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release
2023-07-16T11:41:46.807 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream"
2023-07-16T11:41:46.807 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8"
2023-07-16T11:41:46.807 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos"
2023-07-16T11:41:46.807 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:41:46.807 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:41:46.808 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:41:46.809 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:41:46.809 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server
2023-07-16T11:41:46.833 INFO:teuthology.lock.ops:Updating [smithi188.front.sepia.ceph.com]: set os type and version on server
2023-07-16T11:41:46.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-16T11:41:46.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-16T11:41:46.900 DEBUG:teuthology.orchestra.run.smithi188:> true
2023-07-16T11:41:46.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com'
2023-07-16T11:41:46.977 DEBUG:teuthology.orchestra.run.smithi188:> uname -m
2023-07-16T11:41:47.037 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64
2023-07-16T11:41:47.037 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream"
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="8"
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos"
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora"
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="8"
2023-07-16T11:41:47.097 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el8"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-16T11:41:47.098 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-16T11:41:47.099 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server
2023-07-16T11:41:47.116 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:41:47.116 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:41:47.217 INFO:teuthology.dispatcher.supervisor:Running job 7341076
2023-07-16T11:41:47.217 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ff9991b7ed74eda9de4a5215d6d7d2a72f7b8d2b/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341076 --name matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi --description fs:verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug session_timeout} ranks/1 tasks/dbench validater/valgrind} -- /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341076/orig.config.yaml
2023-07-16T11:41:47.221 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341076
2023-07-16T11:41:47.222 INFO:teuthology.dispatcher.supervisor:Job PID: 2077
2023-07-16T11:41:47.222 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-16T11:43:47.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:43:47.323 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:45:47.497 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:45:47.498 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:47:47.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:47:47.661 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:49:47.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:49:47.838 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:51:48.022 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:51:48.022 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:53:48.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:53:48.194 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:55:48.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:55:48.366 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:57:48.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:57:48.538 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T11:59:48.709 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T11:59:48.709 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:01:48.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:01:48.886 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:03:49.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:03:49.062 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:05:49.233 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:05:49.233 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:07:49.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:07:49.418 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:09:49.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:09:49.586 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:11:49.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:11:49.755 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:13:49.920 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:13:49.921 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:15:50.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:15:50.092 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:17:50.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:17:50.288 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:19:50.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:19:50.416 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:21:50.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:21:50.622 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:23:50.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:23:50.788 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:25:50.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:25:50.962 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:27:51.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-16T12:27:51.114 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-16T12:27:51.184 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-16T12:27:51.292 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-16T12:27:51.292 INFO:teuthology.nuke:Checking targets against current locks
2023-07-16T12:27:51.342 DEBUG:teuthology.nuke:shortname: smithi003
2023-07-16T12:27:51.342 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-16T12:27:51.364 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:36:54.431232', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFhVuwFQJRN+/Nrs4loNh3k3WIwGZDZ9vSlaUWUa2GeCFIOQPqoXWD4sXjboiAQum5Gh7ll7MQci56X7v0ZtqN17HWZq+uuI+U7EGOzQdqqevrKX97dNldOBAsVVYeI2csIYUvXrntIFYugkVnidsucU1eOBGHxs/9nsz4j3jhkay7bDykBEsyVurdBx2GG+cZols5Jik03CbnrHJLfblxrPE+Z+LU21qNHHPuEML371NMAGcKFwzaeUG5HpIeQVcZ6e/3vzgpL1u1h9LUHGArtfC1wpeyHWAZwKsikq8NnRLF2ai/lrVFGJohll5vraZ8sPWgzKIRFLFcFI17U+j7UeEIrejTMW9Jr58Xgo3PvXtgfBYuiwvo3mKSR2oSQRZwg1W6hbc/+dk6RFBMvO4YUKNGW46nvIQAyxEBmivIxgIkMzxVHPmVCIFHMFhg6+/Md6fMZZyFLN9nwl93Pmkp9/gT7cg0BVLNj75+da74n+9TLapwNQ60SzwdW98DUQs='}
2023-07-16T12:27:51.366 DEBUG:teuthology.nuke:shortname: smithi188
2023-07-16T12:27:51.366 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-16T12:27:51.392 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-16_11:27:03-fs:verify-main-distro-default-smithi/7341076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-16 11:36:54.429834', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJFZAEe8fXT6supDNXvH4IdznOuf9XW0MxDFJrxtwHeRX1Egdz6+/FdCE3PVc7uUWAukEZ4DzcBBlAjwTrjinCo='}
2023-07-16T12:27:51.422 INFO:teuthology.orchestra.console:Power off smithi003
2023-07-16T12:27:51.422 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T12:27:51.438 INFO:teuthology.orchestra.console:Power off smithi188
2023-07-16T12:27:51.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-16T12:27:51.448 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T12:27:51.458 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-16T12:27:51.571 INFO:teuthology.orchestra.console:Power off for smithi003 completed
2023-07-16T12:27:51.579 INFO:teuthology.orchestra.console:Power off for smithi188 completed
2023-07-16T12:27:51.725 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com
2023-07-16T12:27:51.734 INFO:teuthology.lock.ops:unlocked: smithi188.front.sepia.ceph.com