2023-07-21T09:59:55.155 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T09:59:55.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T09:59:55.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T09:59:55.318 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac5610c8b0>, signals=[15]) 2023-07-21T09:59:55.320 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2023-07-21T09:59:55.320 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T09:59:55.320 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-21T09:59:55.346 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2023-07-21T09:59:55.347 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2023-07-21T09:59:55.347 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-21T09:59:55.349 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"} 2023-07-21T09:59:55.371 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /host {"name": "smithi154"} 2023-07-21T09:59:55.434 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T09:59:55.437 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-21T09:59:55.478 DEBUG:teuthology.provision.fog.smithi154:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T09:59:55.479 DEBUG:teuthology.provision.fog.smithi154:FOG request: PUT /host/259 {"imageID": 10} 2023-07-21T09:59:55.481 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10) 2023-07-21T09:59:55.482 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 10} 2023-07-21T09:59:55.524 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream 2023-07-21T09:59:55.524 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T09:59:55.529 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of centos 9.stream 2023-07-21T09:59:55.530 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T09:59:55.567 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T09:59:55.570 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /tasktype {"name": "deploy"} 2023-07-21T09:59:55.601 DEBUG:teuthology.provision.fog.smithi154:FOG request: POST /host/259/task {"taskTypeID": 1} 2023-07-21T09:59:55.608 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1} 2023-07-21T09:59:55.733 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T09:59:55.735 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T09:59:55.824 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-21T09:59:55.825 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T09:59:55.839 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-21T09:59:55.840 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T09:59:55.849 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T09:59:55.861 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T09:59:55.982 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-21T09:59:56.083 INFO:teuthology.orchestra.console:Power on smithi150 2023-07-21T09:59:56.084 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T09:59:56.105 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T09:59:59.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:00.128 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:03.988 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:04.198 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-21T10:00:04.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:04.299 INFO:teuthology.orchestra.console:Power on smithi154 2023-07-21T10:00:04.301 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-21T10:00:04.319 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:04.448 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2023-07-21T10:00:04.549 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2023-07-21T10:00:04.550 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:00:08.340 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:12.452 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:00:12.661 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2023-07-21T10:00:12.762 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2023-07-21T10:00:12.763 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:00:19.617 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:00:27.824 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:00:34.680 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:00:42.896 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:00:49.744 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:00:57.960 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:01:04.800 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:01:13.024 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:01:19.864 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:01:28.084 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:01:34.928 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:01:43.144 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:01:49.984 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:01:58.209 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:02:05.046 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:02:13.284 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:02:20.112 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:02:28.358 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:02:35.184 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-07-21T10:02:35.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:02:38.320 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:02:43.416 DEBUG:teuthology.provision.fog.smithi154:FOG request: GET /task/active None 2023-07-21T10:02:43.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:02:44.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:02:46.544 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:02:47.376 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:02:52.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:02:53.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:02:55.600 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:02:56.432 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:03:01.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:02.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:04.688 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:05.492 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:03:10.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:11.494 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:13.744 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:14.544 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:03:19.748 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:20.546 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:22.800 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:23.600 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:03:28.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:29.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:31.856 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:32.656 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-07-21T10:03:37.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:38.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:40.916 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:46.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:03:50.000 WARNING:teuthology.provision.fog.smithi154:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-07-21T10:03:56.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:04:27.610 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T10:04:27.611 DEBUG:teuthology.orchestra.run.smithi154:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T10:04:38.660 WARNING:teuthology.provision.fog.smithi150:timed out 2023-07-21T10:04:44.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:04:44.867 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-21T10:04:44.867 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-21T10:04:45.189 INFO:teuthology.provision.fog.smithi150:Node is ready 2023-07-21T10:04:45.189 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2023-07-21T10:04:45.205 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2023-07-21T10:04:45.205 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2023-07-21T10:04:45.260 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2023-07-21T10:04:45.260 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-07-21T10:04:45.363 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2023-07-21T10:04:45.391 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2023-07-21T10:04:45.459 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2023-07-21T10:04:45.526 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-07-21T10:04:45.592 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-07-21T10:04:45.647 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2023-07-21T10:04:45.648 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2023-07-21T10:04:45.648 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2023-07-21T10:04:45.648 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2023-07-21T10:04:45.649 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2023-07-21T10:04:45.649 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2023-07-21T10:04:45.649 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T10:04:45.649 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-07-21T10:04:45.650 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2023-07-21T10:04:45.650 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T10:04:45.650 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2023-07-21T10:04:45.651 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T10:04:45.651 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T10:04:45.651 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T10:04:45.652 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2023-07-21T10:04:45.654 DEBUG:teuthology.parallel:result is None 2023-07-21T10:04:52.660 INFO:teuthology.provision.fog.smithi154:Node is ready 2023-07-21T10:04:52.661 DEBUG:teuthology.orchestra.run.smithi154:> hostname 2023-07-21T10:04:52.680 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2023-07-21T10:04:52.680 DEBUG:teuthology.orchestra.run.smithi154:> grep smithi154.front.sepia.ceph.com /etc/hosts 2023-07-21T10:04:52.737 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2023-07-21T10:04:52.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-21T10:04:52.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hosts 2023-07-21T10:04:52.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/172.21.15.154/172.21.15.154/g' /etc/hosts 2023-07-21T10:04:52.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i -e 's/smithi154.front.sepia.ceph.com/smithi154/g' /etc/hostname 2023-07-21T10:04:53.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo hostname smithi154 2023-07-21T10:04:53.097 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-21T10:04:53.152 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-21T10:04:53.152 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T10:04:53.153 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T10:04:53.154 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T10:04:53.155 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2023-07-21T10:04:53.155 DEBUG:teuthology.parallel:result is None 2023-07-21T10:04:53.311 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2023-07-21T10:04:53.312 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T10:04:53.343 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2023-07-21T10:04:53.343 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-21T10:04:53.370 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2023-07-21T10:04:53.370 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T10:04:53.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:04:53.453 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-07-21T10:04:53.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-07-21T10:04:53.523 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-07-21T10:04:53.579 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-07-21T10:04:53.579 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-07-21T10:04:53.634 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream" 2023-07-21T10:04:53.634 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-07-21T10:04:53.635 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon" 2023-07-21T10:04:53.636 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T10:04:53.636 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/" 2023-07-21T10:04:53.636 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T10:04:53.636 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T10:04:53.636 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T10:04:53.637 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-07-21T10:04:53.660 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2023-07-21T10:04:53.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-21T10:04:53.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T10:04:53.741 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-07-21T10:04:53.811 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-07-21T10:04:53.811 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-07-21T10:04:53.867 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-07-21T10:04:53.868 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-07-21T10:04:53.922 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="CentOS Stream" 2023-07-21T10:04:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="9" 2023-07-21T10:04:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:ID="centos" 2023-07-21T10:04:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="rhel fedora" 2023-07-21T10:04:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="9" 2023-07-21T10:04:53.923 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el9" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:LOGO="fedora-logo-icon" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://centos.org/" 2023-07-21T10:04:53.924 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T10:04:53.925 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-21T10:04:53.925 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-21T10:04:53.925 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-07-21T10:04:53.951 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:04:53.952 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:04:54.050 INFO:teuthology.dispatcher.supervisor:Running job 7346013 2023-07-21T10:04:54.051 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346013 --name yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} -- /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346013/orig.config.yaml 2023-07-21T10:04:54.054 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346013 2023-07-21T10:04:54.055 INFO:teuthology.dispatcher.supervisor:Job PID: 21091 2023-07-21T10:04:54.055 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-21T10:06:54.152 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:06:54.153 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:08:54.324 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:08:54.325 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:10:54.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:10:54.512 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:12:54.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:12:54.685 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:14:54.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:14:54.853 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:16:55.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:16:55.030 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:18:55.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T10:18:55.197 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None) 2023-07-21T10:18:55.269 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-21T10:18:55.380 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-21T10:18:55.380 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T10:18:55.437 DEBUG:teuthology.nuke:shortname: smithi150 2023-07-21T10:18:55.438 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T10:18:55.459 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346013', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 09:59:54.309405', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMWOc0qFiaKT+R5EBD1JP38O+4DgQPE+FPDv4t9WEb7Q/HAilqSy5Ebc05/jjfNEC3vqtA2qpv2RJmDazf8sdgM='} 2023-07-21T10:18:55.461 DEBUG:teuthology.nuke:shortname: smithi154 2023-07-21T10:18:55.462 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T10:18:55.482 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-21_02:03:58-fs-wip-yuri7-testing-2023-07-20-0727-distro-default-smithi/7346013', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 09:59:54.307276', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOXnij8VUh+bvTI3VHpy5JMyqrtggWcIK7UWkyfKhWitx8LMBwb5ka9gseTbQqkOpZ/NpcaJ34+XwnILwQQ4t9s='} 2023-07-21T10:18:55.517 INFO:teuthology.orchestra.console:Power off smithi150 2023-07-21T10:18:55.518 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T10:18:55.541 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:18:55.561 INFO:teuthology.orchestra.console:Power off smithi154 2023-07-21T10:18:55.562 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T10:18:55.583 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi154.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T10:18:55.673 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-07-21T10:18:55.706 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2023-07-21T10:18:55.827 INFO:teuthology.lock.ops:unlocked: smithi150.front.sepia.ceph.com 2023-07-21T10:18:55.859 INFO:teuthology.lock.ops:unlocked: smithi154.front.sepia.ceph.com