2023-08-04T18:33:45.304 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-04T18:33:45.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:33:45.441 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f950d87cf70>, signals=[15]) 2023-08-04T18:33:45.442 INFO:teuthology.lock.ops:Start node 'smithi049.front.sepia.ceph.com' reimaging 2023-08-04T18:33:45.443 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T18:33:45.443 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-08-04T18:33:45.466 INFO:teuthology.lock.ops:Start node 'smithi087.front.sepia.ceph.com' reimaging 2023-08-04T18:33:45.466 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: reset os type and version on server 2023-08-04T18:33:45.466 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-08-04T18:33:45.468 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /host {"name": "smithi049"} 2023-08-04T18:33:45.491 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /host {"name": "smithi087"} 2023-08-04T18:33:45.534 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-04T18:33:45.545 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-04T18:33:45.571 DEBUG:teuthology.provision.fog.smithi049:Requesting image smithi_centos_8.stream (ID 3) 2023-08-04T18:33:45.572 DEBUG:teuthology.provision.fog.smithi049:FOG request: PUT /host/154 {"imageID": 3} 2023-08-04T18:33:45.586 DEBUG:teuthology.provision.fog.smithi087:Requesting image smithi_centos_8.stream (ID 3) 2023-08-04T18:33:45.586 DEBUG:teuthology.provision.fog.smithi087:FOG request: PUT /host/192 {"imageID": 3} 2023-08-04T18:33:45.616 INFO:teuthology.provision.fog.smithi049:Scheduling deploy of centos 8.stream 2023-08-04T18:33:45.616 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:33:45.629 INFO:teuthology.provision.fog.smithi087:Scheduling deploy of centos 8.stream 2023-08-04T18:33:45.630 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:33:45.671 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T18:33:45.683 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /tasktype {"name": "deploy"} 2023-08-04T18:33:45.702 DEBUG:teuthology.provision.fog.smithi049:FOG request: POST /host/154/task {"taskTypeID": 1} 2023-08-04T18:33:45.725 DEBUG:teuthology.provision.fog.smithi087:FOG request: POST /host/192/task {"taskTypeID": 1} 2023-08-04T18:33:45.750 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:33:45.771 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:33:45.838 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-04T18:33:45.839 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T18:33:45.854 INFO:teuthology.orchestra.console.smithi087:Power off 2023-08-04T18:33:45.855 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T18:33:45.864 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-04T18:33:45.865 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:45.876 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-08-04T18:33:45.877 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:45.887 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-04T18:33:45.898 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-08-04T18:33:49.888 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:49.899 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:49.998 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-04T18:33:50.011 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-08-04T18:33:54.004 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:54.012 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:54.114 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-04T18:33:54.122 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-08-04T18:33:54.216 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-04T18:33:54.317 INFO:teuthology.orchestra.console.smithi049:Power on 2023-08-04T18:33:54.317 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T18:33:54.339 DEBUG:teuthology.orchestra.console.smithi049:power on output: Chassis Power Control: Up/On 2023-08-04T18:33:54.340 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:54.360 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-04T18:33:58.125 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:58.235 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-08-04T18:33:58.336 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-08-04T18:33:58.362 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:58.437 INFO:teuthology.orchestra.console.smithi087:Power on 2023-08-04T18:33:58.438 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-04T18:33:58.459 DEBUG:teuthology.orchestra.console.smithi087:power on output: Chassis Power Control: Up/On 2023-08-04T18:33:58.460 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:33:58.471 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-04T18:33:58.481 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-08-04T18:34:02.476 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:34:02.483 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T18:34:02.586 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is on 2023-08-04T18:34:02.593 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is on 2023-08-04T18:34:02.687 INFO:teuthology.orchestra.console.smithi049:Power on completed 2023-08-04T18:34:02.695 INFO:teuthology.orchestra.console.smithi087:Power on completed 2023-08-04T18:34:02.789 INFO:teuthology.provision.fog.smithi049:Waiting for deploy to finish 2023-08-04T18:34:02.789 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:34:02.796 INFO:teuthology.provision.fog.smithi087:Waiting for deploy to finish 2023-08-04T18:34:02.796 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:34:17.860 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:34:17.861 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:34:32.932 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:34:32.933 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:34:48.001 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:34:48.002 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:35:03.076 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:35:03.077 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:35:18.148 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:35:18.150 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:35:33.224 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:35:33.225 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:35:48.296 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:35:48.297 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:36:03.372 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:36:03.374 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:36:18.460 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:36:18.461 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:36:33.536 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:36:33.537 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:36:48.616 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:36:48.617 DEBUG:teuthology.provision.fog.smithi087:FOG request: GET /task/active None 2023-08-04T18:36:48.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:03.688 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:37:07.056 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-08-04T18:37:13.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:16.112 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-08-04T18:37:18.755 DEBUG:teuthology.provision.fog.smithi049:FOG request: GET /task/active None 2023-08-04T18:37:18.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:22.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:25.168 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-08-04T18:37:31.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:34.256 WARNING:teuthology.provision.fog.smithi087:[Errno None] Unable to connect to port 22 on 172.21.15.87 2023-08-04T18:37:37.264 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:37:40.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:43.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:46.320 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:37:52.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:37:55.376 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:01.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:04.464 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:10.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:13.552 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:19.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:22.644 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:28.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:31.728 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:37.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:40.264 WARNING:teuthology.provision.fog.smithi087:timed out 2023-08-04T18:38:40.784 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:46.268 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:46.510 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T18:38:46.510 DEBUG:teuthology.orchestra.run.smithi087:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T18:38:46.753 INFO:teuthology.provision.fog.smithi087:Node is ready 2023-08-04T18:38:46.754 DEBUG:teuthology.orchestra.run.smithi087:> hostname 2023-08-04T18:38:46.773 INFO:teuthology.orchestra.run.smithi087.stdout:smithi087.front.sepia.ceph.com 2023-08-04T18:38:46.773 DEBUG:teuthology.orchestra.run.smithi087:> grep smithi087.front.sepia.ceph.com /etc/hosts 2023-08-04T18:38:46.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:38:46.833 INFO:teuthology.orchestra.run.smithi087.stdout:172.21.15.87 smithi087.front.sepia.ceph.com smithi087 2023-08-04T18:38:46.833 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-08-04T18:38:46.933 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hosts 2023-08-04T18:38:46.962 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/172.21.15.87/172.21.15.87/g' /etc/hosts 2023-08-04T18:38:47.029 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i -e 's/smithi087.front.sepia.ceph.com/smithi087/g' /etc/hostname 2023-08-04T18:38:47.098 DEBUG:teuthology.orchestra.run.smithi087:> sudo hostname smithi087 2023-08-04T18:38:47.167 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-08-04T18:38:47.225 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2023-08-04T18:38:47.225 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8" 2023-08-04T18:38:47.225 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2023-08-04T18:38:47.225 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T18:38:47.226 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T18:38:47.227 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T18:38:47.227 INFO:teuthology.provision.fog.smithi087:Deploy complete! 2023-08-04T18:38:47.229 DEBUG:teuthology.parallel:result is None 2023-08-04T18:38:49.844 WARNING:teuthology.provision.fog.smithi049:[Errno None] Unable to connect to port 22 on 172.21.15.49 2023-08-04T18:38:55.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:39:55.908 WARNING:teuthology.provision.fog.smithi049:timed out 2023-08-04T18:40:01.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:40:02.176 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-04T18:40:02.176 DEBUG:teuthology.orchestra.run.smithi049:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-04T18:40:02.455 INFO:teuthology.provision.fog.smithi049:Node is ready 2023-08-04T18:40:02.455 DEBUG:teuthology.orchestra.run.smithi049:> hostname 2023-08-04T18:40:02.474 INFO:teuthology.orchestra.run.smithi049.stdout:smithi049.front.sepia.ceph.com 2023-08-04T18:40:02.475 DEBUG:teuthology.orchestra.run.smithi049:> grep smithi049.front.sepia.ceph.com /etc/hosts 2023-08-04T18:40:02.536 INFO:teuthology.orchestra.run.smithi049.stdout:172.21.15.49 smithi049.front.sepia.ceph.com smithi049 2023-08-04T18:40:02.536 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-04T18:40:02.630 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hosts 2023-08-04T18:40:02.660 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/172.21.15.49/172.21.15.49/g' /etc/hosts 2023-08-04T18:40:02.729 DEBUG:teuthology.orchestra.run.smithi049:> sudo sed -i -e 's/smithi049.front.sepia.ceph.com/smithi049/g' /etc/hostname 2023-08-04T18:40:02.797 DEBUG:teuthology.orchestra.run.smithi049:> sudo hostname smithi049 2023-08-04T18:40:02.865 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-08-04T18:40:02.922 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-04T18:40:02.923 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-08-04T18:40:02.924 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-04T18:40:02.924 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-08-04T18:40:02.924 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T18:40:02.924 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T18:40:02.924 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T18:40:02.925 INFO:teuthology.provision.fog.smithi049:Deploy complete! 2023-08-04T18:40:02.925 DEBUG:teuthology.parallel:result is None 2023-08-04T18:40:03.062 INFO:teuthology.lock.ops:Checking smithi049.front.sepia.ceph.com 2023-08-04T18:40:03.063 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T18:40:03.084 INFO:teuthology.lock.ops:Checking smithi087.front.sepia.ceph.com 2023-08-04T18:40:03.084 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-04T18:40:03.102 INFO:teuthology.lock.ops:Updating [smithi049.front.sepia.ceph.com]: set os type and version on server 2023-08-04T18:40:03.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-08-04T18:40:03.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi049.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:40:03.170 DEBUG:teuthology.orchestra.run.smithi049:> true 2023-08-04T18:40:03.241 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi049.front.sepia.ceph.com' 2023-08-04T18:40:03.242 DEBUG:teuthology.orchestra.run.smithi049:> uname -m 2023-08-04T18:40:03.299 INFO:teuthology.orchestra.run.smithi049.stdout:x86_64 2023-08-04T18:40:03.299 DEBUG:teuthology.orchestra.run.smithi049:> cat /etc/os-release 2023-08-04T18:40:03.357 INFO:teuthology.orchestra.run.smithi049.stdout:NAME="CentOS Stream" 2023-08-04T18:40:03.357 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION="8" 2023-08-04T18:40:03.357 INFO:teuthology.orchestra.run.smithi049.stdout:ID="centos" 2023-08-04T18:40:03.357 INFO:teuthology.orchestra.run.smithi049.stdout:ID_LIKE="rhel fedora" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:VERSION_ID="8" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:PLATFORM_ID="platform:el8" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:ANSI_COLOR="0;31" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:HOME_URL="https://centos.org/" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T18:40:03.358 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T18:40:03.359 INFO:teuthology.orchestra.run.smithi049.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T18:40:03.359 INFO:teuthology.lock.ops:Updating smithi049.front.sepia.ceph.com on lock server 2023-08-04T18:40:03.393 INFO:teuthology.lock.ops:Updating [smithi087.front.sepia.ceph.com]: set os type and version on server 2023-08-04T18:40:03.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-08-04T18:40:03.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-04T18:40:03.461 DEBUG:teuthology.orchestra.run.smithi087:> true 2023-08-04T18:40:03.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi087.front.sepia.ceph.com' 2023-08-04T18:40:03.600 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2023-08-04T18:40:03.658 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2023-08-04T18:40:03.658 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2023-08-04T18:40:03.717 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="CentOS Stream" 2023-08-04T18:40:03.717 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="8" 2023-08-04T18:40:03.717 INFO:teuthology.orchestra.run.smithi087.stdout:ID="centos" 2023-08-04T18:40:03.717 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE="rhel fedora" 2023-08-04T18:40:03.717 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="8" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:PLATFORM_ID="platform:el8" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:ANSI_COLOR="0;31" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://centos.org/" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-04T18:40:03.718 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-04T18:40:03.719 INFO:teuthology.orchestra.run.smithi087.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-04T18:40:03.719 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2023-08-04T18:40:03.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:40:03.832 INFO:teuthology.dispatcher.supervisor:Running job 7361247 2023-08-04T18:40:03.832 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361247 --name pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/fragment} -- /home/teuthworker/archive/pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361247/orig.config.yaml 2023-08-04T18:40:03.836 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361247 2023-08-04T18:40:03.837 INFO:teuthology.dispatcher.supervisor:Job PID: 29146 2023-08-04T18:40:03.838 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-04T18:42:03.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:44:04.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:46:04.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:48:04.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:50:04.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:52:04.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:54:04.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:56:04.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T18:58:05.129 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:00:05.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:02:05.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:04:05.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:06:05.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-04T19:06:05.846 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-04T19:06:05.943 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-04T19:06:05.944 INFO:teuthology.nuke:Checking targets against current locks 2023-08-04T19:06:05.990 DEBUG:teuthology.nuke:shortname: smithi049 2023-08-04T19:06:05.991 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T19:06:06.007 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi049.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361247', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 18:33:44.498371', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDgBYddhP24aF4S9nDQzMkpHHoCYPmzGzsFD9nDoSgNtDiDaY3g+psGcKMW4RvkZk9QDdUA0Y6nSPFyXiAFoVVbqQYiZZIQs91LuJK+MyjFmZtHcHqCDspp4HQaBurRZ6OsCDLzrzv4GTQ+dEeMQVSUk7eBhjWu90WglXCyQ39j2f2inL+ZEg2GAwEvVDmzClfNTc5xRKxscp0xqCvGwX+B5KTouJTm80qM8RsA8V4AlqC5OXtitgEEmc2Nrd4uc1sLKtORbJZ/pxDsxFkBLL+NTLBsIOcRDieTACGCpJQlMo9gJ22QrsYIJD00VUJ9hselI2OpKzPfeircBcX0PK0sYFupSIAMR4nYs14DAx2Cr7jg/fU5HjQznA9AFrvSA2sr1p4fAX9v+AyNfG5Y2w1g608VPklPEzsPXNlggWDxk9jbiRND5vGsJvfsLMz5WtwkdFdPPMvHHn1FYenQRGFdKoaSNWkOKhbLCjZFGOMQUb2icAejw1pgZStz9MvNovU='} 2023-08-04T19:06:06.009 DEBUG:teuthology.nuke:shortname: smithi087 2023-08-04T19:06:06.010 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-04T19:06:06.029 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi087.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-04_18:27:04-fs-wip-batrick-testing-20230803.140718-distro-default-smithi/7361247', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-04 18:33:44.500145', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf1sxLm1YaIkQ7hx00n+ZtzQzrA6j+FW81orBcnWGbVY1XaCqHWIrsdFGynBSFSQ/ocelPTjt1sxB06YGKWlOr/x1sg0/6C6CAXGypHsCgcvL8CSmKXEMyxtHzO1uC9BN8HyXgejUUYUBeF7a/xADqlxSgAT+3AOJss3Q5Le64bd8sjlocEonExItj8ey4/aAFYb5SvoGlNkvVgIF/k3svta4Gt2H5xWKTvqXBl3xCCpmQFUPWoP0blpO6C3URcYEzWrjF7Uf62SYewE5C0Mqqs1HMp+GYHp3wtWpK7nzpd4U8UF9hMfJDhzZWbJ3xsh+CYZ6pldX36x990ox7SA8J4mt/ZsrGzmo9JOLBsqjyaSu17ime18mvHufC+hkiwOqgnYL1/bD9IBlr1uoD9R39tCDtBNmKMuIbJMwEuxcaYtnhnRJ2t8YjG/2i2/HAsNomNhIN+2B21G/q+VYGIzna+fJc2crKs7GmDwqL+tTd7sgL+60PV/m/0T1Cxq+K8OU='} 2023-08-04T19:06:06.055 INFO:teuthology.orchestra.console.smithi049:Power off 2023-08-04T19:06:06.055 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:06:06.076 DEBUG:teuthology.orchestra.console.smithi049:power off output: Chassis Power Control: Down/Off 2023-08-04T19:06:06.077 DEBUG:teuthology.orchestra.console.smithi049:pexpect command: ipmitool -H smithi049.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:06:06.095 INFO:teuthology.orchestra.console.smithi087:Power off 2023-08-04T19:06:06.095 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-04T19:06:06.106 DEBUG:teuthology.orchestra.console.smithi049:check power output: Chassis Power is off 2023-08-04T19:06:06.117 DEBUG:teuthology.orchestra.console.smithi087:power off output: Chassis Power Control: Down/Off 2023-08-04T19:06:06.118 DEBUG:teuthology.orchestra.console.smithi087:pexpect command: ipmitool -H smithi087.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-04T19:06:06.139 DEBUG:teuthology.orchestra.console.smithi087:check power output: Chassis Power is off 2023-08-04T19:06:06.208 INFO:teuthology.orchestra.console.smithi049:Power off completed 2023-08-04T19:06:06.241 INFO:teuthology.orchestra.console.smithi087:Power off completed 2023-08-04T19:06:06.364 INFO:teuthology.lock.ops:unlocked: smithi049.front.sepia.ceph.com 2023-08-04T19:06:06.386 INFO:teuthology.lock.ops:unlocked: smithi087.front.sepia.ceph.com