2023-10-10T09:45:41.198 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-10T09:45:41.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:45:41.344 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa059de5670>, signals=[15]) 2023-10-10T09:45:41.346 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2023-10-10T09:45:41.346 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T09:45:41.347 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-10T09:45:41.368 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2023-10-10T09:45:41.369 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2023-10-10T09:45:41.369 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-10T09:45:41.370 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /host {"name": "smithi017"} 2023-10-10T09:45:41.392 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /host {"name": "smithi124"} 2023-10-10T09:45:41.445 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T09:45:41.472 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-10T09:45:41.493 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T09:45:41.493 DEBUG:teuthology.provision.fog.smithi017:FOG request: PUT /host/123 {"imageID": 7} 2023-10-10T09:45:41.517 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-10T09:45:41.518 DEBUG:teuthology.provision.fog.smithi124:FOG request: PUT /host/229 {"imageID": 7} 2023-10-10T09:45:41.540 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of rhel 8.4 2023-10-10T09:45:41.540 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:45:41.563 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.4 2023-10-10T09:45:41.563 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:45:41.607 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T09:45:41.624 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /tasktype {"name": "deploy"} 2023-10-10T09:45:41.645 DEBUG:teuthology.provision.fog.smithi017:FOG request: POST /host/123/task {"taskTypeID": 1} 2023-10-10T09:45:41.657 DEBUG:teuthology.provision.fog.smithi124:FOG request: POST /host/229/task {"taskTypeID": 1} 2023-10-10T09:45:41.705 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:45:41.709 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:45:41.807 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-10T09:45:41.808 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:45:41.826 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-10T09:45:41.826 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T09:45:41.835 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-10T09:45:41.836 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:41.848 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-10T09:45:41.849 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:41.858 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-10T09:45:41.876 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-10T09:45:45.862 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:45.877 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:45.972 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-10T09:45:45.987 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-10T09:45:49.974 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:49.989 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:50.084 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-10T09:45:50.098 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-10T09:45:50.186 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-10T09:45:50.287 INFO:teuthology.orchestra.console.smithi017:Power on 2023-10-10T09:45:50.287 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T09:45:50.339 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2023-10-10T09:45:50.339 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:50.364 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-10T09:45:54.102 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:54.211 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-10T09:45:54.312 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-10T09:45:54.365 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:54.413 INFO:teuthology.orchestra.console.smithi124:Power on 2023-10-10T09:45:54.414 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-10T09:45:54.436 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On 2023-10-10T09:45:54.437 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:54.458 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-10T09:45:54.475 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-10T09:45:58.462 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:58.475 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T09:45:58.573 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on 2023-10-10T09:45:58.586 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2023-10-10T09:45:58.674 INFO:teuthology.orchestra.console.smithi124:Power on completed 2023-10-10T09:45:58.687 INFO:teuthology.orchestra.console.smithi017:Power on completed 2023-10-10T09:45:58.776 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2023-10-10T09:45:58.776 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:45:58.789 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2023-10-10T09:45:58.789 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:46:13.870 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:46:13.871 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:46:28.966 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:46:28.968 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:46:44.078 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:46:44.080 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:46:59.182 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:46:59.183 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:47:14.278 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:47:14.280 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:47:29.402 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:47:29.404 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:47:44.502 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:47:44.504 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:47:59.602 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:47:59.604 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:48:14.719 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:48:14.720 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:48:29.838 DEBUG:teuthology.provision.fog.smithi017:FOG request: GET /task/active None 2023-10-10T09:48:29.840 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:48:29.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:48:44.950 DEBUG:teuthology.provision.fog.smithi124:FOG request: GET /task/active None 2023-10-10T09:48:45.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:48:48.382 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-10T09:48:54.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:48:57.466 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-10T09:49:03.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:03.482 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-10T09:49:06.554 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-10T09:49:09.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:12.538 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-10T09:49:12.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:15.610 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2023-10-10T09:49:18.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:21.598 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-10T09:49:21.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:27.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:49:30.682 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124 2023-10-10T09:49:36.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:50:21.658 WARNING:teuthology.provision.fog.smithi017:timed out 2023-10-10T09:50:27.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:50:27.948 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T09:50:27.949 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T09:50:28.254 INFO:teuthology.provision.fog.smithi017:Node is ready 2023-10-10T09:50:28.255 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2023-10-10T09:50:28.270 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2023-10-10T09:50:28.271 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2023-10-10T09:50:28.326 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2023-10-10T09:50:28.326 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-10T09:50:28.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2023-10-10T09:50:28.476 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2023-10-10T09:50:28.542 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2023-10-10T09:50:28.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2023-10-10T09:50:28.673 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-10T09:50:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:50:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:50:28.728 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-10T09:50:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-10T09:50:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.4" 2023-10-10T09:50:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:50:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:50:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-10T09:50:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:50:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:50:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:50:28.730 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:50:28.731 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-10T09:50:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:50:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:50:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:50:28.731 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:50:28.732 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2023-10-10T09:50:28.733 DEBUG:teuthology.parallel:result is None 2023-10-10T09:50:36.694 WARNING:teuthology.provision.fog.smithi124:timed out 2023-10-10T09:50:42.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:50:43.014 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-10T09:50:43.014 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-10T09:50:43.302 INFO:teuthology.provision.fog.smithi124:Node is ready 2023-10-10T09:50:43.303 DEBUG:teuthology.orchestra.run.smithi124:> hostname 2023-10-10T09:50:43.318 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2023-10-10T09:50:43.318 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts 2023-10-10T09:50:43.373 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2023-10-10T09:50:43.373 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-10T09:50:43.479 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts 2023-10-10T09:50:43.505 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts 2023-10-10T09:50:43.568 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname 2023-10-10T09:50:43.630 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124 2023-10-10T09:50:43.691 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-10T09:50:43.743 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:50:43.744 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:50:43.744 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-10T09:50:43.744 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-10T09:50:43.744 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-10-10T09:50:43.744 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:50:43.745 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:50:43.745 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-10T09:50:43.745 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:50:43.745 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:50:43.745 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:50:43.746 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:50:43.746 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-10T09:50:43.746 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:50:43.746 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:50:43.746 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:50:43.747 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:50:43.747 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2023-10-10T09:50:43.747 DEBUG:teuthology.parallel:result is None 2023-10-10T09:50:43.894 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2023-10-10T09:50:43.895 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T09:50:43.918 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2023-10-10T09:50:43.919 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-10T09:50:43.936 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2023-10-10T09:50:43.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-10T09:50:43.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:50:44.009 DEBUG:teuthology.orchestra.run.smithi017:> true 2023-10-10T09:50:44.133 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2023-10-10T09:50:44.134 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2023-10-10T09:50:44.189 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2023-10-10T09:50:44.189 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2023-10-10T09:50:44.245 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:50:44.245 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:50:44.246 INFO:teuthology.orchestra.run.smithi017.stdout:ID="rhel" 2023-10-10T09:50:44.246 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="fedora" 2023-10-10T09:50:44.246 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8.4" 2023-10-10T09:50:44.246 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:50:44.246 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:50:44.247 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2023-10-10T09:50:44.247 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:50:44.247 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:50:44.247 INFO:teuthology.orchestra.run.smithi017.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:50:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:50:44.248 INFO:teuthology.orchestra.run.smithi017.stdout: 2023-10-10T09:50:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:50:44.248 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:50:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:50:44.249 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:50:44.249 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2023-10-10T09:50:44.269 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2023-10-10T09:50:44.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-10T09:50:44.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-10T09:50:44.333 DEBUG:teuthology.orchestra.run.smithi124:> true 2023-10-10T09:50:44.401 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com' 2023-10-10T09:50:44.401 DEBUG:teuthology.orchestra.run.smithi124:> uname -m 2023-10-10T09:50:44.457 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2023-10-10T09:50:44.457 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release 2023-10-10T09:50:44.511 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2023-10-10T09:50:44.512 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.4 (Ootpa)" 2023-10-10T09:50:44.512 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2023-10-10T09:50:44.512 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2023-10-10T09:50:44.512 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.4" 2023-10-10T09:50:44.512 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2023-10-10T09:50:44.513 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-10T09:50:44.513 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2023-10-10T09:50:44.513 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-10T09:50:44.513 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2023-10-10T09:50:44.513 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-10T09:50:44.514 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-10T09:50:44.514 INFO:teuthology.orchestra.run.smithi124.stdout: 2023-10-10T09:50:44.514 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-10T09:50:44.514 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-10T09:50:44.514 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-10T09:50:44.515 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-10T09:50:44.515 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2023-10-10T09:50:44.536 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:50:44.629 INFO:teuthology.dispatcher.supervisor:Running job 7419479 2023-10-10T09:50:44.629 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419479 --name yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} -- /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419479/orig.config.yaml 2023-10-10T09:50:44.633 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419479 2023-10-10T09:50:44.633 INFO:teuthology.dispatcher.supervisor:Job PID: 697712 2023-10-10T09:50:44.634 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-10T09:52:44.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:54:44.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:56:45.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T09:58:45.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:00:45.383 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:02:45.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:04:45.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:06:45.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:08:46.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-10T10:08:46.095 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-10T10:08:46.206 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-10T10:08:46.206 INFO:teuthology.nuke:Checking targets against current locks 2023-10-10T10:08:46.253 DEBUG:teuthology.nuke:shortname: smithi017 2023-10-10T10:08:46.254 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T10:08:46.279 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 09:45:40.332101', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhPSkhDOBaKI+Icmx7MOEDbEIq6U2ZmA3XOJK4xOIpuHCzQadZ9jKZ4QfF1uJWEOMdpnCNA+qdyehPo4CUPU1E='} 2023-10-10T10:08:46.282 DEBUG:teuthology.nuke:shortname: smithi124 2023-10-10T10:08:46.282 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-10T10:08:46.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-10_04:31:01-fs-wip-yuri3-testing-2023-10-09-0727-quincy-distro-default-smithi/7419479', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-10 09:45:40.330778', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAyBi/JRMka1mQRlIH2Rt4ih5Z4tkLNlWwO6ox49C0WfhyUgSZL2LzjaonEAALxvXpHRd/IaDHzk0yYSONztpQ='} 2023-10-10T10:08:46.327 INFO:teuthology.orchestra.console.smithi017:Power off 2023-10-10T10:08:46.328 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:08:46.349 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2023-10-10T10:08:46.349 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:08:46.364 INFO:teuthology.orchestra.console.smithi124:Power off 2023-10-10T10:08:46.365 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-10T10:08:46.373 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2023-10-10T10:08:46.385 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off 2023-10-10T10:08:46.386 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-10T10:08:46.408 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off 2023-10-10T10:08:46.474 INFO:teuthology.orchestra.console.smithi017:Power off completed 2023-10-10T10:08:46.510 INFO:teuthology.orchestra.console.smithi124:Power off completed 2023-10-10T10:08:46.628 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2023-10-10T10:08:46.660 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com