2023-10-06T11:21:49.715 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T11:21:49.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:21:49.866 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4e90564670>, signals=[15]) 2023-10-06T11:21:49.866 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-10-06T11:21:49.866 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:21:49.866 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-06T11:21:49.888 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-10-06T11:21:49.888 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-10-06T11:21:49.888 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-10-06T11:21:49.889 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-10-06T11:21:49.913 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-10-06T11:21:49.966 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T11:21:49.986 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_rhel_8.4"} 2023-10-06T11:21:50.009 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T11:21:50.010 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 7} 2023-10-06T11:21:50.025 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_rhel_8.4 (ID 7) 2023-10-06T11:21:50.026 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 7} 2023-10-06T11:21:50.055 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.4 2023-10-06T11:21:50.055 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:21:50.069 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of rhel 8.4 2023-10-06T11:21:50.069 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:21:50.113 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:21:50.131 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-10-06T11:21:50.149 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-10-06T11:21:50.174 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-10-06T11:21:50.198 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:21:50.270 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:21:50.334 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-06T11:21:50.335 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:21:50.359 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-06T11:21:50.359 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:50.372 INFO:teuthology.orchestra.console.smithi174:Power off 2023-10-06T11:21:50.373 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:21:50.383 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-06T11:21:50.393 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-10-06T11:21:50.393 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:50.415 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T11:21:54.387 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:54.416 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:54.495 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-06T11:21:54.524 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T11:21:58.498 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:58.524 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:58.607 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:21:58.633 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:21:58.707 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-06T11:21:58.734 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-10-06T11:21:58.808 INFO:teuthology.orchestra.console.smithi033:Power on 2023-10-06T11:21:58.809 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:21:58.829 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-10-06T11:21:58.829 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:58.836 INFO:teuthology.orchestra.console.smithi174:Power on 2023-10-06T11:21:58.836 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-06T11:21:58.849 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:21:58.854 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-10-06T11:21:58.855 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:21:58.874 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:22:02.853 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:02.874 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:02.962 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:22:02.983 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:22:06.966 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:06.984 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:07.096 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-10-06T11:22:07.117 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-06T11:22:07.198 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-10-06T11:22:07.218 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-10-06T11:22:07.299 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-10-06T11:22:07.299 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:22:07.319 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-10-06T11:22:07.319 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:22:22.382 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:22:22.385 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:22:37.474 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:22:37.476 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:22:52.550 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:22:52.551 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:23:07.622 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:23:07.624 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:23:22.698 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:23:22.700 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:23:37.766 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:23:37.768 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:23:52.845 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:23:52.847 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:24:07.918 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:24:07.920 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:24:22.998 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:24:23.000 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:24:38.072 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-10-06T11:24:38.074 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:24:38.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:24:53.151 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-10-06T11:24:53.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:24:56.574 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-06T11:25:02.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:05.658 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-06T11:25:11.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:11.674 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:25:14.746 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-06T11:25:17.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:20.730 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:25:20.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:26.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:29.786 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:25:35.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:25:38.878 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-10-06T11:25:44.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:20.782 WARNING:teuthology.provision.fog.smithi033:timed out 2023-10-06T11:26:26.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:27.100 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:26:27.100 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:26:27.392 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-10-06T11:26:27.392 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-10-06T11:26:27.409 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-10-06T11:26:27.409 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-10-06T11:26:27.466 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-10-06T11:26:27.466 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-06T11:26:27.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-10-06T11:26:27.604 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-10-06T11:26:27.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-10-06T11:26:27.737 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-10-06T11:26:27.802 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-06T11:26:27.857 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:26:27.857 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:26:27.857 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-10-06T11:26:27.857 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-10-06T11:26:27.857 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:26:27.858 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:26:27.859 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-10-06T11:26:27.860 DEBUG:teuthology.parallel:result is None 2023-10-06T11:26:44.902 WARNING:teuthology.provision.fog.smithi174:timed out 2023-10-06T11:26:51.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:52.051 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-06T11:26:52.052 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-06T11:26:52.330 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-10-06T11:26:52.330 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-10-06T11:26:52.344 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-10-06T11:26:52.345 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-10-06T11:26:52.403 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-10-06T11:26:52.403 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-10-06T11:26:52.521 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-10-06T11:26:52.546 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-10-06T11:26:52.613 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-10-06T11:26:52.680 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-10-06T11:26:52.745 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-10-06T11:26:52.802 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:26:52.802 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:26:52.802 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-10-06T11:26:52.802 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-10-06T11:26:52.802 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.4" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:26:52.803 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:26:52.804 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-10-06T11:26:52.804 DEBUG:teuthology.parallel:result is None 2023-10-06T11:26:52.952 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-10-06T11:26:52.952 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:26:52.995 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-10-06T11:26:52.996 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-06T11:26:53.013 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:26:53.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:26:53.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:53.085 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-06T11:26:53.214 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-06T11:26:53.214 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-06T11:26:53.270 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-06T11:26:53.270 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-06T11:26:53.325 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:26:53.326 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:26:53.327 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-06T11:26:53.327 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:26:53.327 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:26:53.327 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:26:53.327 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:26:53.327 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-06T11:26:53.353 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-10-06T11:26:53.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T11:26:53.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:26:53.425 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-10-06T11:26:53.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-10-06T11:26:53.492 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-10-06T11:26:53.549 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-10-06T11:26:53.549 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-10-06T11:26:53.605 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T11:26:53.605 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T11:26:53.605 INFO:teuthology.orchestra.run.smithi174.stdout:ID="rhel" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="fedora" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8.4" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout: 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T11:26:53.606 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T11:26:53.607 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T11:26:53.607 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T11:26:53.607 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-10-06T11:26:53.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:26:53.718 INFO:teuthology.dispatcher.supervisor:Running job 7412416 2023-10-06T11:26:53.718 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412416 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/truncate_delay} -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412416/orig.config.yaml 2023-10-06T11:26:53.721 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412416 2023-10-06T11:26:53.721 INFO:teuthology.dispatcher.supervisor:Job PID: 1577637 2023-10-06T11:26:53.722 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-06T11:28:53.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:30:53.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:32:54.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:34:54.319 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:36:54.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:38:54.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:40:54.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:42:54.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:44:55.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:44:55.249 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-06T11:44:55.417 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-06T11:44:55.417 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T11:44:55.467 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-06T11:44:55.467 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:44:55.487 DEBUG:teuthology.nuke:shortname: smithi174 2023-10-06T11:44:55.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:44:55.490 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412416', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:21:48.911036', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIioQ9dqv3CBe79qez/D41L2gtCx/gueDdHaBpFv4u4RXuz+9IarXNoj8/rzQ9Eb9A5DTMf7mKMND520+OzHMoo='} 2023-10-06T11:44:55.508 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412416', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 11:21:48.912847', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEV8SQOxK8dNT6oR7geHA7HXO9jl0HO2RppFDr4PV7T3MmcqnLTGid5hsaZ4W5+6PO5i1Mh/zO1v+zfbMasJ6gc='} 2023-10-06T11:44:55.535 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-06T11:44:55.535 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:44:55.556 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-06T11:44:55.557 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:44:55.571 INFO:teuthology.orchestra.console.smithi174:Power off 2023-10-06T11:44:55.572 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:44:55.580 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-06T11:44:55.594 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-10-06T11:44:55.594 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:44:55.618 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-10-06T11:44:55.681 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-06T11:44:55.719 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-10-06T11:44:55.831 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-10-06T11:44:55.863 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com