2023-09-05T19:41:02.342 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-05T19:41:02.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:41:02.490 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f40b4559d30>, signals=[15]) 2023-09-05T19:41:02.492 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2023-09-05T19:41:02.492 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T19:41:02.492 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-05T19:41:02.518 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2023-09-05T19:41:02.518 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2023-09-05T19:41:02.518 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-09-05T19:41:02.520 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /host {"name": "smithi044"} 2023-09-05T19:41:02.543 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /host {"name": "smithi062"} 2023-09-05T19:41:02.596 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-05T19:41:02.600 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-05T19:41:02.637 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-05T19:41:02.637 DEBUG:teuthology.provision.fog.smithi044:FOG request: PUT /host/149 {"imageID": 5} 2023-09-05T19:41:02.640 DEBUG:teuthology.provision.fog.smithi062:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-05T19:41:02.640 DEBUG:teuthology.provision.fog.smithi062:FOG request: PUT /host/167 {"imageID": 5} 2023-09-05T19:41:02.680 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6 2023-09-05T19:41:02.680 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:41:02.690 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of rhel 8.6 2023-09-05T19:41:02.690 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:41:02.742 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T19:41:02.746 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /tasktype {"name": "deploy"} 2023-09-05T19:41:02.783 DEBUG:teuthology.provision.fog.smithi062:FOG request: POST /host/167/task {"taskTypeID": 1} 2023-09-05T19:41:02.787 DEBUG:teuthology.provision.fog.smithi044:FOG request: POST /host/149/task {"taskTypeID": 1} 2023-09-05T19:41:02.839 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:41:02.844 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:41:02.931 INFO:teuthology.orchestra.console.smithi044:Power off 2023-09-05T19:41:02.932 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T19:41:02.944 INFO:teuthology.orchestra.console.smithi062:Power off 2023-09-05T19:41:02.945 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T19:41:02.955 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-09-05T19:41:02.956 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:02.967 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-09-05T19:41:02.968 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:02.978 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-05T19:41:02.987 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-09-05T19:41:06.984 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:06.992 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:07.094 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-05T19:41:07.100 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-09-05T19:41:11.099 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:11.105 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:11.208 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-05T19:41:11.213 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-09-05T19:41:11.314 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-09-05T19:41:11.415 INFO:teuthology.orchestra.console.smithi062:Power on 2023-09-05T19:41:11.415 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T19:41:11.435 DEBUG:teuthology.orchestra.console.smithi062:power on output: Chassis Power Control: Up/On 2023-09-05T19:41:11.435 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:11.457 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-09-05T19:41:15.210 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:15.318 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-05T19:41:15.419 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-09-05T19:41:15.458 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:15.519 INFO:teuthology.orchestra.console.smithi044:Power on 2023-09-05T19:41:15.520 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-05T19:41:15.539 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2023-09-05T19:41:15.540 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:15.558 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-05T19:41:15.565 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-09-05T19:41:19.564 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:19.570 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T19:41:19.672 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2023-09-05T19:41:19.677 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2023-09-05T19:41:19.774 INFO:teuthology.orchestra.console.smithi044:Power on completed 2023-09-05T19:41:19.778 INFO:teuthology.orchestra.console.smithi062:Power on completed 2023-09-05T19:41:19.875 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2023-09-05T19:41:19.875 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:41:19.879 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2023-09-05T19:41:19.879 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:41:35.002 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:41:35.003 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:41:50.111 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:41:50.113 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:42:05.211 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:42:05.217 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:42:20.318 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:42:20.320 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:42:35.414 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:42:35.419 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:42:50.536 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:42:50.539 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:43:05.662 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:43:05.664 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:43:20.795 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:43:20.797 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:43:35.954 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:43:35.957 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:43:51.092 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:43:51.093 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:44:06.221 DEBUG:teuthology.provision.fog.smithi044:FOG request: GET /task/active None 2023-09-05T19:44:06.222 DEBUG:teuthology.provision.fog.smithi062:FOG request: GET /task/active None 2023-09-05T19:44:06.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:06.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:24.730 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:44:24.731 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-05T19:44:30.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:30.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:33.818 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:44:33.819 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-05T19:44:39.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:39.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:42.906 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:44:42.906 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-05T19:44:48.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:48.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:51.994 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:44:51.994 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2023-09-05T19:44:57.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:44:57.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:45:16.442 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:45:22.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:45:25.498 WARNING:teuthology.provision.fog.smithi062:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-09-05T19:45:31.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:45:32.901 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T19:45:32.902 DEBUG:teuthology.orchestra.run.smithi062:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T19:45:33.248 INFO:teuthology.provision.fog.smithi062:Node is ready 2023-09-05T19:45:33.249 DEBUG:teuthology.orchestra.run.smithi062:> hostname 2023-09-05T19:45:33.265 INFO:teuthology.orchestra.run.smithi062.stdout:smithi022 2023-09-05T19:45:33.266 DEBUG:teuthology.orchestra.run.smithi062:> grep smithi022 /etc/hosts 2023-09-05T19:45:33.323 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-05T19:45:33.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-09-05T19:45:33.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hosts 2023-09-05T19:45:33.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/172.21.15.22/172.21.15.62/g' /etc/hosts 2023-09-05T19:45:33.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i -e 's/smithi022/smithi062/g' /etc/hostname 2023-09-05T19:45:33.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname smithi062 2023-09-05T19:45:33.753 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-09-05T19:45:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-09-05T19:45:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-09-05T19:45:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-09-05T19:45:33.810 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-09-05T19:45:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-09-05T19:45:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-09-05T19:45:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-05T19:45:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-09-05T19:45:33.811 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-05T19:45:33.812 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-05T19:45:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-05T19:45:33.813 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-05T19:45:33.813 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2023-09-05T19:45:33.815 DEBUG:teuthology.parallel:result is None 2023-09-05T19:45:58.029 WARNING:teuthology.provision.fog.smithi044:timed out 2023-09-05T19:46:04.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:46:04.365 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-05T19:46:04.366 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-05T19:46:04.667 INFO:teuthology.provision.fog.smithi044:Node is ready 2023-09-05T19:46:04.667 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2023-09-05T19:46:04.686 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2023-09-05T19:46:04.687 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2023-09-05T19:46:04.745 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2023-09-05T19:46:04.746 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-05T19:46:04.858 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2023-09-05T19:46:04.887 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2023-09-05T19:46:04.956 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2023-09-05T19:46:05.024 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2023-09-05T19:46:05.092 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-05T19:46:05.148 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux" 2023-09-05T19:46:05.149 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)" 2023-09-05T19:46:05.149 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel" 2023-09-05T19:46:05.149 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora" 2023-09-05T19:46:05.149 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6" 2023-09-05T19:46:05.149 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8" 2023-09-05T19:46:05.150 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-05T19:46:05.150 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-09-05T19:46:05.150 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-05T19:46:05.150 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/" 2023-09-05T19:46:05.150 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-05T19:46:05.151 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T19:46:05.151 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-09-05T19:46:05.151 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-05T19:46:05.151 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-05T19:46:05.151 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-05T19:46:05.152 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-05T19:46:05.152 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2023-09-05T19:46:05.153 DEBUG:teuthology.parallel:result is None 2023-09-05T19:46:05.337 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2023-09-05T19:46:05.338 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T19:46:05.363 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2023-09-05T19:46:05.363 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-05T19:46:05.389 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2023-09-05T19:46:05.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-05T19:46:05.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:46:05.457 DEBUG:teuthology.orchestra.run.smithi044:> true 2023-09-05T19:46:05.523 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2023-09-05T19:46:05.523 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2023-09-05T19:46:05.580 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2023-09-05T19:46:05.580 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2023-09-05T19:46:05.637 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="Red Hat Enterprise Linux" 2023-09-05T19:46:05.637 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="8.6 (Ootpa)" 2023-09-05T19:46:05.637 INFO:teuthology.orchestra.run.smithi044.stdout:ID="rhel" 2023-09-05T19:46:05.637 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="fedora" 2023-09-05T19:46:05.638 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="8.6" 2023-09-05T19:46:05.638 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el8" 2023-09-05T19:46:05.638 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-05T19:46:05.638 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2023-09-05T19:46:05.639 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-05T19:46:05.639 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://www.redhat.com/" 2023-09-05T19:46:05.639 INFO:teuthology.orchestra.run.smithi044.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-05T19:46:05.639 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T19:46:05.639 INFO:teuthology.orchestra.run.smithi044.stdout: 2023-09-05T19:46:05.640 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-05T19:46:05.640 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-05T19:46:05.640 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-05T19:46:05.640 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-05T19:46:05.641 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2023-09-05T19:46:05.663 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2023-09-05T19:46:05.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-05T19:46:05.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-05T19:46:05.731 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-09-05T19:46:05.868 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-09-05T19:46:05.868 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-09-05T19:46:05.926 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-09-05T19:46:05.927 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-09-05T19:46:05.985 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2023-09-05T19:46:05.985 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2023-09-05T19:46:05.985 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2023-09-05T19:46:05.986 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2023-09-05T19:46:05.986 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2023-09-05T19:46:05.986 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2023-09-05T19:46:05.986 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-05T19:46:05.987 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2023-09-05T19:46:05.987 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-05T19:46:05.987 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2023-09-05T19:46:05.987 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-05T19:46:05.987 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-05T19:46:05.988 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-09-05T19:46:05.988 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-05T19:46:05.988 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-05T19:46:05.988 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-05T19:46:05.988 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-05T19:46:05.989 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-09-05T19:46:06.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:46:06.110 INFO:teuthology.dispatcher.supervisor:Running job 7388850 2023-09-05T19:46:06.111 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi/7388850 --name pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-limits} -- /home/teuthworker/archive/pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi/7388850/orig.config.yaml 2023-09-05T19:46:06.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi/7388850 2023-09-05T19:46:06.115 INFO:teuthology.dispatcher.supervisor:Job PID: 3955174 2023-09-05T19:46:06.116 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-05T19:48:06.217 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:50:06.386 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:52:06.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:54:06.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:56:06.880 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T19:58:06.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T20:00:07.159 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T20:02:07.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T20:04:07.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-05T20:04:07.502 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-05T20:04:07.603 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-05T20:04:07.604 INFO:teuthology.nuke:Checking targets against current locks 2023-09-05T20:04:07.656 DEBUG:teuthology.nuke:shortname: smithi044 2023-09-05T20:04:07.657 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T20:04:07.678 DEBUG:teuthology.nuke:shortname: smithi062 2023-09-05T20:04:07.679 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-05T20:04:07.682 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi044.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi/7388850', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 19:41:01.550524', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-05T20:04:07.703 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-05_19:40:12-fs:functional-main-distro-default-smithi/7388850', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-05 19:41:01.551962', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-09-05T20:04:07.735 INFO:teuthology.orchestra.console.smithi044:Power off 2023-09-05T20:04:07.736 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T20:04:07.757 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2023-09-05T20:04:07.757 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T20:04:07.768 INFO:teuthology.orchestra.console.smithi062:Power off 2023-09-05T20:04:07.769 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-05T20:04:07.777 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2023-09-05T20:04:07.788 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2023-09-05T20:04:07.788 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-05T20:04:07.807 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2023-09-05T20:04:07.879 INFO:teuthology.orchestra.console.smithi044:Power off completed 2023-09-05T20:04:07.909 INFO:teuthology.orchestra.console.smithi062:Power off completed 2023-09-05T20:04:08.035 INFO:teuthology.lock.ops:unlocked: smithi044.front.sepia.ceph.com 2023-09-05T20:04:08.051 INFO:teuthology.lock.ops:unlocked: smithi062.front.sepia.ceph.com