2024-04-18T04:04:41.699 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-18T04:04:41.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:04:41.887 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe4f4b6dc10>, signals=[15]) 2024-04-18T04:04:41.887 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2024-04-18T04:04:41.887 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:04:41.888 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-18T04:04:41.912 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2024-04-18T04:04:41.912 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:04:41.912 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-18T04:04:41.928 INFO:teuthology.lock.ops:Start node 'smithi183.front.sepia.ceph.com' reimaging 2024-04-18T04:04:41.928 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: reset os type and version on server 2024-04-18T04:04:41.928 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-04-18T04:04:42.030 DEBUG:teuthology.provision.fog.smithi086:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:04:42.035 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:04:42.054 DEBUG:teuthology.provision.fog.smithi183:Requesting image smithi_rhel_8.6 (ID 5) 2024-04-18T04:04:42.072 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of rhel 8.6 2024-04-18T04:04:42.077 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2024-04-18T04:04:42.101 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of rhel 8.6 2024-04-18T04:04:42.369 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-18T04:04:42.369 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:04:42.382 INFO:teuthology.orchestra.console.smithi086:Power off 2024-04-18T04:04:42.383 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:04:42.396 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-18T04:04:42.396 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.408 DEBUG:teuthology.orchestra.console.smithi086:power off output: Chassis Power Control: Down/Off 2024-04-18T04:04:42.408 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.424 INFO:teuthology.orchestra.console.smithi183:Power off 2024-04-18T04:04:42.425 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-18T04:04:42.433 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-18T04:04:42.437 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-18T04:04:42.447 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2024-04-18T04:04:42.447 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.472 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-04-18T04:04:42.535 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-18T04:04:42.538 INFO:teuthology.orchestra.console.smithi086:Power off completed 2024-04-18T04:04:42.573 INFO:teuthology.orchestra.console.smithi183:Power off completed 2024-04-18T04:04:42.636 INFO:teuthology.orchestra.console.smithi104:Power on 2024-04-18T04:04:42.637 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:04:42.644 INFO:teuthology.orchestra.console.smithi086:Power on 2024-04-18T04:04:42.644 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:04:42.660 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2024-04-18T04:04:42.663 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.674 DEBUG:teuthology.orchestra.console.smithi086:power on output: Chassis Power Control: Up/On 2024-04-18T04:04:42.674 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.682 INFO:teuthology.orchestra.console.smithi183:Power on 2024-04-18T04:04:42.682 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-18T04:04:42.698 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-18T04:04:42.698 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-18T04:04:42.705 DEBUG:teuthology.orchestra.console.smithi183:power on output: Chassis Power Control: Up/On 2024-04-18T04:04:42.706 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:42.735 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2024-04-18T04:04:46.702 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:46.709 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:46.736 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:46.811 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is off 2024-04-18T04:04:46.817 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-18T04:04:46.845 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2024-04-18T04:04:46.946 INFO:teuthology.orchestra.console.smithi183:Power on completed 2024-04-18T04:04:47.046 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2024-04-18T04:04:50.814 DEBUG:teuthology.orchestra.console.smithi086:pexpect command: ipmitool -H smithi086.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:50.821 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-18T04:04:50.923 DEBUG:teuthology.orchestra.console.smithi086:check power output: Chassis Power is on 2024-04-18T04:04:50.930 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-18T04:04:51.024 INFO:teuthology.orchestra.console.smithi086:Power on completed 2024-04-18T04:04:51.031 INFO:teuthology.orchestra.console.smithi104:Power on completed 2024-04-18T04:04:51.125 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2024-04-18T04:04:51.132 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2024-04-18T04:07:52.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:11.295 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:08:17.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:20.350 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:08:22.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:26.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:29.406 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:08:35.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:38.466 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:08:41.502 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:08:44.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:47.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:47.550 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:08:49.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:50.562 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:08:52.226 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:08:53.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:56.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:58.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:08:59.646 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:09:01.314 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:09:03.778 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:09:05.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:07.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:08.702 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:09:09.781 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:10.402 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:09:12.862 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:09:14.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:16.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:18.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:19.486 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:09:21.922 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-18T04:09:25.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:27.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:28.542 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:09:30.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:09:30.080 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:09:33.214 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:09:34.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:37.598 WARNING:teuthology.provision.fog.smithi183:[Errno None] Unable to connect to port 22 on 172.21.15.183 2024-04-18T04:09:39.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:42.270 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:09:43.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:48.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:50.311 INFO:teuthology.provision.fog.smithi104:Node is ready 2024-04-18T04:09:50.312 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2024-04-18T04:09:50.334 INFO:teuthology.orchestra.run.smithi104.stdout:smithi045 2024-04-18T04:09:50.334 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi045 /etc/hosts 2024-04-18T04:09:50.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:09:50.394 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi045/smithi104/g' /etc/hostname 2024-04-18T04:09:50.573 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-18T04:09:50.599 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:09:50.656 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-18T04:09:50.657 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:09:50.657 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:09:50.657 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:09:50.657 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:09:50.657 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2024-04-18T04:09:50.659 DEBUG:teuthology.parallel:result is None 2024-04-18T04:09:51.326 WARNING:teuthology.provision.fog.smithi086:[Errno None] Unable to connect to port 22 on 172.21.15.86 2024-04-18T04:09:57.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:09:57.561 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:09:57.562 DEBUG:teuthology.orchestra.run.smithi086:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:10:17.806 INFO:teuthology.provision.fog.smithi086:Node is ready 2024-04-18T04:10:17.807 DEBUG:teuthology.orchestra.run.smithi086:> hostname 2024-04-18T04:10:17.828 INFO:teuthology.orchestra.run.smithi086.stdout:smithi045 2024-04-18T04:10:17.829 DEBUG:teuthology.orchestra.run.smithi086:> grep smithi045 /etc/hosts 2024-04-18T04:10:17.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-18T04:10:17.888 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i -e 's/smithi045/smithi086/g' /etc/hostname 2024-04-18T04:10:18.037 DEBUG:teuthology.orchestra.run.smithi086:> sudo hostname smithi086 2024-04-18T04:10:18.064 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-04-18T04:10:18.121 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:10:18.122 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:10:18.122 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2024-04-18T04:10:18.123 DEBUG:teuthology.parallel:result is None 2024-04-18T04:10:43.602 WARNING:teuthology.provision.fog.smithi183:timed out 2024-04-18T04:10:49.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:10:49.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-18T04:10:49.933 DEBUG:teuthology.orchestra.run.smithi183:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-18T04:10:50.199 INFO:teuthology.provision.fog.smithi183:Node is ready 2024-04-18T04:10:50.199 DEBUG:teuthology.orchestra.run.smithi183:> hostname 2024-04-18T04:10:50.216 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183 2024-04-18T04:10:50.217 DEBUG:teuthology.orchestra.run.smithi183:> grep smithi183 /etc/hosts 2024-04-18T04:10:50.272 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2024-04-18T04:10:50.273 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-04-18T04:10:50.395 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hosts 2024-04-18T04:10:50.425 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/172.21.15.183/172.21.15.183/g' /etc/hosts 2024-04-18T04:10:50.492 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i -e 's/smithi183/smithi183/g' /etc/hostname 2024-04-18T04:10:50.558 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname smithi183 2024-04-18T04:10:50.623 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-04-18T04:10:50.678 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:10:50.678 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-18T04:10:50.679 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:10:50.680 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:10:50.680 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:10:50.680 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:10:50.680 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2024-04-18T04:10:50.681 DEBUG:teuthology.parallel:result is None 2024-04-18T04:10:50.871 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2024-04-18T04:10:50.871 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:10:50.892 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2024-04-18T04:10:50.892 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:10:50.908 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2024-04-18T04:10:50.908 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-18T04:10:50.927 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:10:50.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T04:10:50.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:10:51.000 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-04-18T04:10:51.071 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-04-18T04:10:51.071 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-04-18T04:10:51.129 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-04-18T04:10:51.130 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-04-18T04:10:51.188 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:10:51.189 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:10:51.190 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:10:51.190 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-04-18T04:10:51.209 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:10:51.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-18T04:10:51.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:10:51.317 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-18T04:10:51.455 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-18T04:10:51.456 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-18T04:10:51.512 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-18T04:10:51.512 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:ID="rhel" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="fedora" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8.6" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:10:51.569 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout: 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:10:51.570 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:10:51.571 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-18T04:10:51.592 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2024-04-18T04:10:51.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-18T04:10:51.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-18T04:10:51.662 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-04-18T04:10:51.734 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-04-18T04:10:51.734 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-04-18T04:10:51.793 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-04-18T04:10:51.793 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-04-18T04:10:51.851 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Red Hat Enterprise Linux" 2024-04-18T04:10:51.851 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="8.6 (Ootpa)" 2024-04-18T04:10:51.851 INFO:teuthology.orchestra.run.smithi183.stdout:ID="rhel" 2024-04-18T04:10:51.851 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="fedora" 2024-04-18T04:10:51.851 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="8.6" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el8" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.redhat.com/" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-04-18T04:10:51.852 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-04-18T04:10:51.853 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-04-18T04:10:51.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:10:51.989 INFO:teuthology.dispatcher.supervisor:Running job 7661487 2024-04-18T04:10:51.989 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661487 --name teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/direct_io}} -- /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661487/orig.config.yaml 2024-04-18T04:10:51.993 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2024-04-17_22:24:03-fs-reef-distro-default-smithi/7661487 2024-04-18T04:10:51.993 INFO:teuthology.dispatcher.supervisor:Job PID: 1126749 2024-04-18T04:10:51.993 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-18T04:12:52.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:14:52.275 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:16:52.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:18:52.647 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:20:52.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:22:52.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:24:53.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-18T04:24:53.219 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1