2023-11-10T11:53:28.087 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-10T11:53:28.088 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T11:53:28.249 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e9928ac10>, signals=[15]) 2023-11-10T11:53:28.250 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging 2023-11-10T11:53:28.250 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T11:53:28.251 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-11-10T11:53:28.272 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-11-10T11:53:28.273 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-11-10T11:53:28.273 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-11-10T11:53:28.274 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /host {"name": "smithi150"} 2023-11-10T11:53:28.297 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /host {"name": "smithi187"} 2023-11-10T11:53:28.345 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-10T11:53:28.378 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-11-10T11:53:28.381 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-10T11:53:28.382 DEBUG:teuthology.provision.fog.smithi150:FOG request: PUT /host/255 {"imageID": 5} 2023-11-10T11:53:28.428 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of rhel 8.6 2023-11-10T11:53:28.428 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:53:28.431 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_rhel_8.6 (ID 5) 2023-11-10T11:53:28.431 DEBUG:teuthology.provision.fog.smithi187:FOG request: PUT /host/292 {"imageID": 5} 2023-11-10T11:53:28.491 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of rhel 8.6 2023-11-10T11:53:28.491 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:53:28.636 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T11:53:28.661 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /tasktype {"name": "deploy"} 2023-11-10T11:53:28.676 DEBUG:teuthology.provision.fog.smithi150:FOG request: POST /host/255/task {"taskTypeID": 1} 2023-11-10T11:53:28.707 DEBUG:teuthology.provision.fog.smithi187:FOG request: POST /host/292/task {"taskTypeID": 1} 2023-11-10T11:53:28.740 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:53:28.769 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:53:28.967 INFO:teuthology.orchestra.console.smithi150:Power off 2023-11-10T11:53:28.968 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T11:53:28.988 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off 2023-11-10T11:53:28.989 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:29.010 INFO:teuthology.orchestra.console.smithi187:Power off 2023-11-10T11:53:29.010 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-10T11:53:29.019 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-11-10T11:53:29.032 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-11-10T11:53:29.033 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:29.054 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-11-10T11:53:33.021 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:33.055 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:33.130 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-11-10T11:53:33.163 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-11-10T11:53:37.135 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:37.163 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:37.243 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-10T11:53:37.271 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-11-10T11:53:37.345 INFO:teuthology.orchestra.console.smithi150:Power off completed 2023-11-10T11:53:37.445 INFO:teuthology.orchestra.console.smithi150:Power on 2023-11-10T11:53:37.446 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T11:53:37.466 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On 2023-11-10T11:53:37.467 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:37.486 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-10T11:53:41.276 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:41.384 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-11-10T11:53:41.485 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-11-10T11:53:41.488 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:41.586 INFO:teuthology.orchestra.console.smithi187:Power on 2023-11-10T11:53:41.587 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-10T11:53:41.595 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off 2023-11-10T11:53:41.606 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2023-11-10T11:53:41.606 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:41.626 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-11-10T11:53:45.598 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:45.627 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-10T11:53:45.708 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on 2023-11-10T11:53:45.736 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-11-10T11:53:45.809 INFO:teuthology.orchestra.console.smithi150:Power on completed 2023-11-10T11:53:45.837 INFO:teuthology.orchestra.console.smithi187:Power on completed 2023-11-10T11:53:45.910 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2023-11-10T11:53:45.911 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:53:45.938 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-11-10T11:53:45.938 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:54:01.090 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:54:01.103 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:54:16.310 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:54:16.312 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:54:31.491 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:54:31.492 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:54:46.668 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:54:46.670 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:55:01.865 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:55:01.867 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:55:17.102 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:55:17.103 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:55:32.354 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:55:32.357 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:55:56.256 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:56:01.202 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:56:11.758 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:56:18.714 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:56:27.138 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:56:35.470 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:56:42.528 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:56:50.705 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:56:57.838 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:57:05.878 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:57:13.082 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:57:21.108 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:57:28.346 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:57:36.282 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:57:43.518 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:57:51.452 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:57:58.710 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:58:06.636 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:58:13.859 DEBUG:teuthology.provision.fog.smithi150:FOG request: GET /task/active None 2023-11-10T11:58:13.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:17.050 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:58:21.767 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:58:23.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:26.106 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:58:32.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:35.162 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:58:36.878 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:58:41.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:44.218 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:58:50.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:58:51.976 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:58:53.306 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:58:59.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:02.362 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:59:07.070 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:59:08.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:11.418 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:59:17.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:20.474 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:59:22.154 DEBUG:teuthology.provision.fog.smithi187:FOG request: GET /task/active None 2023-11-10T11:59:22.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:25.306 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T11:59:26.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:31.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:34.366 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T11:59:36.826 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:59:40.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:42.829 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:43.454 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T11:59:45.882 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-11-10T11:59:49.457 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:51.884 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T11:59:52.538 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T11:59:58.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:00.612 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T12:00:00.613 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T12:00:00.718 INFO:teuthology.provision.fog.smithi150:Node is ready 2023-11-10T12:00:00.718 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2023-11-10T12:00:00.734 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2023-11-10T12:00:00.735 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2023-11-10T12:00:00.791 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2023-11-10T12:00:00.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-11-10T12:00:00.936 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2023-11-10T12:00:00.965 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2023-11-10T12:00:01.032 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2023-11-10T12:00:01.100 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2023-11-10T12:00:01.167 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-11-10T12:00:01.223 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T12:00:01.224 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2023-11-10T12:00:01.224 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-11-10T12:00:01.224 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-11-10T12:00:01.224 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2023-11-10T12:00:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:00:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-10T12:00:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-11-10T12:00:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-10T12:00:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T12:00:01.226 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T12:00:01.226 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:00:01.226 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-11-10T12:00:01.226 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:00:01.226 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-10T12:00:01.227 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T12:00:01.227 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-10T12:00:01.228 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2023-11-10T12:00:01.229 DEBUG:teuthology.parallel:result is None 2023-11-10T12:00:01.598 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T12:00:07.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:00:10.682 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-11-10T12:00:16.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:01:16.747 WARNING:teuthology.provision.fog.smithi187:timed out 2023-11-10T12:01:22.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:01:23.092 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-10T12:01:23.093 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-10T12:01:23.381 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-11-10T12:01:23.382 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2023-11-10T12:01:23.400 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187 2023-11-10T12:01:23.400 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187 /etc/hosts 2023-11-10T12:01:23.457 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2023-11-10T12:01:23.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-11-10T12:01:23.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hosts 2023-11-10T12:01:23.609 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2023-11-10T12:01:23.676 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187/smithi187/g' /etc/hostname 2023-11-10T12:01:23.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2023-11-10T12:01:23.807 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-11-10T12:01:23.865 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T12:01:23.865 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-11-10T12:01:23.865 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-11-10T12:01:23.866 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-11-10T12:01:23.866 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-11-10T12:01:23.866 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:01:23.866 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-10T12:01:23.866 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-11-10T12:01:23.867 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-10T12:01:23.867 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T12:01:23.867 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T12:01:23.867 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:01:23.867 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-11-10T12:01:23.868 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:01:23.868 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-10T12:01:23.868 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T12:01:23.868 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-10T12:01:23.868 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-11-10T12:01:23.869 DEBUG:teuthology.parallel:result is None 2023-11-10T12:01:24.019 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2023-11-10T12:01:24.019 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T12:01:24.038 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-11-10T12:01:24.038 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-10T12:01:24.064 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2023-11-10T12:01:24.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-11-10T12:01:24.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:01:24.131 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-11-10T12:01:24.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-11-10T12:01:24.268 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-11-10T12:01:24.324 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-11-10T12:01:24.325 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-11-10T12:01:24.382 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T12:01:24.382 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2023-11-10T12:01:24.383 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2023-11-10T12:01:24.383 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2023-11-10T12:01:24.383 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2023-11-10T12:01:24.383 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:01:24.384 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-10T12:01:24.384 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2023-11-10T12:01:24.384 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-10T12:01:24.384 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T12:01:24.384 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T12:01:24.385 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:01:24.385 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-11-10T12:01:24.385 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:01:24.385 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-10T12:01:24.386 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T12:01:24.386 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-10T12:01:24.386 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-11-10T12:01:24.413 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-11-10T12:01:24.414 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-11-10T12:01:24.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-10T12:01:24.479 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-11-10T12:01:24.548 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-11-10T12:01:24.549 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-11-10T12:01:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-11-10T12:01:24.606 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-11-10T12:01:24.662 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-11-10T12:01:24.662 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-11-10T12:01:24.663 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-11-10T12:01:24.663 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-11-10T12:01:24.663 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-11-10T12:01:24.663 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-11-10T12:01:24.663 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-10T12:01:24.664 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-11-10T12:01:24.664 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-10T12:01:24.664 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-11-10T12:01:24.664 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-10T12:01:24.664 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-10T12:01:24.665 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-11-10T12:01:24.665 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-10T12:01:24.665 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-10T12:01:24.665 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-10T12:01:24.665 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-10T12:01:24.666 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-11-10T12:01:24.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:01:24.779 INFO:teuthology.dispatcher.supervisor:Running job 7453888 2023-11-10T12:01:24.779 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453888 --name rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453888/orig.config.yaml 2023-11-10T12:01:24.782 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-11-10_11:52:20-fs-rishabh-unqiue-fsnames-testing-default-smithi/7453888 2023-11-10T12:01:24.783 INFO:teuthology.dispatcher.supervisor:Job PID: 1939966 2023-11-10T12:01:24.783 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-10T12:03:24.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:05:25.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:07:25.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:09:25.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:11:25.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:13:25.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:15:25.909 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:17:26.024 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:19:26.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:21:26.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:23:26.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:25:26.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-10T12:25:26.816 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120