2023-09-13T02:54:49.170 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T02:54:49.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T02:54:49.338 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f76cc33c670>, signals=[15]) 2023-09-13T02:54:49.339 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging 2023-09-13T02:54:49.340 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T02:54:49.340 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-09-13T02:54:49.366 INFO:teuthology.lock.ops:Start node 'smithi077.front.sepia.ceph.com' reimaging 2023-09-13T02:54:49.367 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T02:54:49.367 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-09-13T02:54:49.369 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"} 2023-09-13T02:54:49.389 INFO:teuthology.lock.ops:Start node 'smithi175.front.sepia.ceph.com' reimaging 2023-09-13T02:54:49.390 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: reset os type and version on server 2023-09-13T02:54:49.390 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-09-13T02:54:49.391 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /host {"name": "smithi077"} 2023-09-13T02:54:49.414 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /host {"name": "smithi175"} 2023-09-13T02:54:49.443 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T02:54:49.470 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T02:54:49.483 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T02:54:49.484 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 5} 2023-09-13T02:54:49.487 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /image {"name": "smithi_rhel_8.6"} 2023-09-13T02:54:49.523 DEBUG:teuthology.provision.fog.smithi077:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T02:54:49.524 DEBUG:teuthology.provision.fog.smithi077:FOG request: PUT /host/182 {"imageID": 5} 2023-09-13T02:54:49.529 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of rhel 8.6 2023-09-13T02:54:49.529 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:54:49.535 DEBUG:teuthology.provision.fog.smithi175:Requesting image smithi_rhel_8.6 (ID 5) 2023-09-13T02:54:49.535 DEBUG:teuthology.provision.fog.smithi175:FOG request: PUT /host/280 {"imageID": 5} 2023-09-13T02:54:49.584 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T02:54:49.587 INFO:teuthology.provision.fog.smithi077:Scheduling deploy of rhel 8.6 2023-09-13T02:54:49.587 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:54:49.594 INFO:teuthology.provision.fog.smithi175:Scheduling deploy of rhel 8.6 2023-09-13T02:54:49.594 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:54:49.618 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1} 2023-09-13T02:54:49.640 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T02:54:49.649 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /tasktype {"name": "deploy"} 2023-09-13T02:54:49.678 DEBUG:teuthology.provision.fog.smithi077:FOG request: POST /host/182/task {"taskTypeID": 1} 2023-09-13T02:54:49.684 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:54:49.687 DEBUG:teuthology.provision.fog.smithi175:FOG request: POST /host/280/task {"taskTypeID": 1} 2023-09-13T02:54:49.731 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:54:49.744 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:54:49.776 INFO:teuthology.orchestra.console.smithi022:Power off 2023-09-13T02:54:49.777 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T02:54:49.798 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-09-13T02:54:49.799 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:49.819 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-13T02:54:49.843 INFO:teuthology.orchestra.console.smithi175:Power off 2023-09-13T02:54:49.843 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T02:54:49.856 INFO:teuthology.orchestra.console.smithi077:Power off 2023-09-13T02:54:49.857 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T02:54:49.866 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-09-13T02:54:49.867 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:49.877 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-09-13T02:54:49.877 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:49.886 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-09-13T02:54:49.896 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-09-13T02:54:49.926 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-09-13T02:54:49.988 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-09-13T02:54:49.998 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-09-13T02:54:50.027 INFO:teuthology.orchestra.console.smithi022:Power on 2023-09-13T02:54:50.027 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T02:54:50.050 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On 2023-09-13T02:54:50.051 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:50.071 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-13T02:54:50.089 INFO:teuthology.orchestra.console.smithi175:Power on 2023-09-13T02:54:50.090 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T02:54:50.100 INFO:teuthology.orchestra.console.smithi077:Power on 2023-09-13T02:54:50.100 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-13T02:54:50.110 DEBUG:teuthology.orchestra.console.smithi175:power on output: Chassis Power Control: Up/On 2023-09-13T02:54:50.111 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:50.121 DEBUG:teuthology.orchestra.console.smithi077:power on output: Chassis Power Control: Up/On 2023-09-13T02:54:50.121 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:50.131 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-09-13T02:54:50.142 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-09-13T02:54:54.075 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:54.133 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:54.143 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:54.186 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-13T02:54:54.242 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-09-13T02:54:54.252 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is on 2023-09-13T02:54:54.353 INFO:teuthology.orchestra.console.smithi077:Power on completed 2023-09-13T02:54:54.454 INFO:teuthology.provision.fog.smithi077:Waiting for deploy to finish 2023-09-13T02:54:54.454 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:54:58.191 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:58.244 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T02:54:58.353 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is on 2023-09-13T02:54:58.377 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-09-13T02:54:58.455 INFO:teuthology.orchestra.console.smithi175:Power on completed 2023-09-13T02:54:58.478 INFO:teuthology.orchestra.console.smithi022:Power on completed 2023-09-13T02:54:58.556 INFO:teuthology.provision.fog.smithi175:Waiting for deploy to finish 2023-09-13T02:54:58.556 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:54:58.580 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish 2023-09-13T02:54:58.580 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:55:09.526 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:55:13.638 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:55:13.641 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:55:24.599 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:55:28.702 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:55:28.703 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:55:39.674 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:55:43.774 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:55:43.777 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:55:54.745 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:55:58.843 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:55:58.845 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:56:09.816 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:56:13.906 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:56:13.909 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:56:24.890 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:56:28.982 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:56:28.983 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:56:39.960 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:56:44.074 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:56:44.075 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:56:55.034 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:56:59.142 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:56:59.143 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:57:10.098 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:57:14.206 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:57:14.207 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:57:25.162 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:57:29.262 DEBUG:teuthology.provision.fog.smithi175:FOG request: GET /task/active None 2023-09-13T02:57:29.265 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None 2023-09-13T02:57:29.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:57:29.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:57:40.212 DEBUG:teuthology.provision.fog.smithi077:FOG request: GET /task/active None 2023-09-13T02:57:40.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:57:47.674 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-09-13T02:57:53.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:57:56.730 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-09-13T02:57:58.685 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:58:02.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:04.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:05.786 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22 2023-09-13T02:58:07.738 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:58:11.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:13.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:16.794 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:58:22.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:25.850 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:58:29.410 ERROR:teuthology.orchestra.connection:Error authenticating with smithi175.front.sepia.ceph.com: No SSH private key found! 2023-09-13T02:58:29.563 WARNING:teuthology.provision.fog.smithi175:No existing session 2023-09-13T02:58:31.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:35.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:50.394 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:58:56.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:58:59.450 WARNING:teuthology.provision.fog.smithi077:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-09-13T02:59:05.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:06.858 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T02:59:06.859 DEBUG:teuthology.orchestra.run.smithi077:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T02:59:07.414 INFO:teuthology.provision.fog.smithi077:Node is ready 2023-09-13T02:59:07.415 DEBUG:teuthology.orchestra.run.smithi077:> hostname 2023-09-13T02:59:07.478 INFO:teuthology.orchestra.run.smithi077.stdout:smithi022 2023-09-13T02:59:07.478 DEBUG:teuthology.orchestra.run.smithi077:> grep smithi022 /etc/hosts 2023-09-13T02:59:07.539 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-13T02:59:07.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-09-13T02:59:07.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi022/smithi077/g' /etc/hosts 2023-09-13T02:59:07.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/172.21.15.22/172.21.15.77/g' /etc/hosts 2023-09-13T02:59:07.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i -e 's/smithi022/smithi077/g' /etc/hostname 2023-09-13T02:59:07.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname smithi077 2023-09-13T02:59:08.004 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-09-13T02:59:08.061 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:08.062 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:08.062 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2023-09-13T02:59:08.062 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2023-09-13T02:59:08.063 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2023-09-13T02:59:08.063 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:08.063 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:08.063 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:08.064 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:08.064 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:08.064 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:08.064 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:08.064 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-09-13T02:59:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:08.066 INFO:teuthology.provision.fog.smithi077:Deploy complete! 2023-09-13T02:59:08.067 DEBUG:teuthology.parallel:result is None 2023-09-13T02:59:11.790 WARNING:teuthology.provision.fog.smithi022:timed out 2023-09-13T02:59:17.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:18.036 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T02:59:18.036 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T02:59:18.359 INFO:teuthology.provision.fog.smithi022:Node is ready 2023-09-13T02:59:18.360 DEBUG:teuthology.orchestra.run.smithi022:> hostname 2023-09-13T02:59:18.380 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com 2023-09-13T02:59:18.381 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts 2023-09-13T02:59:18.440 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2023-09-13T02:59:18.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-09-13T02:59:18.558 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts 2023-09-13T02:59:18.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts 2023-09-13T02:59:18.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname 2023-09-13T02:59:18.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022 2023-09-13T02:59:18.796 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-09-13T02:59:18.853 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:18.853 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:18.854 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-09-13T02:59:18.854 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-09-13T02:59:18.854 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-09-13T02:59:18.854 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:18.855 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:18.855 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:18.855 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:18.855 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:18.855 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:18.856 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:18.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-09-13T02:59:18.856 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:18.856 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:18.857 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:18.857 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:18.857 INFO:teuthology.provision.fog.smithi022:Deploy complete! 2023-09-13T02:59:18.858 DEBUG:teuthology.parallel:result is None 2023-09-13T02:59:27.774 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-09-13T02:59:35.575 WARNING:teuthology.provision.fog.smithi175:timed out 2023-09-13T02:59:41.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:41.923 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-13T02:59:41.923 DEBUG:teuthology.orchestra.run.smithi175:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-13T02:59:42.214 INFO:teuthology.provision.fog.smithi175:Node is ready 2023-09-13T02:59:42.215 DEBUG:teuthology.orchestra.run.smithi175:> hostname 2023-09-13T02:59:42.232 INFO:teuthology.orchestra.run.smithi175.stdout:smithi175 2023-09-13T02:59:42.233 DEBUG:teuthology.orchestra.run.smithi175:> grep smithi175 /etc/hosts 2023-09-13T02:59:42.290 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.15.175 smithi175.front.sepia.ceph.com smithi175 2023-09-13T02:59:42.291 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-09-13T02:59:42.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175/smithi175/g' /etc/hosts 2023-09-13T02:59:42.463 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/172.21.15.175/172.21.15.175/g' /etc/hosts 2023-09-13T02:59:42.529 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i -e 's/smithi175/smithi175/g' /etc/hostname 2023-09-13T02:59:42.597 DEBUG:teuthology.orchestra.run.smithi175:> sudo hostname smithi175 2023-09-13T02:59:42.663 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-09-13T02:59:42.719 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:42.719 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:42.720 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-09-13T02:59:42.720 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-09-13T02:59:42.720 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-09-13T02:59:42.720 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:42.720 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:42.721 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:42.722 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-09-13T02:59:42.722 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:42.722 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:42.722 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:42.722 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:42.723 INFO:teuthology.provision.fog.smithi175:Deploy complete! 2023-09-13T02:59:42.723 DEBUG:teuthology.parallel:result is None 2023-09-13T02:59:42.909 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com 2023-09-13T02:59:42.910 INFO:teuthology.lock.ops:Checking smithi077.front.sepia.ceph.com 2023-09-13T02:59:42.910 INFO:teuthology.lock.ops:Checking smithi175.front.sepia.ceph.com 2023-09-13T02:59:42.910 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-13T02:59:42.929 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server 2023-09-13T02:59:42.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-13T02:59:42.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:42.998 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-09-13T02:59:43.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-09-13T02:59:43.132 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-09-13T02:59:43.190 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-09-13T02:59:43.191 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-09-13T02:59:43.249 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:43.250 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:43.250 INFO:teuthology.orchestra.run.smithi022.stdout:ID="rhel" 2023-09-13T02:59:43.250 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="fedora" 2023-09-13T02:59:43.250 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8.6" 2023-09-13T02:59:43.250 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:43.251 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:43.251 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:43.251 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:43.251 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:43.251 INFO:teuthology.orchestra.run.smithi022.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:43.252 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:43.253 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-09-13T02:59:43.279 INFO:teuthology.lock.ops:Updating [smithi077.front.sepia.ceph.com]: set os type and version on server 2023-09-13T02:59:43.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-09-13T02:59:43.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:43.347 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-09-13T02:59:43.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-09-13T02:59:43.480 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-09-13T02:59:43.539 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-09-13T02:59:43.539 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-09-13T02:59:43.596 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:43.596 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:43.596 INFO:teuthology.orchestra.run.smithi077.stdout:ID="rhel" 2023-09-13T02:59:43.597 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="fedora" 2023-09-13T02:59:43.597 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="8.6" 2023-09-13T02:59:43.597 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:43.597 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:43.597 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:43.598 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:43.598 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:43.598 INFO:teuthology.orchestra.run.smithi077.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:43.598 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:43.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-09-13T02:59:43.599 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:43.599 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:43.599 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:43.600 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:43.600 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-09-13T02:59:43.620 INFO:teuthology.lock.ops:Updating [smithi175.front.sepia.ceph.com]: set os type and version on server 2023-09-13T02:59:43.620 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-09-13T02:59:43.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T02:59:43.687 DEBUG:teuthology.orchestra.run.smithi175:> true 2023-09-13T02:59:43.761 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2023-09-13T02:59:43.762 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2023-09-13T02:59:43.821 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2023-09-13T02:59:43.822 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2023-09-13T02:59:43.881 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T02:59:43.881 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T02:59:43.881 INFO:teuthology.orchestra.run.smithi175.stdout:ID="rhel" 2023-09-13T02:59:43.882 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="fedora" 2023-09-13T02:59:43.882 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="8.6" 2023-09-13T02:59:43.882 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el8" 2023-09-13T02:59:43.882 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T02:59:43.882 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2023-09-13T02:59:43.883 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T02:59:43.883 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T02:59:43.883 INFO:teuthology.orchestra.run.smithi175.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T02:59:43.883 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T02:59:43.883 INFO:teuthology.orchestra.run.smithi175.stdout: 2023-09-13T02:59:43.884 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T02:59:43.884 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T02:59:43.884 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T02:59:43.884 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T02:59:43.885 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2023-09-13T02:59:43.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T02:59:43.990 INFO:teuthology.dispatcher.supervisor:Running job 7395267 2023-09-13T02:59:43.991 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267 --name pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsx}} -- /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267/orig.config.yaml 2023-09-13T02:59:43.994 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267 2023-09-13T02:59:43.994 INFO:teuthology.dispatcher.supervisor:Job PID: 2895239 2023-09-13T02:59:43.995 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-13T03:01:44.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:03:44.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:05:44.446 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:07:44.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:09:44.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:11:44.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:13:45.102 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:15:45.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:17:45.439 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:19:45.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:21:45.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:23:45.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:25:46.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:27:46.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:29:46.346 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:31:46.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:33:46.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:35:46.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:37:47.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:39:47.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:41:47.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:43:47.531 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:45:47.694 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T03:45:47.753 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-13T03:45:47.979 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-13T03:45:47.979 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T03:45:48.029 DEBUG:teuthology.nuke:shortname: smithi022 2023-09-13T03:45:48.030 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T03:45:48.052 DEBUG:teuthology.nuke:shortname: smithi077 2023-09-13T03:45:48.052 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T03:45:48.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 02:54:48.236736', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T03:45:48.072 DEBUG:teuthology.nuke:shortname: smithi175 2023-09-13T03:45:48.073 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T03:45:48.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 02:54:48.238688', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T03:45:48.094 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-09-12_14:07:50-fs-wip-batrick-testing-20230912.122437-distro-default-smithi/7395267', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 02:54:48.240175', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T03:45:48.103 INFO:teuthology.orchestra.console.smithi022:Power off 2023-09-13T03:45:48.104 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T03:45:48.125 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-09-13T03:45:48.126 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T03:45:48.143 INFO:teuthology.orchestra.console.smithi077:Power off 2023-09-13T03:45:48.143 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T03:45:48.156 INFO:teuthology.orchestra.console.smithi175:Power off 2023-09-13T03:45:48.157 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T03:45:48.163 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-09-13T03:45:48.166 DEBUG:teuthology.orchestra.console.smithi077:power off output: Chassis Power Control: Down/Off 2023-09-13T03:45:48.166 DEBUG:teuthology.orchestra.console.smithi077:pexpect command: ipmitool -H smithi077.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T03:45:48.177 DEBUG:teuthology.orchestra.console.smithi175:power off output: Chassis Power Control: Down/Off 2023-09-13T03:45:48.178 DEBUG:teuthology.orchestra.console.smithi175:pexpect command: ipmitool -H smithi175.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T03:45:48.186 DEBUG:teuthology.orchestra.console.smithi077:check power output: Chassis Power is off 2023-09-13T03:45:48.198 DEBUG:teuthology.orchestra.console.smithi175:check power output: Chassis Power is off 2023-09-13T03:45:48.265 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-09-13T03:45:48.287 INFO:teuthology.orchestra.console.smithi077:Power off completed 2023-09-13T03:45:48.299 INFO:teuthology.orchestra.console.smithi175:Power off completed 2023-09-13T03:45:48.411 INFO:teuthology.lock.ops:unlocked: smithi022.front.sepia.ceph.com 2023-09-13T03:45:48.434 INFO:teuthology.lock.ops:unlocked: smithi077.front.sepia.ceph.com 2023-09-13T03:45:48.443 INFO:teuthology.lock.ops:unlocked: smithi175.front.sepia.ceph.com