2023-08-07T20:11:10.070 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-07T20:11:10.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:11:10.217 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faceb66bee0>, signals=[15]) 2023-08-07T20:11:10.218 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2023-08-07T20:11:10.219 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T20:11:10.219 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-07T20:11:10.239 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-08-07T20:11:10.239 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T20:11:10.240 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-07T20:11:10.241 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /host {"name": "smithi102"} 2023-08-07T20:11:10.264 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-08-07T20:11:10.306 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T20:11:10.335 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T20:11:10.342 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T20:11:10.342 DEBUG:teuthology.provision.fog.smithi102:FOG request: PUT /host/207 {"imageID": 10} 2023-08-07T20:11:10.379 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T20:11:10.380 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 10} 2023-08-07T20:11:10.382 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 9.stream 2023-08-07T20:11:10.383 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:11:10.427 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-08-07T20:11:10.428 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:11:10.440 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T20:11:10.490 DEBUG:teuthology.provision.fog.smithi102:FOG request: POST /host/207/task {"taskTypeID": 1} 2023-08-07T20:11:10.502 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T20:11:10.546 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-08-07T20:11:10.552 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:11:10.592 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:11:10.651 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-07T20:11:10.652 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:11:10.676 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-07T20:11:10.676 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:10.695 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-07T20:11:10.696 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:11:10.705 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-07T20:11:10.716 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-07T20:11:10.716 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:10.741 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-07T20:11:10.807 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-07T20:11:10.843 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-07T20:11:10.908 INFO:teuthology.orchestra.console.smithi102:Power on 2023-08-07T20:11:10.909 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T20:11:10.930 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2023-08-07T20:11:10.930 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:10.944 INFO:teuthology.orchestra.console.smithi112:Power on 2023-08-07T20:11:10.945 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T20:11:10.954 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-07T20:11:10.964 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-08-07T20:11:10.964 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:10.989 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-07T20:11:14.956 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:14.990 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:11:15.068 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2023-08-07T20:11:15.101 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-07T20:11:15.169 INFO:teuthology.orchestra.console.smithi102:Power on completed 2023-08-07T20:11:15.202 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-08-07T20:11:15.271 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2023-08-07T20:11:15.272 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:11:15.302 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-08-07T20:11:15.303 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:11:30.352 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:11:30.368 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:11:45.436 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:11:45.437 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:12:00.512 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:12:00.513 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:12:15.580 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:12:15.582 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:12:30.652 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:12:30.653 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:12:45.716 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:12:45.717 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:13:00.800 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:13:00.802 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:13:15.875 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:13:15.877 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:13:30.968 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:13:30.970 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:13:46.044 DEBUG:teuthology.provision.fog.smithi102:FOG request: GET /task/active None 2023-08-07T20:13:46.046 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:13:46.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:13:46.401 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: Authentication failed. 2023-08-07T20:13:46.404 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T20:13:46.406 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T20:13:46.407 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-07T20:14:01.131 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-07T20:14:01.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:04.276 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:10.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:13.328 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:19.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:22.388 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:28.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:31.440 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:37.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:40.496 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:46.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:14:49.552 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:14:55.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:15:14.036 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:15:20.037 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:15:23.088 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-07T20:15:29.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:15:30.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T20:15:30.246 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T20:15:49.872 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-07T20:15:49.874 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi102 2023-08-07T20:15:55.480 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-08-07T20:15:55.480 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-08-07T20:15:55.499 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-08-07T20:15:55.500 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-08-07T20:15:55.557 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-08-07T20:15:55.557 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-07T20:15:55.681 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-08-07T20:15:55.712 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-08-07T20:15:55.780 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-08-07T20:15:55.849 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-07T20:15:55.916 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-07T20:15:55.971 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-07T20:15:55.971 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-07T20:15:55.971 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-07T20:15:55.971 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:15:55.971 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:15:55.972 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:15:55.973 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:15:55.973 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:15:55.973 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:15:55.974 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-08-07T20:15:55.975 DEBUG:teuthology.parallel:result is None 2023-08-07T20:15:58.877 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-07T20:15:58.878 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:15:59.150 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-08-07T20:15:59.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-07T20:15:59.463 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T20:15:59.463 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T20:15:59.477 INFO:teuthology.provision.fog.smithi102:Node is ready 2023-08-07T20:15:59.477 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2023-08-07T20:15:59.528 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2023-08-07T20:15:59.528 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2023-08-07T20:15:59.580 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2023-08-07T20:15:59.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-07T20:15:59.678 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2023-08-07T20:15:59.706 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2023-08-07T20:15:59.770 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2023-08-07T20:15:59.836 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2023-08-07T20:15:59.902 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-07T20:15:59.953 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-08-07T20:15:59.953 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-08-07T20:15:59.953 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-08-07T20:15:59.953 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:15:59.954 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-08-07T20:15:59.954 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:15:59.954 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:15:59.954 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-07T20:15:59.954 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:15:59.955 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:15:59.955 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:15:59.955 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:15:59.955 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:15:59.955 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:15:59.956 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2023-08-07T20:15:59.956 DEBUG:teuthology.parallel:result is None 2023-08-07T20:16:00.097 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2023-08-07T20:16:00.098 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T20:16:00.124 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-08-07T20:16:00.124 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T20:16:00.142 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2023-08-07T20:16:00.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-07T20:16:00.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:16:00.221 DEBUG:teuthology.orchestra.run.smithi102:> true 2023-08-07T20:16:00.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2023-08-07T20:16:00.286 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2023-08-07T20:16:00.337 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2023-08-07T20:16:00.338 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2023-08-07T20:16:00.388 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:16:00.389 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:16:00.390 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:16:00.391 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2023-08-07T20:16:00.424 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-08-07T20:16:00.425 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-07T20:16:00.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:16:00.508 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-08-07T20:16:00.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-07T20:16:00.535 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-08-07T20:16:00.590 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-08-07T20:16:00.590 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-07T20:16:00.645 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-07T20:16:00.645 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-07T20:16:00.645 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-07T20:16:00.645 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:16:00.646 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:16:00.647 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:16:00.648 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:16:00.648 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:16:00.648 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:16:00.649 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-07T20:16:00.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:16:00.765 INFO:teuthology.dispatcher.supervisor:Running job 7360735 2023-08-07T20:16:00.765 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360735 --name rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/metrics} -- /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360735/orig.config.yaml 2023-08-07T20:16:00.769 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360735 2023-08-07T20:16:00.770 INFO:teuthology.dispatcher.supervisor:Job PID: 29301 2023-08-07T20:16:00.770 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-07T20:18:00.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:20:00.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:22:01.045 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:24:01.205 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:26:01.389 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:28:01.565 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:30:01.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:32:01.893 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:34:02.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:36:02.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:38:02.382 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:40:02.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:42:02.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:44:02.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:46:03.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:48:03.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:50:03.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:52:03.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:54:03.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:56:03.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:58:04.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:00:04.160 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:02:04.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:04:04.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:06:04.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:06:04.758 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-07T21:06:04.866 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-07T21:06:04.866 INFO:teuthology.nuke:Checking targets against current locks 2023-08-07T21:06:04.909 DEBUG:teuthology.nuke:shortname: smithi102 2023-08-07T21:06:04.910 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T21:06:04.932 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 20:11:09.284620', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrg43oyR3DHhhArQb5Do6pcBujrsk8KuArEwqRfZY0LebEmPrknhcpawyVSqFds92SGNMpP+6DDWAdomTNQY4U='} 2023-08-07T21:06:04.937 DEBUG:teuthology.nuke:shortname: smithi112 2023-08-07T21:06:04.937 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T21:06:04.961 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360735', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 20:11:09.286472', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPKLyY7YH6kWmH8dKtZKRhC/RLmJfoViEDdVulGyKaZ/GZo8G2LWw0McndevgtcAdrEags8MYEH5pyv3CBIUR8='} 2023-08-07T21:06:04.991 INFO:teuthology.orchestra.console.smithi102:Power off 2023-08-07T21:06:04.991 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T21:06:05.008 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-07T21:06:05.008 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T21:06:05.018 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2023-08-07T21:06:05.019 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T21:06:05.030 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-07T21:06:05.032 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T21:06:05.041 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2023-08-07T21:06:05.054 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-07T21:06:05.143 INFO:teuthology.orchestra.console.smithi102:Power off completed 2023-08-07T21:06:05.155 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-07T21:06:05.296 INFO:teuthology.lock.ops:unlocked: smithi102.front.sepia.ceph.com 2023-08-07T21:06:05.306 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com