2023-08-10T10:30:46.070 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T10:30:46.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:30:46.205 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa2ea6b3ee0>, signals=[15]) 2023-08-10T10:30:46.207 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2023-08-10T10:30:46.207 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T10:30:46.208 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-08-10T10:30:46.230 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2023-08-10T10:30:46.231 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2023-08-10T10:30:46.231 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-08-10T10:30:46.232 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /host {"name": "smithi152"} 2023-08-10T10:30:46.255 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /host {"name": "smithi156"} 2023-08-10T10:30:46.318 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-10T10:30:46.329 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-10T10:30:46.360 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_9.stream (ID 10) 2023-08-10T10:30:46.360 DEBUG:teuthology.provision.fog.smithi152:FOG request: PUT /host/257 {"imageID": 10} 2023-08-10T10:30:46.376 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10) 2023-08-10T10:30:46.376 DEBUG:teuthology.provision.fog.smithi156:FOG request: PUT /host/261 {"imageID": 10} 2023-08-10T10:30:46.402 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 9.stream 2023-08-10T10:30:46.402 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:30:46.422 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream 2023-08-10T10:30:46.422 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:30:46.483 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T10:30:46.504 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /tasktype {"name": "deploy"} 2023-08-10T10:30:46.532 DEBUG:teuthology.provision.fog.smithi152:FOG request: POST /host/257/task {"taskTypeID": 1} 2023-08-10T10:30:46.546 DEBUG:teuthology.provision.fog.smithi156:FOG request: POST /host/261/task {"taskTypeID": 1} 2023-08-10T10:30:46.583 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:30:46.599 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:30:46.683 INFO:teuthology.orchestra.console.smithi152:Power off 2023-08-10T10:30:46.684 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:30:46.700 INFO:teuthology.orchestra.console.smithi156:Power off 2023-08-10T10:30:46.700 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:30:46.709 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-08-10T10:30:46.710 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:46.721 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-08-10T10:30:46.721 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:46.729 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-08-10T10:30:46.742 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-08-10T10:30:46.830 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-08-10T10:30:46.843 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-08-10T10:30:46.932 INFO:teuthology.orchestra.console.smithi152:Power on 2023-08-10T10:30:46.932 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T10:30:46.944 INFO:teuthology.orchestra.console.smithi156:Power on 2023-08-10T10:30:46.944 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-10T10:30:46.953 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2023-08-10T10:30:46.955 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:46.967 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On 2023-08-10T10:30:46.967 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:46.975 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-08-10T10:30:46.986 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-08-10T10:30:50.980 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:50.988 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:51.090 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-08-10T10:30:51.097 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-08-10T10:30:55.094 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:55.102 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:30:55.204 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2023-08-10T10:30:55.211 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-08-10T10:30:55.305 INFO:teuthology.orchestra.console.smithi152:Power on completed 2023-08-10T10:30:55.311 INFO:teuthology.orchestra.console.smithi156:Power on completed 2023-08-10T10:30:55.407 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2023-08-10T10:30:55.407 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:30:55.412 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2023-08-10T10:30:55.412 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:31:10.540 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:31:10.542 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:31:25.627 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:31:25.628 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:31:40.708 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:31:40.709 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:31:55.786 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:31:55.799 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:32:10.872 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:32:10.874 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:32:25.964 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:32:25.966 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:32:41.120 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:32:41.125 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:32:56.212 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:32:56.214 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:33:11.309 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:33:11.310 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:33:26.396 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:33:26.398 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:33:41.493 DEBUG:teuthology.provision.fog.smithi152:FOG request: GET /task/active None 2023-08-10T10:33:41.494 DEBUG:teuthology.provision.fog.smithi156:FOG request: GET /task/active None 2023-08-10T10:33:41.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:33:41.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:33:44.628 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:33:44.629 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:33:50.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:33:50.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:33:53.712 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:33:53.713 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:33:59.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:33:59.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:02.800 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:34:02.801 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:34:08.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:08.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:11.888 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:34:11.889 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:34:17.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:17.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:20.948 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:34:20.949 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:34:26.952 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:26.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:30.036 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2023-08-10T10:34:30.037 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:34:36.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:36.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:34:54.448 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:35:00.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:03.504 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156 2023-08-10T10:35:09.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:12.349 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T10:35:12.350 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T10:35:36.044 WARNING:teuthology.provision.fog.smithi152:timed out 2023-08-10T10:35:37.586 INFO:teuthology.provision.fog.smithi156:Node is ready 2023-08-10T10:35:37.587 DEBUG:teuthology.orchestra.run.smithi156:> hostname 2023-08-10T10:35:37.605 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2023-08-10T10:35:37.606 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts 2023-08-10T10:35:37.663 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2023-08-10T10:35:37.663 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-08-10T10:35:37.789 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts 2023-08-10T10:35:37.819 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts 2023-08-10T10:35:37.889 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname 2023-08-10T10:35:37.958 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156 2023-08-10T10:35:38.026 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-08-10T10:35:38.081 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-08-10T10:35:38.081 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-08-10T10:35:38.082 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-08-10T10:35:38.082 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:35:38.082 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-08-10T10:35:38.082 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:35:38.083 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:35:38.083 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-08-10T10:35:38.083 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:35:38.084 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:35:38.084 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:35:38.084 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:35:38.084 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:35:38.085 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:35:38.086 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2023-08-10T10:35:38.087 DEBUG:teuthology.parallel:result is None 2023-08-10T10:35:42.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:42.295 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-10T10:35:42.295 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-10T10:35:42.583 INFO:teuthology.provision.fog.smithi152:Node is ready 2023-08-10T10:35:42.584 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2023-08-10T10:35:42.598 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2023-08-10T10:35:42.598 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2023-08-10T10:35:42.652 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2023-08-10T10:35:42.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-08-10T10:35:42.781 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2023-08-10T10:35:42.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2023-08-10T10:35:42.875 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2023-08-10T10:35:42.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2023-08-10T10:35:43.009 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-08-10T10:35:43.063 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-08-10T10:35:43.063 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-08-10T10:35:43.064 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:35:43.065 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:35:43.065 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2023-08-10T10:35:43.066 DEBUG:teuthology.parallel:result is None 2023-08-10T10:35:43.205 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2023-08-10T10:35:43.206 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:35:43.230 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2023-08-10T10:35:43.231 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-10T10:35:43.257 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:35:43.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-08-10T10:35:43.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:43.342 DEBUG:teuthology.orchestra.run.smithi152:> true 2023-08-10T10:35:43.410 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2023-08-10T10:35:43.410 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2023-08-10T10:35:43.463 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2023-08-10T10:35:43.464 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2023-08-10T10:35:43.518 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2023-08-10T10:35:43.518 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2023-08-10T10:35:43.519 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2023-08-10T10:35:43.519 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:35:43.519 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2023-08-10T10:35:43.519 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:35:43.520 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:35:43.520 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2023-08-10T10:35:43.520 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:35:43.521 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:35:43.521 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:35:43.521 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:35:43.522 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:35:43.522 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:35:43.523 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2023-08-10T10:35:43.556 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2023-08-10T10:35:43.556 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-08-10T10:35:43.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:35:43.638 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-08-10T10:35:43.712 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-08-10T10:35:43.712 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-08-10T10:35:43.768 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-08-10T10:35:43.768 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-08-10T10:35:43.824 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2023-08-10T10:35:43.824 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9" 2023-08-10T10:35:43.824 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2023-08-10T10:35:43.824 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-10T10:35:43.825 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:35:43.826 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:35:43.826 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-10T10:35:43.826 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:35:43.826 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-08-10T10:35:43.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:35:43.941 INFO:teuthology.dispatcher.supervisor:Running job 7364568 2023-08-10T10:35:43.941 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364568 --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/iozone}}} -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364568/orig.config.yaml 2023-08-10T10:35:43.945 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364568 2023-08-10T10:35:43.946 INFO:teuthology.dispatcher.supervisor:Job PID: 22182 2023-08-10T10:35:43.946 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-10T10:37:43.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:39:44.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:41:44.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:43:44.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:45:44.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:47:44.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:49:44.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:51:45.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:53:45.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:55:45.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:57:45.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:59:45.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:01:45.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:03:45.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:05:46.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:07:46.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:09:46.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T11:09:46.534 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-10T11:09:46.637 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-10T11:09:46.638 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T11:09:46.682 DEBUG:teuthology.nuke:shortname: smithi152 2023-08-10T11:09:46.683 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:09:46.698 DEBUG:teuthology.nuke:shortname: smithi156 2023-08-10T11:09:46.698 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T11:09:46.701 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 10:30:45.281473', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMe2o5YfaL46iJ72hNsxgfckdWAqhuOsjeS2eN7OlvzEcJrkZars2ZoB67Ttzvgo1AsxNdPYtmKMBm8+XbcUeho='} 2023-08-10T11:09:46.718 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364568', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 10:30:45.279460', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG5MLot/Jo2EryV0TJloDcLZL1wRlfnMeSJnOo1KCAZqH7ODu+E3tKzm2X+FHsscCjTpE8/wTBC5UspVXj8gyQs='} 2023-08-10T11:09:46.748 INFO:teuthology.orchestra.console.smithi152:Power off 2023-08-10T11:09:46.749 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T11:09:46.771 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2023-08-10T11:09:46.771 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:09:46.786 INFO:teuthology.orchestra.console.smithi156:Power off 2023-08-10T11:09:46.786 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T11:09:46.796 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2023-08-10T11:09:46.806 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-08-10T11:09:46.806 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T11:09:46.826 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-08-10T11:09:46.898 INFO:teuthology.orchestra.console.smithi152:Power off completed 2023-08-10T11:09:46.927 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-08-10T11:09:47.051 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2023-08-10T11:09:47.073 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com