2023-10-31T11:44:27.182 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-31T11:44:27.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:44:27.329 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5bff2a670>, signals=[15]) 2023-10-31T11:44:27.331 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-10-31T11:44:27.332 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-10-31T11:44:27.332 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-31T11:44:27.359 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2023-10-31T11:44:27.360 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2023-10-31T11:44:27.360 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-31T11:44:27.362 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-10-31T11:44:27.384 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /host {"name": "smithi153"} 2023-10-31T11:44:27.441 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-31T11:44:27.466 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-10-31T11:44:27.484 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_8.stream (ID 3) 2023-10-31T11:44:27.485 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 3} 2023-10-31T11:44:27.507 DEBUG:teuthology.provision.fog.smithi153:Requesting image smithi_centos_8.stream (ID 3) 2023-10-31T11:44:27.507 DEBUG:teuthology.provision.fog.smithi153:FOG request: PUT /host/258 {"imageID": 3} 2023-10-31T11:44:27.531 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 8.stream 2023-10-31T11:44:27.531 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:44:27.554 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2023-10-31T11:44:27.555 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:44:27.573 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-10-31T11:44:27.603 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /tasktype {"name": "deploy"} 2023-10-31T11:44:27.607 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-10-31T11:44:27.640 DEBUG:teuthology.provision.fog.smithi153:FOG request: POST /host/258/task {"taskTypeID": 1} 2023-10-31T11:44:27.667 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:44:27.706 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:44:27.758 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-31T11:44:27.759 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:44:27.783 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-31T11:44:27.784 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:27.798 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-31T11:44:27.798 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T11:44:27.810 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-31T11:44:27.821 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-31T11:44:27.822 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:27.844 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-31T11:44:31.816 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:31.845 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:31.925 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-31T11:44:31.955 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-31T11:44:35.931 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:35.955 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:36.040 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-31T11:44:36.064 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-31T11:44:36.165 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-31T11:44:36.266 INFO:teuthology.orchestra.console.smithi153:Power on 2023-10-31T11:44:36.266 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-31T11:44:36.287 DEBUG:teuthology.orchestra.console.smithi153:power on output: Chassis Power Control: Up/On 2023-10-31T11:44:36.288 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:36.311 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-31T11:44:40.045 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:40.154 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-31T11:44:40.255 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-31T11:44:40.313 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:40.357 INFO:teuthology.orchestra.console.smithi059:Power on 2023-10-31T11:44:40.357 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-31T11:44:40.378 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-10-31T11:44:40.379 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:40.400 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-31T11:44:40.422 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-31T11:44:44.404 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:44.423 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T11:44:44.514 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-31T11:44:44.533 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-10-31T11:44:44.616 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-10-31T11:44:44.634 INFO:teuthology.orchestra.console.smithi153:Power on completed 2023-10-31T11:44:44.718 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-10-31T11:44:44.718 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:44:44.736 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2023-10-31T11:44:44.736 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:44:59.797 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:44:59.800 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:45:14.878 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:45:14.880 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:45:29.942 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:45:29.943 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:45:45.018 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:45:45.020 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:46:00.090 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:46:00.092 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:46:15.157 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:46:15.160 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:46:30.227 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:46:30.228 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:46:45.307 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:46:45.309 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:47:00.392 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:47:00.394 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:47:15.467 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-10-31T11:47:15.469 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:47:15.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:30.547 DEBUG:teuthology.provision.fog.smithi153:FOG request: GET /task/active None 2023-10-31T11:47:30.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:33.882 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-31T11:47:39.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:42.970 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-31T11:47:48.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:48.986 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-31T11:47:52.026 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-31T11:47:54.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:58.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:47:58.046 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-31T11:48:01.082 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-31T11:48:04.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:48:07.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:48:07.130 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-31T11:48:13.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:48:16.218 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-31T11:48:22.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:48:25.275 WARNING:teuthology.provision.fog.smithi153:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-10-31T11:48:31.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:49:07.123 WARNING:teuthology.provision.fog.smithi059:timed out 2023-10-31T11:49:13.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:49:13.398 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-31T11:49:13.399 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-31T11:49:13.651 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-10-31T11:49:13.651 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-10-31T11:49:13.672 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-10-31T11:49:13.673 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-10-31T11:49:13.734 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-10-31T11:49:13.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-31T11:49:13.845 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-10-31T11:49:13.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-10-31T11:49:13.949 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-10-31T11:49:14.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-10-31T11:49:14.091 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-31T11:49:14.151 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-31T11:49:14.151 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-10-31T11:49:14.151 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-31T11:49:14.151 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:49:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-10-31T11:49:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:49:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:49:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-31T11:49:14.152 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:49:14.153 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:49:14.153 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:49:14.153 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:49:14.153 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:49:14.154 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-10-31T11:49:14.156 DEBUG:teuthology.parallel:result is None 2023-10-31T11:49:31.298 WARNING:teuthology.provision.fog.smithi153:timed out 2023-10-31T11:49:37.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:49:37.573 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-31T11:49:37.574 DEBUG:teuthology.orchestra.run.smithi153:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-31T11:49:37.808 INFO:teuthology.provision.fog.smithi153:Node is ready 2023-10-31T11:49:37.809 DEBUG:teuthology.orchestra.run.smithi153:> hostname 2023-10-31T11:49:37.828 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2023-10-31T11:49:37.828 DEBUG:teuthology.orchestra.run.smithi153:> grep smithi153.front.sepia.ceph.com /etc/hosts 2023-10-31T11:49:37.887 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2023-10-31T11:49:37.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-31T11:49:38.002 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hosts 2023-10-31T11:49:38.031 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/172.21.15.153/172.21.15.153/g' /etc/hosts 2023-10-31T11:49:38.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i -e 's/smithi153.front.sepia.ceph.com/smithi153/g' /etc/hostname 2023-10-31T11:49:38.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo hostname smithi153 2023-10-31T11:49:38.235 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-31T11:49:38.293 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-10-31T11:49:38.293 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-10-31T11:49:38.294 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-10-31T11:49:38.294 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:49:38.294 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-10-31T11:49:38.294 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:49:38.294 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:49:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-31T11:49:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:49:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:49:38.295 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:49:38.296 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:49:38.296 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:49:38.296 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2023-10-31T11:49:38.297 DEBUG:teuthology.parallel:result is None 2023-10-31T11:49:38.459 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-10-31T11:49:38.460 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-31T11:49:38.484 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2023-10-31T11:49:38.485 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-31T11:49:38.511 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-10-31T11:49:38.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-31T11:49:38.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:49:38.583 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-31T11:49:38.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-31T11:49:38.726 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-31T11:49:38.786 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-31T11:49:38.786 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-31T11:49:38.846 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-10-31T11:49:38.847 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8" 2023-10-31T11:49:38.847 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-10-31T11:49:38.847 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:49:38.847 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8" 2023-10-31T11:49:38.848 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:49:38.848 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:49:38.848 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-31T11:49:38.848 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:49:38.849 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:49:38.849 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:49:38.849 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:49:38.849 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:49:38.850 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-31T11:49:38.877 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2023-10-31T11:49:38.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-31T11:49:38.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-31T11:49:38.948 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-10-31T11:49:39.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-10-31T11:49:39.021 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-10-31T11:49:39.079 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-10-31T11:49:39.080 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-10-31T11:49:39.138 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2023-10-31T11:49:39.138 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2023-10-31T11:49:39.138 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2023-10-31T11:49:39.139 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2023-10-31T11:49:39.139 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2023-10-31T11:49:39.139 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2023-10-31T11:49:39.139 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-31T11:49:39.140 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2023-10-31T11:49:39.140 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-31T11:49:39.140 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2023-10-31T11:49:39.140 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-31T11:49:39.140 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-31T11:49:39.141 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-31T11:49:39.141 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-10-31T11:49:39.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:49:39.262 INFO:teuthology.dispatcher.supervisor:Running job 7441938 2023-10-31T11:49:39.263 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441938 --name dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi --description fs:upgrade/upgraded_client/{bluestore-bitmap branch/pacific centos_8.stream clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-install 1-mount/mount/fuse 2-upgrade 3-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} -- /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441938/orig.config.yaml 2023-10-31T11:49:39.266 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441938 2023-10-31T11:49:39.267 INFO:teuthology.dispatcher.supervisor:Job PID: 3976251 2023-10-31T11:49:39.267 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-31T11:51:39.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:53:39.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:55:39.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:57:39.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T11:59:40.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:01:40.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:03:40.271 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:05:40.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:07:40.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:09:40.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:11:40.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:13:41.112 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:15:41.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:17:41.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:19:41.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:21:41.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:23:41.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-31T12:23:42.061 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-31T12:23:42.168 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-31T12:23:42.169 INFO:teuthology.nuke:Checking targets against current locks 2023-10-31T12:23:42.221 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-31T12:23:42.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-31T12:23:42.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 11:44:26.329924', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJGEpiXuMml5Wq0YMKylv1h/dsM08/gTwsvC0BLqaWTwr+6ghqSd3/5NxM4EfiEc9ZV0LGxL+eyrRRFeVAg+tJ4='} 2023-10-31T12:23:42.242 DEBUG:teuthology.nuke:shortname: smithi153 2023-10-31T12:23:42.242 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-31T12:23:42.262 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dparmar-2023-10-31_11:02:23-fs:upgrade-wip-vshankar-testing-20231018.065603-distro-default-smithi/7441938', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-31 11:44:26.328426', 'locked_by': 'scheduled_dparmar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJBTmeeud3CLTr3lh/LO0ll7DeZz26hElSFbvroXq0JWxQAx1tf0vLWgg88XSxqNbPALnPzvAuaNFlTEOzTUldA='} 2023-10-31T12:23:42.283 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-31T12:23:42.284 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T12:23:42.307 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-31T12:23:42.307 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T12:23:42.321 INFO:teuthology.orchestra.console.smithi153:Power off 2023-10-31T12:23:42.321 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-31T12:23:42.330 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-31T12:23:42.342 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-10-31T12:23:42.342 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-31T12:23:42.363 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-10-31T12:23:42.431 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-31T12:23:42.465 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-10-31T12:23:42.588 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com 2023-10-31T12:23:42.611 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com