2023-08-30T23:15:19.770 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T23:15:19.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:15:19.940 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f400b2a0670>, signals=[15]) 2023-08-30T23:15:19.941 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-08-30T23:15:19.942 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T23:15:19.942 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-08-30T23:15:19.973 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2023-08-30T23:15:19.973 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T23:15:19.973 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-30T23:15:19.975 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /host {"name": "smithi002"} 2023-08-30T23:15:20.001 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /host {"name": "smithi192"} 2023-08-30T23:15:20.051 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T23:15:20.066 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T23:15:20.093 DEBUG:teuthology.provision.fog.smithi002:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T23:15:20.094 DEBUG:teuthology.provision.fog.smithi002:FOG request: PUT /host/108 {"imageID": 3} 2023-08-30T23:15:20.107 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T23:15:20.107 DEBUG:teuthology.provision.fog.smithi192:FOG request: PUT /host/297 {"imageID": 3} 2023-08-30T23:15:20.135 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream 2023-08-30T23:15:20.136 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:15:20.156 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream 2023-08-30T23:15:20.156 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:15:20.205 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T23:15:20.217 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T23:15:20.244 DEBUG:teuthology.provision.fog.smithi002:FOG request: POST /host/108/task {"taskTypeID": 1} 2023-08-30T23:15:20.255 DEBUG:teuthology.provision.fog.smithi192:FOG request: POST /host/297/task {"taskTypeID": 1} 2023-08-30T23:15:20.297 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:15:20.316 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:15:20.416 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-30T23:15:20.417 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:15:20.434 INFO:teuthology.orchestra.console.smithi002:Power off 2023-08-30T23:15:20.435 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:15:20.444 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-30T23:15:20.444 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:20.457 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-08-30T23:15:20.459 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:20.471 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-30T23:15:20.479 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-30T23:15:20.572 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-30T23:15:20.580 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-08-30T23:15:20.674 INFO:teuthology.orchestra.console.smithi192:Power on 2023-08-30T23:15:20.674 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T23:15:20.682 INFO:teuthology.orchestra.console.smithi002:Power on 2023-08-30T23:15:20.682 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T23:15:20.694 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2023-08-30T23:15:20.695 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:20.704 DEBUG:teuthology.orchestra.console.smithi002:power on output: Chassis Power Control: Up/On 2023-08-30T23:15:20.705 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:20.716 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-30T23:15:20.724 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-30T23:15:24.718 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:24.725 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:24.827 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-30T23:15:24.833 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-30T23:15:28.830 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:28.838 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:15:28.940 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2023-08-30T23:15:28.949 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is on 2023-08-30T23:15:29.041 INFO:teuthology.orchestra.console.smithi192:Power on completed 2023-08-30T23:15:29.051 INFO:teuthology.orchestra.console.smithi002:Power on completed 2023-08-30T23:15:29.142 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2023-08-30T23:15:29.142 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:15:29.152 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-08-30T23:15:29.153 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:15:44.235 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:15:44.236 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:15:59.358 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:15:59.359 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:16:14.478 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:16:14.479 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:16:29.574 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:16:29.575 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:16:44.686 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:16:44.687 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:16:59.802 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:16:59.803 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:17:14.898 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:17:14.900 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:17:29.994 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:17:29.995 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:17:45.102 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:17:45.105 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:18:00.218 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:18:00.219 DEBUG:teuthology.provision.fog.smithi002:FOG request: GET /task/active None 2023-08-30T23:18:00.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:03.390 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:09.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:12.474 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:15.342 DEBUG:teuthology.provision.fog.smithi192:FOG request: GET /task/active None 2023-08-30T23:18:15.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:18.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:18.494 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:18:21.530 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:24.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:27.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:27.578 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:18:30.586 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:33.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:36.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:36.634 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:18:39.642 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:42.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:45.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:45.694 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:18:48.698 WARNING:teuthology.provision.fog.smithi002:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-08-30T23:18:51.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:18:54.778 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:19:00.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:19:03.838 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-08-30T23:19:09.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:19:54.746 WARNING:teuthology.provision.fog.smithi002:timed out 2023-08-30T23:20:00.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:20:00.965 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T23:20:00.966 DEBUG:teuthology.orchestra.run.smithi002:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T23:20:01.226 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-08-30T23:20:01.227 DEBUG:teuthology.orchestra.run.smithi002:> hostname 2023-08-30T23:20:01.248 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-08-30T23:20:01.248 DEBUG:teuthology.orchestra.run.smithi002:> grep smithi002.front.sepia.ceph.com /etc/hosts 2023-08-30T23:20:01.310 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-08-30T23:20:01.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-08-30T23:20:01.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hosts 2023-08-30T23:20:01.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/172.21.15.2/172.21.15.2/g' /etc/hosts 2023-08-30T23:20:01.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i -e 's/smithi002.front.sepia.ceph.com/smithi002/g' /etc/hostname 2023-08-30T23:20:01.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo hostname smithi002 2023-08-30T23:20:01.676 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-08-30T23:20:01.735 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-08-30T23:20:01.736 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8" 2023-08-30T23:20:01.736 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-08-30T23:20:01.736 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:20:01.736 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2023-08-30T23:20:01.737 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:20:01.737 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:20:01.737 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-08-30T23:20:01.737 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:20:01.738 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:20:01.738 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:20:01.738 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:20:01.738 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:20:01.742 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-08-30T23:20:01.743 DEBUG:teuthology.parallel:result is None 2023-08-30T23:20:09.854 WARNING:teuthology.provision.fog.smithi192:timed out 2023-08-30T23:20:15.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:20:16.062 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T23:20:16.062 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T23:20:16.298 INFO:teuthology.provision.fog.smithi192:Node is ready 2023-08-30T23:20:16.299 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2023-08-30T23:20:16.318 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2023-08-30T23:20:16.318 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2023-08-30T23:20:16.378 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2023-08-30T23:20:16.379 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-30T23:20:16.477 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2023-08-30T23:20:16.507 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2023-08-30T23:20:16.576 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2023-08-30T23:20:16.644 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2023-08-30T23:20:16.711 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-30T23:20:16.769 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-08-30T23:20:16.769 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-08-30T23:20:16.770 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-08-30T23:20:16.770 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:20:16.770 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-08-30T23:20:16.770 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:20:16.771 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:20:16.771 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-08-30T23:20:16.771 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:20:16.771 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:20:16.773 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:20:16.773 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:20:16.774 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:20:16.774 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2023-08-30T23:20:16.775 DEBUG:teuthology.parallel:result is None 2023-08-30T23:20:16.945 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-08-30T23:20:16.945 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T23:20:16.971 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2023-08-30T23:20:16.971 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T23:20:16.997 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-08-30T23:20:16.997 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-08-30T23:20:16.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:20:17.066 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-08-30T23:20:17.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-08-30T23:20:17.203 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-08-30T23:20:17.262 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-08-30T23:20:17.263 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-08-30T23:20:17.322 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-08-30T23:20:17.322 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8" 2023-08-30T23:20:17.323 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-08-30T23:20:17.323 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:20:17.323 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2023-08-30T23:20:17.323 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:20:17.324 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:20:17.324 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-08-30T23:20:17.324 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:20:17.324 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:20:17.324 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:20:17.325 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:20:17.325 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:20:17.325 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-08-30T23:20:17.346 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2023-08-30T23:20:17.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-30T23:20:17.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T23:20:17.413 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-08-30T23:20:17.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-08-30T23:20:17.483 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-08-30T23:20:17.540 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-08-30T23:20:17.540 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-08-30T23:20:17.598 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2023-08-30T23:20:17.598 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8" 2023-08-30T23:20:17.599 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2023-08-30T23:20:17.599 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2023-08-30T23:20:17.599 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8" 2023-08-30T23:20:17.599 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8" 2023-08-30T23:20:17.599 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T23:20:17.600 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2023-08-30T23:20:17.600 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T23:20:17.600 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2023-08-30T23:20:17.600 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T23:20:17.601 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T23:20:17.601 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T23:20:17.601 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-08-30T23:20:17.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:20:17.722 INFO:teuthology.dispatcher.supervisor:Running job 7384895 2023-08-30T23:20:17.722 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384895 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/stress_tests/{0-client-upgrade 1-tests/dbench}}} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384895/orig.config.yaml 2023-08-30T23:20:17.726 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384895 2023-08-30T23:20:17.727 INFO:teuthology.dispatcher.supervisor:Job PID: 3866324 2023-08-30T23:20:17.727 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T23:22:17.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:24:17.994 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:26:18.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:28:18.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:30:18.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:32:18.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:34:18.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:36:19.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:36:19.072 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T23:36:19.198 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T23:36:19.198 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T23:36:19.251 DEBUG:teuthology.nuke:shortname: smithi002 2023-08-30T23:36:19.252 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:36:19.276 DEBUG:teuthology.nuke:shortname: smithi192 2023-08-30T23:36:19.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:36:19.280 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 23:15:18.853027', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKdN4Zj+uVMN0M0YE3sPqKOX2zhZSlTv5LRhSvT75ghtMvIeQ/uIQ58e+mbV86s4XfaJ+LLhvHi4dg5MRGSqWS4='} 2023-08-30T23:36:19.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384895', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 23:15:18.854473', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD2pe/wUP5zaD/Z1kLvnpISw/2HO3R4zflDJ5Qdu7wa/VzFdya25UuxUPztEcApoxUtLEfZG5Vi7U4jvL+k/2k+0a3VmyQYN37aNLBIFBrRH78W2nK1jAQc3vDCuDbEeNt7IEvozFWeusCRSFoDxylskWGdL2hFdjXaM2t6aaAbeEjVbvvlJ/+3XbkHZdpc9ROi0/D0f5Ia+STfUmrMWeH7U3H7XgpsSzg0q828zZSn8XqtjESX7RmwLuw5HxbCA792dBQtlBBVimKzwEvkUyKU3kBq6IM2KgLrsfidXCBwCO52kj4+ZCQoHt+xLfAbdLyFMa3N/gF5JvOdv8MFcGc2jniaKTf93MsJZ125rLVReO+9x/NdOnrBVJhTj5nGRqtbaot33F+0/JiWHvDFXdJ2yrFO89OGa6Z224ZOXpeNZApLy/z97orAdwPvhgizDFMIWYovmDJEjWJofdGbhrJrwN8ZENjptgWQ6ulV/dkgCptdlK0Kq4juivyQRyn49F0='} 2023-08-30T23:36:19.340 INFO:teuthology.orchestra.console.smithi002:Power off 2023-08-30T23:36:19.340 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:36:19.362 DEBUG:teuthology.orchestra.console.smithi002:power off output: Chassis Power Control: Down/Off 2023-08-30T23:36:19.363 DEBUG:teuthology.orchestra.console.smithi002:pexpect command: ipmitool -H smithi002.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:36:19.379 INFO:teuthology.orchestra.console.smithi192:Power off 2023-08-30T23:36:19.379 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:36:19.388 DEBUG:teuthology.orchestra.console.smithi002:check power output: Chassis Power is off 2023-08-30T23:36:19.400 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2023-08-30T23:36:19.400 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:36:19.421 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2023-08-30T23:36:19.489 INFO:teuthology.orchestra.console.smithi002:Power off completed 2023-08-30T23:36:19.523 INFO:teuthology.orchestra.console.smithi192:Power off completed 2023-08-30T23:36:19.645 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-08-30T23:36:19.661 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com