2023-11-06T18:05:33.366 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-06T18:05:33.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:05:33.511 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5407766670>, signals=[15]) 2023-11-06T18:05:33.513 INFO:teuthology.lock.ops:Start node 'smithi019.front.sepia.ceph.com' reimaging 2023-11-06T18:05:33.513 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: reset os type and version on server 2023-11-06T18:05:33.514 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-11-06T18:05:33.536 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2023-11-06T18:05:33.536 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2023-11-06T18:05:33.536 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-06T18:05:33.538 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /host {"name": "smithi019"} 2023-11-06T18:05:33.560 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"} 2023-11-06T18:05:33.615 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-06T18:05:33.633 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-11-06T18:05:33.657 DEBUG:teuthology.provision.fog.smithi019:Requesting image smithi_centos_9.stream (ID 10) 2023-11-06T18:05:33.657 DEBUG:teuthology.provision.fog.smithi019:FOG request: PUT /host/125 {"imageID": 10} 2023-11-06T18:05:33.684 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_9.stream (ID 10) 2023-11-06T18:05:33.684 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 10} 2023-11-06T18:05:33.704 INFO:teuthology.provision.fog.smithi019:Scheduling deploy of centos 9.stream 2023-11-06T18:05:33.705 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:05:33.736 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 9.stream 2023-11-06T18:05:33.737 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:05:33.757 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /tasktype {"name": "deploy"} 2023-11-06T18:05:33.790 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"} 2023-11-06T18:05:33.793 DEBUG:teuthology.provision.fog.smithi019:FOG request: POST /host/125/task {"taskTypeID": 1} 2023-11-06T18:05:33.832 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1} 2023-11-06T18:05:33.840 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:05:33.876 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:05:33.927 INFO:teuthology.orchestra.console.smithi019:Power off 2023-11-06T18:05:33.928 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-06T18:05:33.950 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-11-06T18:05:33.950 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:33.967 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-06T18:05:33.967 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-06T18:05:33.975 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-06T18:05:33.997 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-06T18:05:33.998 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:34.021 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-06T18:05:37.981 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:38.023 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:38.090 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-06T18:05:38.132 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-06T18:05:42.094 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:42.134 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:42.204 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-11-06T18:05:42.243 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-06T18:05:42.305 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-11-06T18:05:42.406 INFO:teuthology.orchestra.console.smithi019:Power on 2023-11-06T18:05:42.406 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-06T18:05:42.429 DEBUG:teuthology.orchestra.console.smithi019:power on output: Chassis Power Control: Up/On 2023-11-06T18:05:42.430 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:42.451 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-11-06T18:05:46.247 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:46.357 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-06T18:05:46.452 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:46.461 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-06T18:05:46.563 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is on 2023-11-06T18:05:46.563 INFO:teuthology.orchestra.console.smithi129:Power on 2023-11-06T18:05:46.564 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-06T18:05:46.592 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On 2023-11-06T18:05:46.593 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:46.624 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-06T18:05:46.663 INFO:teuthology.orchestra.console.smithi019:Power on completed 2023-11-06T18:05:46.764 INFO:teuthology.provision.fog.smithi019:Waiting for deploy to finish 2023-11-06T18:05:46.765 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:05:50.626 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:50.736 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-06T18:05:54.738 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T18:05:54.847 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on 2023-11-06T18:05:54.948 INFO:teuthology.orchestra.console.smithi129:Power on completed 2023-11-06T18:05:55.049 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2023-11-06T18:05:55.050 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:06:01.838 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:06:10.117 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:06:16.910 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:06:25.194 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:06:31.999 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:06:40.262 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:06:47.083 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:06:55.338 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:07:02.170 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:07:10.414 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:07:17.242 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:07:25.498 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:07:32.314 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:07:40.562 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:07:47.386 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:07:55.641 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:08:02.453 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:08:10.704 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:08:17.526 DEBUG:teuthology.provision.fog.smithi019:FOG request: GET /task/active None 2023-11-06T18:08:17.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:08:25.770 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None 2023-11-06T18:08:25.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:08:35.963 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-06T18:08:41.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:08:44.154 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-06T18:08:45.054 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-06T18:08:50.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:08:51.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:08:53.210 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-06T18:08:54.138 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-06T18:08:59.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:09:00.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:09:02.298 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-06T18:09:03.194 WARNING:teuthology.provision.fog.smithi019:[Errno None] Unable to connect to port 22 on 172.21.15.19 2023-11-06T18:09:08.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:09:09.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:09:11.389 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-06T18:09:17.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:09:20.478 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129 2023-11-06T18:09:26.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:10:09.233 WARNING:teuthology.provision.fog.smithi019:timed out 2023-11-06T18:10:15.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:10:15.472 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-06T18:10:15.473 DEBUG:teuthology.orchestra.run.smithi019:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-06T18:10:15.830 INFO:teuthology.provision.fog.smithi019:Node is ready 2023-11-06T18:10:15.830 DEBUG:teuthology.orchestra.run.smithi019:> hostname 2023-11-06T18:10:15.846 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019.front.sepia.ceph.com 2023-11-06T18:10:15.847 DEBUG:teuthology.orchestra.run.smithi019:> grep smithi019.front.sepia.ceph.com /etc/hosts 2023-11-06T18:10:15.903 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19 smithi019.front.sepia.ceph.com smithi019 2023-11-06T18:10:15.903 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-11-06T18:10:16.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hosts 2023-11-06T18:10:16.048 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/172.21.15.19/172.21.15.19/g' /etc/hosts 2023-11-06T18:10:16.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i -e 's/smithi019.front.sepia.ceph.com/smithi019/g' /etc/hostname 2023-11-06T18:10:16.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname smithi019 2023-11-06T18:10:16.261 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-11-06T18:10:16.316 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2023-11-06T18:10:16.317 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-06T18:10:16.318 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-11-06T18:10:16.318 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2023-11-06T18:10:16.318 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-06T18:10:16.318 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-11-06T18:10:16.318 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T18:10:16.319 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-06T18:10:16.319 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-06T18:10:16.319 INFO:teuthology.provision.fog.smithi019:Deploy complete! 2023-11-06T18:10:16.321 DEBUG:teuthology.parallel:result is None 2023-11-06T18:10:26.494 WARNING:teuthology.provision.fog.smithi129:timed out 2023-11-06T18:10:32.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:10:32.710 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-06T18:10:32.711 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-06T18:10:33.031 INFO:teuthology.provision.fog.smithi129:Node is ready 2023-11-06T18:10:33.031 DEBUG:teuthology.orchestra.run.smithi129:> hostname 2023-11-06T18:10:33.045 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2023-11-06T18:10:33.046 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts 2023-11-06T18:10:33.101 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2023-11-06T18:10:33.101 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-06T18:10:33.225 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts 2023-11-06T18:10:33.253 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts 2023-11-06T18:10:33.320 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname 2023-11-06T18:10:33.386 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129 2023-11-06T18:10:33.453 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-06T18:10:33.507 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-06T18:10:33.507 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-11-06T18:10:33.508 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-06T18:10:33.508 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-06T18:10:33.508 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-11-06T18:10:33.508 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-11-06T18:10:33.508 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T18:10:33.509 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-06T18:10:33.510 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-06T18:10:33.510 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2023-11-06T18:10:33.511 DEBUG:teuthology.parallel:result is None 2023-11-06T18:10:33.676 INFO:teuthology.lock.ops:Checking smithi019.front.sepia.ceph.com 2023-11-06T18:10:33.677 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-06T18:10:33.705 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2023-11-06T18:10:33.706 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-06T18:10:33.723 INFO:teuthology.lock.ops:Updating [smithi019.front.sepia.ceph.com]: set os type and version on server 2023-11-06T18:10:33.723 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-06T18:10:33.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:10:33.820 DEBUG:teuthology.orchestra.run.smithi019:> true 2023-11-06T18:10:34.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2023-11-06T18:10:34.001 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2023-11-06T18:10:34.055 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2023-11-06T18:10:34.056 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2023-11-06T18:10:34.110 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2023-11-06T18:10:34.111 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2023-11-06T18:10:34.111 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2023-11-06T18:10:34.111 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2023-11-06T18:10:34.111 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2023-11-06T18:10:34.112 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2023-11-06T18:10:34.112 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-06T18:10:34.112 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2023-11-06T18:10:34.112 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2023-11-06T18:10:34.112 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-06T18:10:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2023-11-06T18:10:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T18:10:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-06T18:10:34.113 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-06T18:10:34.114 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2023-11-06T18:10:34.139 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2023-11-06T18:10:34.139 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-06T18:10:34.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-06T18:10:34.220 DEBUG:teuthology.orchestra.run.smithi129:> true 2023-11-06T18:10:34.288 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com' 2023-11-06T18:10:34.289 DEBUG:teuthology.orchestra.run.smithi129:> uname -m 2023-11-06T18:10:34.342 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2023-11-06T18:10:34.343 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release 2023-11-06T18:10:34.397 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2023-11-06T18:10:34.397 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="9" 2023-11-06T18:10:34.398 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2023-11-06T18:10:34.398 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2023-11-06T18:10:34.398 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="9" 2023-11-06T18:10:34.398 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el9" 2023-11-06T18:10:34.399 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-06T18:10:34.399 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2023-11-06T18:10:34.399 INFO:teuthology.orchestra.run.smithi129.stdout:LOGO="fedora-logo-icon" 2023-11-06T18:10:34.399 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-06T18:10:34.399 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2023-11-06T18:10:34.400 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-06T18:10:34.400 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-06T18:10:34.400 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-06T18:10:34.400 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2023-11-06T18:10:34.600 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:10:34.695 INFO:teuthology.dispatcher.supervisor:Running job 7450165 2023-11-06T18:10:34.695 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi/7450165 --name yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi/7450165/orig.config.yaml 2023-11-06T18:10:34.698 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi/7450165 2023-11-06T18:10:34.699 INFO:teuthology.dispatcher.supervisor:Job PID: 1673056 2023-11-06T18:10:34.699 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-06T18:12:34.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:14:34.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:16:35.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:18:35.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:20:35.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:22:35.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:24:35.771 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:26:35.934 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:28:36.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:30:36.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:32:36.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:34:36.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:36:36.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:38:36.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:40:37.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:42:37.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:44:37.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:46:37.572 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:48:37.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:50:37.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:52:38.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:54:38.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:56:38.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T18:58:38.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:00:38.664 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:02:38.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:04:39.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:06:39.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:08:39.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:10:39.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:12:39.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-06T19:12:39.768 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-06T19:12:39.868 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-06T19:12:39.868 INFO:teuthology.nuke:Checking targets against current locks 2023-11-06T19:12:39.917 DEBUG:teuthology.nuke:shortname: smithi019 2023-11-06T19:12:39.917 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-06T19:12:39.940 DEBUG:teuthology.nuke:shortname: smithi129 2023-11-06T19:12:39.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-06T19:12:39.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi/7450165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 18:05:32.539122', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKs9S3S6w7K2fFHDHZe580VbdQb7M/c2ub2EadrFquUo36zrtshmiQnj9J4isvrNZWaPLhnunusQEmB5bL18Vk='} 2023-11-06T19:12:39.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-06_15:46:57-fs-reef-release-distro-default-smithi/7450165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-06 18:05:32.540877', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLbNhAdEsfoufdcRYnyxH6illEEafSkU5Ye248cD5d1r297bkP18xQ9ZvQo5FX+uP0uOCcWqzZSAWtmrxOPT1aQ='} 2023-11-06T19:12:39.996 INFO:teuthology.orchestra.console.smithi019:Power off 2023-11-06T19:12:39.996 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-06T19:12:40.017 DEBUG:teuthology.orchestra.console.smithi019:power off output: Chassis Power Control: Down/Off 2023-11-06T19:12:40.018 DEBUG:teuthology.orchestra.console.smithi019:pexpect command: ipmitool -H smithi019.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T19:12:40.033 INFO:teuthology.orchestra.console.smithi129:Power off 2023-11-06T19:12:40.033 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-06T19:12:40.042 DEBUG:teuthology.orchestra.console.smithi019:check power output: Chassis Power is off 2023-11-06T19:12:40.055 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off 2023-11-06T19:12:40.055 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-06T19:12:40.078 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off 2023-11-06T19:12:40.144 INFO:teuthology.orchestra.console.smithi019:Power off completed 2023-11-06T19:12:40.179 INFO:teuthology.orchestra.console.smithi129:Power off completed 2023-11-06T19:12:40.293 INFO:teuthology.lock.ops:unlocked: smithi019.front.sepia.ceph.com 2023-11-06T19:12:40.318 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com