2023-10-03T16:10:13.189 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-03T16:10:13.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:10:13.337 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0b92cb1670>, signals=[15]) 2023-10-03T16:10:13.338 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-10-03T16:10:13.338 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T16:10:13.338 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-03T16:10:13.355 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-10-03T16:10:13.355 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-10-03T16:10:13.355 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-03T16:10:13.356 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /host {"name": "smithi146"} 2023-10-03T16:10:13.380 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"} 2023-10-03T16:10:13.424 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-03T16:10:13.443 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-03T16:10:13.466 DEBUG:teuthology.provision.fog.smithi146:Requesting image smithi_centos_9.stream (ID 10) 2023-10-03T16:10:13.467 DEBUG:teuthology.provision.fog.smithi146:FOG request: PUT /host/251 {"imageID": 10} 2023-10-03T16:10:13.490 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_9.stream (ID 10) 2023-10-03T16:10:13.491 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 10} 2023-10-03T16:10:13.515 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 9.stream 2023-10-03T16:10:13.515 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:10:13.563 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 9.stream 2023-10-03T16:10:13.563 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:10:13.586 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T16:10:13.611 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"} 2023-10-03T16:10:13.629 DEBUG:teuthology.provision.fog.smithi146:FOG request: POST /host/251/task {"taskTypeID": 1} 2023-10-03T16:10:13.651 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1} 2023-10-03T16:10:13.680 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:10:13.700 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:10:13.783 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-03T16:10:13.783 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T16:10:13.795 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-03T16:10:13.795 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T16:10:13.804 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-03T16:10:13.805 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:13.815 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-03T16:10:13.815 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:13.825 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T16:10:13.835 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T16:10:17.830 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:17.838 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:17.940 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T16:10:17.946 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T16:10:21.946 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:21.952 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:22.055 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T16:10:22.061 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T16:10:22.156 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-03T16:10:22.257 INFO:teuthology.orchestra.console.smithi146:Power on 2023-10-03T16:10:22.257 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T16:10:22.279 DEBUG:teuthology.orchestra.console.smithi146:power on output: Chassis Power Control: Up/On 2023-10-03T16:10:22.279 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:22.300 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T16:10:26.066 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:26.177 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-03T16:10:26.277 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-03T16:10:26.302 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:26.378 INFO:teuthology.orchestra.console.smithi172:Power on 2023-10-03T16:10:26.379 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-03T16:10:26.401 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On 2023-10-03T16:10:26.401 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:26.410 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T16:10:26.424 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-03T16:10:30.415 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:30.425 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T16:10:30.534 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on 2023-10-03T16:10:30.601 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-03T16:10:30.635 INFO:teuthology.orchestra.console.smithi172:Power on completed 2023-10-03T16:10:30.702 INFO:teuthology.orchestra.console.smithi146:Power on completed 2023-10-03T16:10:30.736 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-10-03T16:10:30.737 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:10:30.803 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-10-03T16:10:30.803 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:10:45.852 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:10:45.876 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:11:00.939 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:11:00.944 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:11:16.029 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:11:16.030 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:11:31.115 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:11:31.116 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:11:46.202 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:11:46.204 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:12:01.282 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:12:01.285 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:12:16.380 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:12:16.381 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:12:31.472 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:12:31.474 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:12:51.206 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:12:51.216 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:13:06.378 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:13:06.398 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:13:21.481 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:13:21.483 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:13:36.582 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:13:36.584 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:13:51.670 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:13:51.671 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:14:06.754 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:14:06.755 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:14:21.826 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None 2023-10-03T16:14:21.828 DEBUG:teuthology.provision.fog.smithi146:FOG request: GET /task/active None 2023-10-03T16:14:21.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:21.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:40.252 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:14:40.252 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:14:46.259 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:46.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:49.338 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:14:49.339 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:14:55.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:55.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:14:58.426 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:14:58.427 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:15:04.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:04.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:07.515 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:15:07.515 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:15:13.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:13.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:16.603 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:15:16.603 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:15:22.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:22.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:25.690 WARNING:teuthology.provision.fog.smithi146:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-03T16:15:25.691 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-10-03T16:15:31.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:15:31.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:16:31.761 WARNING:teuthology.provision.fog.smithi146:timed out 2023-10-03T16:16:31.761 WARNING:teuthology.provision.fog.smithi172:timed out 2023-10-03T16:16:37.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:16:37.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:16:37.973 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T16:16:37.974 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T16:16:38.112 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-03T16:16:38.112 DEBUG:teuthology.orchestra.run.smithi146:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-03T16:16:38.304 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-10-03T16:16:38.304 DEBUG:teuthology.orchestra.run.smithi172:> hostname 2023-10-03T16:16:38.320 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com 2023-10-03T16:16:38.320 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts 2023-10-03T16:16:38.376 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172 2023-10-03T16:16:38.376 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-10-03T16:16:38.436 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-10-03T16:16:38.437 DEBUG:teuthology.orchestra.run.smithi146:> hostname 2023-10-03T16:16:38.452 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-10-03T16:16:38.453 DEBUG:teuthology.orchestra.run.smithi146:> grep smithi146.front.sepia.ceph.com /etc/hosts 2023-10-03T16:16:38.485 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts 2023-10-03T16:16:38.508 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-10-03T16:16:38.508 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-10-03T16:16:38.513 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts 2023-10-03T16:16:38.582 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname 2023-10-03T16:16:38.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hosts 2023-10-03T16:16:38.649 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172 2023-10-03T16:16:38.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/172.21.15.146/172.21.15.146/g' /etc/hosts 2023-10-03T16:16:38.717 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-03T16:16:38.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i -e 's/smithi146.front.sepia.ceph.com/smithi146/g' /etc/hostname 2023-10-03T16:16:38.772 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-10-03T16:16:38.772 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-10-03T16:16:38.772 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-10-03T16:16:38.772 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-03T16:16:38.773 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T16:16:38.774 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-10-03T16:16:38.776 DEBUG:teuthology.parallel:result is None 2023-10-03T16:16:38.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo hostname smithi146 2023-10-03T16:16:38.860 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-03T16:16:38.913 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-03T16:16:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-03T16:16:38.915 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T16:16:38.915 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-10-03T16:16:38.916 DEBUG:teuthology.parallel:result is None 2023-10-03T16:16:39.084 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-10-03T16:16:39.084 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T16:16:39.108 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-10-03T16:16:39.108 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-03T16:16:39.126 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-10-03T16:16:39.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T16:16:39.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:16:39.244 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-03T16:16:39.308 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-03T16:16:39.308 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-10-03T16:16:39.360 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-10-03T16:16:39.360 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-03T16:16:39.413 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Stream" 2023-10-03T16:16:39.413 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="9" 2023-10-03T16:16:39.413 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2023-10-03T16:16:39.413 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="9" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el9" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:LOGO="fedora-logo-icon" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-03T16:16:39.414 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T16:16:39.415 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-03T16:16:39.433 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-10-03T16:16:39.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T16:16:39.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-03T16:16:39.517 DEBUG:teuthology.orchestra.run.smithi172:> true 2023-10-03T16:16:39.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-10-03T16:16:39.585 DEBUG:teuthology.orchestra.run.smithi172:> uname -m 2023-10-03T16:16:39.643 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-10-03T16:16:39.643 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="9" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="9" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el9" 2023-10-03T16:16:39.702 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:LOGO="fedora-logo-icon" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-03T16:16:39.703 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-03T16:16:39.704 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-10-03T16:16:39.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:16:39.812 INFO:teuthology.dispatcher.supervisor:Running job 7409682 2023-10-03T16:16:39.813 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi/7409682 --name yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi/7409682/orig.config.yaml 2023-10-03T16:16:39.816 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi/7409682 2023-10-03T16:16:39.817 INFO:teuthology.dispatcher.supervisor:Job PID: 1304016 2023-10-03T16:16:39.817 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-03T16:18:39.831 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:20:39.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:22:40.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:24:40.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:26:40.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:28:40.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:30:40.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:32:40.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:34:40.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:36:41.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:38:41.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:40:41.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:42:41.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:44:41.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:46:41.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:48:42.147 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:50:42.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:52:42.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:54:42.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:56:42.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T16:58:42.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:00:43.008 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:02:43.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:04:43.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:06:43.484 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:08:43.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:10:43.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:12:43.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:14:43.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:16:44.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-03T17:16:44.208 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-10-03T17:16:44.311 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-03T17:16:44.312 INFO:teuthology.nuke:Checking targets against current locks 2023-10-03T17:16:44.362 DEBUG:teuthology.nuke:shortname: smithi146 2023-10-03T17:16:44.363 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T17:16:44.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi/7409682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 16:10:12.452980', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHvHZvrRFtu0agS0Z2jQ7GVtw87fpcKCDFms1ARnuOBqIuuTU/CdMM788RUcT1tLbcgC0vePjFJyy3/cESvktGc='} 2023-10-03T17:16:44.386 DEBUG:teuthology.nuke:shortname: smithi172 2023-10-03T17:16:44.386 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-03T17:16:44.412 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-03_16:08:12-rados-wip-yuri5-testing-2023-09-27-0959-distro-default-smithi/7409682', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-03 16:10:12.454603', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGb4YeT1XVAJkzaTbG54vB9l536wTtnp9L+cx5EG/E0DWxlZxkPq2uls13k53jv6e+ubyGpjxZ7OKNzx8stoapI='} 2023-10-03T17:16:44.437 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-03T17:16:44.437 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T17:16:44.459 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-03T17:16:44.459 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T17:16:44.474 INFO:teuthology.orchestra.console.smithi172:Power off 2023-10-03T17:16:44.475 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-03T17:16:44.483 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-03T17:16:44.495 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off 2023-10-03T17:16:44.496 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-03T17:16:44.515 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off 2023-10-03T17:16:44.585 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-03T17:16:44.616 INFO:teuthology.orchestra.console.smithi172:Power off completed 2023-10-03T17:16:44.731 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2023-10-03T17:16:44.766 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com