2023-10-30T16:01:31.350 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-30T16:01:31.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:01:31.482 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8dd97b9670>, signals=[15]) 2023-10-30T16:01:31.483 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-10-30T16:01:31.484 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T16:01:31.484 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-30T16:01:31.503 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2023-10-30T16:01:31.504 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2023-10-30T16:01:31.504 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-30T16:01:31.505 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"} 2023-10-30T16:01:31.528 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"} 2023-10-30T16:01:31.573 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T16:01:31.597 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-10-30T16:01:31.616 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T16:01:31.616 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 10} 2023-10-30T16:01:31.637 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_9.stream (ID 10) 2023-10-30T16:01:31.637 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 10} 2023-10-30T16:01:31.659 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 9.stream 2023-10-30T16:01:31.660 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:01:31.689 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 9.stream 2023-10-30T16:01:31.690 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:01:31.720 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T16:01:31.749 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"} 2023-10-30T16:01:31.760 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1} 2023-10-30T16:01:31.786 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1} 2023-10-30T16:01:31.820 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:01:31.839 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:01:31.938 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-30T16:01:31.939 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T16:01:31.951 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-30T16:01:31.952 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T16:01:31.960 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-30T16:01:31.960 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:31.972 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-30T16:01:31.973 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:31.980 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-30T16:01:31.993 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-30T16:01:35.986 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:35.994 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:36.095 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-30T16:01:36.102 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-30T16:01:40.099 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:40.105 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:40.207 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-30T16:01:40.213 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-30T16:01:40.309 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-30T16:01:40.410 INFO:teuthology.orchestra.console.smithi161:Power on 2023-10-30T16:01:40.410 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T16:01:40.432 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2023-10-30T16:01:40.432 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:40.452 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-30T16:01:44.216 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:44.327 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-30T16:01:44.428 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-30T16:01:44.454 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:44.530 INFO:teuthology.orchestra.console.smithi131:Power on 2023-10-30T16:01:44.530 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-10-30T16:01:44.550 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-10-30T16:01:44.551 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:44.563 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-30T16:01:44.574 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-30T16:01:48.568 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:48.575 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T16:01:48.676 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2023-10-30T16:01:48.684 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-10-30T16:01:48.779 INFO:teuthology.orchestra.console.smithi161:Power on completed 2023-10-30T16:01:48.784 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-10-30T16:01:48.880 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2023-10-30T16:01:48.880 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:01:48.886 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-10-30T16:01:48.886 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:02:03.985 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:02:03.987 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:02:19.066 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:02:19.067 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:02:34.142 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:02:34.144 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:02:49.226 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:02:49.228 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:03:04.318 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:03:04.320 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:03:19.402 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:03:19.403 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:03:34.497 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:03:34.499 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:03:49.626 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:03:49.627 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:04:04.751 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:04:04.753 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:04:19.873 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:04:19.875 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:04:34.966 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-10-30T16:04:34.968 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None 2023-10-30T16:04:35.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:04:35.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:04:53.498 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-30T16:04:53.500 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-30T16:04:59.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:04:59.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:02.587 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-30T16:05:02.587 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-30T16:05:08.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:08.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:11.646 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-30T16:05:11.647 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-30T16:05:17.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:17.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:20.734 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-10-30T16:05:20.735 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-30T16:05:26.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:26.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:05:29.822 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2023-10-30T16:05:35.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:06:26.783 WARNING:teuthology.provision.fog.smithi131:timed out 2023-10-30T16:06:32.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:06:33.220 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T16:06:33.221 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T16:06:33.519 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-10-30T16:06:33.519 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-10-30T16:06:33.534 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-10-30T16:06:33.534 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-10-30T16:06:33.589 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-10-30T16:06:33.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-30T16:06:33.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-10-30T16:06:33.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-10-30T16:06:33.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-10-30T16:06:33.850 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-10-30T16:06:33.917 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-30T16:06:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-10-30T16:06:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2023-10-30T16:06:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-10-30T16:06:33.972 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-10-30T16:06:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2023-10-30T16:06:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2023-10-30T16:06:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T16:06:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-30T16:06:33.973 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2023-10-30T16:06:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T16:06:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-10-30T16:06:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T16:06:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T16:06:33.974 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T16:06:33.975 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-10-30T16:06:33.976 DEBUG:teuthology.parallel:result is None 2023-10-30T16:06:35.832 WARNING:teuthology.provision.fog.smithi161:timed out 2023-10-30T16:06:41.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:06:42.117 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-10-30T16:06:42.118 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-10-30T16:06:42.431 INFO:teuthology.provision.fog.smithi161:Node is ready 2023-10-30T16:06:42.432 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2023-10-30T16:06:42.446 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2023-10-30T16:06:42.447 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2023-10-30T16:06:42.501 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2023-10-30T16:06:42.502 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-30T16:06:42.611 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2023-10-30T16:06:42.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2023-10-30T16:06:42.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2023-10-30T16:06:42.773 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2023-10-30T16:06:42.839 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-30T16:06:42.893 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-30T16:06:42.894 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-10-30T16:06:42.894 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-30T16:06:42.894 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-30T16:06:42.894 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-10-30T16:06:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-10-30T16:06:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T16:06:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-30T16:06:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-10-30T16:06:42.895 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T16:06:42.896 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-30T16:06:42.896 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T16:06:42.896 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T16:06:42.896 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T16:06:42.896 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2023-10-30T16:06:42.897 DEBUG:teuthology.parallel:result is None 2023-10-30T16:06:43.060 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-10-30T16:06:43.061 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T16:06:43.083 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2023-10-30T16:06:43.083 INFO:teuthology.lock.ops:New key found. Updating... 2023-10-30T16:06:43.101 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-10-30T16:06:43.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-30T16:06:43.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:06:43.185 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-10-30T16:06:43.254 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-10-30T16:06:43.255 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-10-30T16:06:43.311 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-10-30T16:06:43.311 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-10-30T16:06:43.367 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-10-30T16:06:43.367 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2023-10-30T16:06:43.368 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-10-30T16:06:43.368 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-10-30T16:06:43.368 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2023-10-30T16:06:43.368 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2023-10-30T16:06:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T16:06:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-10-30T16:06:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2023-10-30T16:06:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T16:06:43.369 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-10-30T16:06:43.370 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T16:06:43.370 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T16:06:43.370 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T16:06:43.370 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-10-30T16:06:43.391 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2023-10-30T16:06:43.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-30T16:06:43.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-30T16:06:43.475 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-10-30T16:06:43.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-10-30T16:06:43.541 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-10-30T16:06:43.595 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-10-30T16:06:43.595 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-10-30T16:06:43.650 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2023-10-30T16:06:43.650 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2023-10-30T16:06:43.650 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2023-10-30T16:06:43.651 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2023-10-30T16:06:43.652 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-30T16:06:43.652 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2023-10-30T16:06:43.652 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-30T16:06:43.652 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-30T16:06:43.652 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-30T16:06:43.653 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-10-30T16:06:43.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:06:43.759 INFO:teuthology.dispatcher.supervisor:Running job 7441129 2023-10-30T16:06:43.760 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi/7441129 --name yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} -- /home/teuthworker/archive/yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi/7441129/orig.config.yaml 2023-10-30T16:06:43.762 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi/7441129 2023-10-30T16:06:43.763 INFO:teuthology.dispatcher.supervisor:Job PID: 345571 2023-10-30T16:06:43.763 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-10-30T16:08:43.863 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:10:44.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:12:44.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:14:44.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:16:44.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:18:44.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:20:44.839 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:22:45.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:24:45.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:26:45.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:28:45.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:30:45.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:32:45.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:34:46.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:36:46.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:38:46.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:40:46.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:42:46.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:44:47.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:46:47.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:48:47.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:50:47.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:52:47.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:54:47.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:56:47.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T16:58:48.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:00:48.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:02:48.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:04:48.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:06:48.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:08:49.003 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:10:49.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:12:49.344 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:14:49.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:16:49.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:18:49.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:20:50.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:22:50.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:24:50.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:26:50.559 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:28:50.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:30:50.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:32:51.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:34:51.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:36:51.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:38:51.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:40:51.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:42:51.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:44:52.139 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:46:52.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:48:52.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:50:52.643 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:52:52.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:54:52.971 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:56:53.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T17:58:53.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T18:00:53.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T18:02:53.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T18:04:53.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T18:06:53.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-30T18:06:53.944 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-10-30T18:06:54.098 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-10-30T18:06:54.099 INFO:teuthology.nuke:Checking targets against current locks 2023-10-30T18:06:54.152 DEBUG:teuthology.nuke:shortname: smithi131 2023-10-30T18:06:54.153 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T18:06:54.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi/7441129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 16:01:30.560881', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ9fiQGqXSGYPRjf4I/O3vsUpJZqDoSW985dbNrrpLQdO+/bGH11BMJHj5Nw4LF+ReTli1VHGTZi5j1UrZ+dpbo='} 2023-10-30T18:06:54.177 DEBUG:teuthology.nuke:shortname: smithi161 2023-10-30T18:06:54.178 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-30T18:06:54.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-30_15:34:36-rados-wip-yuri10-testing-2023-10-27-0804-distro-default-smithi/7441129', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-30 16:01:30.559746', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLAAlb4cvcx18jXUQW8zHIsYiu2MTHResJV+NHz3Z34LCD29ndpHbjXoesuwbbi2kYXs74qxD8wUl18tPRvOL4s='} 2023-10-30T18:06:54.224 INFO:teuthology.orchestra.console.smithi131:Power off 2023-10-30T18:06:54.225 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T18:06:54.248 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-10-30T18:06:54.249 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T18:06:54.268 INFO:teuthology.orchestra.console.smithi161:Power off 2023-10-30T18:06:54.269 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-30T18:06:54.297 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2023-10-30T18:06:54.298 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-30T18:06:54.309 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-10-30T18:06:54.324 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2023-10-30T18:06:54.410 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-10-30T18:06:54.425 INFO:teuthology.orchestra.console.smithi161:Power off completed 2023-10-30T18:06:54.559 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com 2023-10-30T18:06:54.568 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com