2023-08-30T18:18:26.622 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T18:18:26.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:18:26.759 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fac8d302670>, signals=[15]) 2023-08-30T18:18:26.760 INFO:teuthology.lock.ops:Start node 'smithi112.front.sepia.ceph.com' reimaging 2023-08-30T18:18:26.761 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:18:26.761 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-30T18:18:26.783 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-08-30T18:18:26.783 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T18:18:26.784 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-30T18:18:26.785 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /host {"name": "smithi112"} 2023-08-30T18:18:26.808 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /host {"name": "smithi179"} 2023-08-30T18:18:26.847 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:18:26.878 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T18:18:26.890 DEBUG:teuthology.provision.fog.smithi112:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:18:26.891 DEBUG:teuthology.provision.fog.smithi112:FOG request: PUT /host/217 {"imageID": 10} 2023-08-30T18:18:26.925 DEBUG:teuthology.provision.fog.smithi179:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T18:18:26.926 DEBUG:teuthology.provision.fog.smithi179:FOG request: PUT /host/284 {"imageID": 10} 2023-08-30T18:18:26.944 INFO:teuthology.provision.fog.smithi112:Scheduling deploy of centos 9.stream 2023-08-30T18:18:26.944 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:18:26.973 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of centos 9.stream 2023-08-30T18:18:26.974 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:18:27.175 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:18:27.192 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T18:18:27.222 DEBUG:teuthology.provision.fog.smithi112:FOG request: POST /host/217/task {"taskTypeID": 1} 2023-08-30T18:18:27.229 DEBUG:teuthology.provision.fog.smithi179:FOG request: POST /host/284/task {"taskTypeID": 1} 2023-08-30T18:18:27.279 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:18:27.287 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:18:27.532 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-30T18:18:27.533 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:18:27.546 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-30T18:18:27.547 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:18:27.555 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-30T18:18:27.556 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:27.569 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-30T18:18:27.570 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:27.575 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-30T18:18:27.589 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-30T18:18:27.677 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-30T18:18:27.778 INFO:teuthology.orchestra.console.smithi112:Power on 2023-08-30T18:18:27.778 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:18:27.799 DEBUG:teuthology.orchestra.console.smithi112:power on output: Chassis Power Control: Up/On 2023-08-30T18:18:27.800 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:27.822 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-30T18:18:31.594 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:31.702 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-30T18:18:31.824 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:31.932 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is on 2023-08-30T18:18:32.033 INFO:teuthology.orchestra.console.smithi112:Power on completed 2023-08-30T18:18:32.134 INFO:teuthology.provision.fog.smithi112:Waiting for deploy to finish 2023-08-30T18:18:32.134 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:18:35.706 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:35.814 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-30T18:18:39.817 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:39.925 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-30T18:18:40.026 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-30T18:18:40.127 INFO:teuthology.orchestra.console.smithi179:Power on 2023-08-30T18:18:40.127 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T18:18:40.147 DEBUG:teuthology.orchestra.console.smithi179:power on output: Chassis Power Control: Up/On 2023-08-30T18:18:40.148 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:40.167 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-30T18:18:44.172 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:44.280 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-30T18:18:47.354 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:18:48.282 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:18:48.392 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2023-08-30T18:18:48.492 INFO:teuthology.orchestra.console.smithi179:Power on completed 2023-08-30T18:18:48.593 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-08-30T18:18:48.593 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:19:02.599 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:19:03.789 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:19:17.831 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:19:18.993 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:19:33.064 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:19:34.243 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:19:48.343 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:19:49.548 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:20:03.673 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:20:04.889 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:20:19.101 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:20:20.335 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:20:34.448 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:20:35.755 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:20:49.966 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:20:51.157 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:21:05.650 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:21:06.760 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:21:21.317 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:21:22.287 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:21:36.629 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:21:37.620 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:21:51.910 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:21:53.024 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:22:07.239 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:22:08.361 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:22:22.598 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:22:23.693 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:22:37.930 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:22:38.927 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:22:53.144 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:22:54.131 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:23:08.347 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:23:09.304 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:23:23.582 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:23:24.498 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:23:38.806 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:23:39.687 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:23:53.990 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:23:54.884 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:24:09.178 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:24:10.016 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:24:24.365 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:24:25.195 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:24:39.530 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:24:40.356 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:24:54.668 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:24:55.477 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:25:09.817 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:25:10.604 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:25:24.931 DEBUG:teuthology.provision.fog.smithi112:FOG request: GET /task/active None 2023-08-30T18:25:25.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:25.693 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:25:28.094 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:25:34.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:37.182 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:25:40.794 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:25:43.186 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:46.266 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:25:52.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:25:55.322 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:25:55.865 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:26:01.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:04.378 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:26:10.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:10.938 DEBUG:teuthology.provision.fog.smithi179:FOG request: GET /task/active None 2023-08-30T18:26:11.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:13.466 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:26:14.074 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-30T18:26:19.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:20.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:22.554 WARNING:teuthology.provision.fog.smithi112:[Errno None] Unable to connect to port 22 on 172.21.15.112 2023-08-30T18:26:23.130 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-30T18:26:28.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:29.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:32.186 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-30T18:26:38.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:41.242 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-30T18:26:47.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:26:50.298 WARNING:teuthology.provision.fog.smithi179:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-08-30T18:26:56.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:27:00.321 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:27:00.322 DEBUG:teuthology.orchestra.run.smithi112:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:27:25.699 INFO:teuthology.provision.fog.smithi112:Node is ready 2023-08-30T18:27:25.700 DEBUG:teuthology.orchestra.run.smithi112:> hostname 2023-08-30T18:27:25.758 INFO:teuthology.orchestra.run.smithi112.stdout:smithi112.front.sepia.ceph.com 2023-08-30T18:27:25.759 DEBUG:teuthology.orchestra.run.smithi112:> grep smithi112.front.sepia.ceph.com /etc/hosts 2023-08-30T18:27:25.815 INFO:teuthology.orchestra.run.smithi112.stdout:172.21.15.112 smithi112.front.sepia.ceph.com smithi112 2023-08-30T18:27:25.816 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-30T18:27:25.948 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hosts 2023-08-30T18:27:25.979 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/172.21.15.112/172.21.15.112/g' /etc/hosts 2023-08-30T18:27:26.050 DEBUG:teuthology.orchestra.run.smithi112:> sudo sed -i -e 's/smithi112.front.sepia.ceph.com/smithi112/g' /etc/hostname 2023-08-30T18:27:26.119 DEBUG:teuthology.orchestra.run.smithi112:> sudo hostname smithi112 2023-08-30T18:27:26.187 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-30T18:27:26.242 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-30T18:27:26.243 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-30T18:27:26.243 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-30T18:27:26.243 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:27:26.243 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-30T18:27:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:27:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:27:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-30T18:27:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:27:26.244 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:27:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:27:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:27:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:27:26.245 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:27:26.246 INFO:teuthology.provision.fog.smithi112:Deploy complete! 2023-08-30T18:27:26.247 DEBUG:teuthology.parallel:result is None 2023-08-30T18:27:56.334 WARNING:teuthology.provision.fog.smithi179:timed out 2023-08-30T18:28:02.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:28:02.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T18:28:02.535 DEBUG:teuthology.orchestra.run.smithi179:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T18:28:02.873 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-08-30T18:28:02.873 DEBUG:teuthology.orchestra.run.smithi179:> hostname 2023-08-30T18:28:02.887 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179.front.sepia.ceph.com 2023-08-30T18:28:02.888 DEBUG:teuthology.orchestra.run.smithi179:> grep smithi179.front.sepia.ceph.com /etc/hosts 2023-08-30T18:28:02.942 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-08-30T18:28:02.943 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-30T18:28:03.069 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hosts 2023-08-30T18:28:03.097 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/172.21.15.179/172.21.15.179/g' /etc/hosts 2023-08-30T18:28:03.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i -e 's/smithi179.front.sepia.ceph.com/smithi179/g' /etc/hostname 2023-08-30T18:28:03.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo hostname smithi179 2023-08-30T18:28:03.297 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-30T18:28:03.352 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-30T18:28:03.352 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2023-08-30T18:28:03.352 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-30T18:28:03.352 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:28:03.353 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2023-08-30T18:28:03.353 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:28:03.353 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:28:03.353 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-30T18:28:03.353 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:28:03.354 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:28:03.354 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:28:03.354 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:28:03.354 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:28:03.354 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:28:03.355 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-08-30T18:28:03.356 DEBUG:teuthology.parallel:result is None 2023-08-30T18:28:03.505 INFO:teuthology.lock.ops:Checking smithi112.front.sepia.ceph.com 2023-08-30T18:28:03.506 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:28:03.532 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-08-30T18:28:03.532 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T18:28:03.550 INFO:teuthology.lock.ops:Updating [smithi112.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:28:03.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-30T18:28:03.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi112.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:28:03.633 DEBUG:teuthology.orchestra.run.smithi112:> true 2023-08-30T18:28:03.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi112.front.sepia.ceph.com' 2023-08-30T18:28:03.809 DEBUG:teuthology.orchestra.run.smithi112:> uname -m 2023-08-30T18:28:03.865 INFO:teuthology.orchestra.run.smithi112.stdout:x86_64 2023-08-30T18:28:03.865 DEBUG:teuthology.orchestra.run.smithi112:> cat /etc/os-release 2023-08-30T18:28:03.919 INFO:teuthology.orchestra.run.smithi112.stdout:NAME="CentOS Stream" 2023-08-30T18:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION="9" 2023-08-30T18:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:ID="centos" 2023-08-30T18:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:VERSION_ID="9" 2023-08-30T18:28:03.920 INFO:teuthology.orchestra.run.smithi112.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:28:03.921 INFO:teuthology.orchestra.run.smithi112.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:28:03.921 INFO:teuthology.orchestra.run.smithi112.stdout:ANSI_COLOR="0;31" 2023-08-30T18:28:03.921 INFO:teuthology.orchestra.run.smithi112.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:28:03.921 INFO:teuthology.orchestra.run.smithi112.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:28:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:28:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:28:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:28:03.922 INFO:teuthology.orchestra.run.smithi112.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:28:03.923 INFO:teuthology.lock.ops:Updating smithi112.front.sepia.ceph.com on lock server 2023-08-30T18:28:03.949 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-08-30T18:28:03.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-30T18:28:03.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T18:28:04.030 DEBUG:teuthology.orchestra.run.smithi179:> true 2023-08-30T18:28:04.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-08-30T18:28:04.097 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2023-08-30T18:28:04.153 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-08-30T18:28:04.153 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2023-08-30T18:28:04.209 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="CentOS Stream" 2023-08-30T18:28:04.209 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="9" 2023-08-30T18:28:04.210 INFO:teuthology.orchestra.run.smithi179.stdout:ID="centos" 2023-08-30T18:28:04.210 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="rhel fedora" 2023-08-30T18:28:04.210 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="9" 2023-08-30T18:28:04.210 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el9" 2023-08-30T18:28:04.210 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T18:28:04.211 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-08-30T18:28:04.211 INFO:teuthology.orchestra.run.smithi179.stdout:LOGO="fedora-logo-icon" 2023-08-30T18:28:04.211 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T18:28:04.211 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://centos.org/" 2023-08-30T18:28:04.211 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T18:28:04.212 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T18:28:04.212 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T18:28:04.212 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-08-30T18:28:04.232 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:28:04.313 INFO:teuthology.dispatcher.supervisor:Running job 7384542 2023-08-30T18:28:04.313 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384542 --name yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384542/orig.config.yaml 2023-08-30T18:28:04.316 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384542 2023-08-30T18:28:04.317 INFO:teuthology.dispatcher.supervisor:Job PID: 1842475 2023-08-30T18:28:04.317 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T18:30:04.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T18:30:04.484 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T18:30:04.586 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T18:30:04.586 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T18:30:04.641 DEBUG:teuthology.nuke:shortname: smithi112 2023-08-30T18:30:04.641 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:30:04.664 DEBUG:teuthology.nuke:shortname: smithi179 2023-08-30T18:30:04.664 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T18:30:04.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi112.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384542', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:18:25.852578', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMCYoBeskdj7CWBqw626U4TbwcdGf9EQ5Z+eOZwwMq/KAnRt1QlB6Sg9u4my10uNQ6DHxYBh0Ppp37nLHBX2L9M='} 2023-08-30T18:30:04.689 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_18:16:37-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384542', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 18:18:25.850986', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBInmChUODFeeAp105odyBj4o/7LJtRd6kCbFpBY8NiFRkXJnZKUZ++h/SPKQbODFsUUCHS2ieVoNU0li9W7Z40E='} 2023-08-30T18:30:04.719 INFO:teuthology.orchestra.console.smithi112:Power off 2023-08-30T18:30:04.720 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:30:04.740 DEBUG:teuthology.orchestra.console.smithi112:power off output: Chassis Power Control: Down/Off 2023-08-30T18:30:04.741 DEBUG:teuthology.orchestra.console.smithi112:pexpect command: ipmitool -H smithi112.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:30:04.760 INFO:teuthology.orchestra.console.smithi179:Power off 2023-08-30T18:30:04.761 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T18:30:04.769 DEBUG:teuthology.orchestra.console.smithi112:check power output: Chassis Power is off 2023-08-30T18:30:04.781 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2023-08-30T18:30:04.781 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T18:30:04.801 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2023-08-30T18:30:04.870 INFO:teuthology.orchestra.console.smithi112:Power off completed 2023-08-30T18:30:04.902 INFO:teuthology.orchestra.console.smithi179:Power off completed 2023-08-30T18:30:05.024 INFO:teuthology.lock.ops:unlocked: smithi112.front.sepia.ceph.com 2023-08-30T18:30:05.052 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com