2023-09-11T14:33:56.854 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-11T14:33:56.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:33:56.944 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbe37e24670>, signals=[15]) 2023-09-11T14:33:56.946 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-09-11T14:33:56.946 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-09-11T14:33:56.946 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-11T14:33:56.961 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-09-11T14:33:57.034 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-09-11T14:33:57.079 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2023-09-11T14:33:57.080 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 10} 2023-09-11T14:33:57.123 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2023-09-11T14:33:57.124 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:33:57.183 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-09-11T14:33:57.224 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-09-11T14:33:57.280 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:33:57.370 INFO:teuthology.orchestra.console.smithi069:Power off 2023-09-11T14:33:57.371 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-11T14:33:57.395 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-09-11T14:33:57.395 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:33:57.417 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-11T14:33:57.518 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-09-11T14:33:57.618 INFO:teuthology.orchestra.console.smithi069:Power on 2023-09-11T14:33:57.619 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-11T14:33:57.640 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-09-11T14:33:57.640 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:33:57.661 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-09-11T14:34:01.669 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-11T14:34:01.778 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-09-11T14:34:01.879 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-09-11T14:34:01.980 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-09-11T14:34:01.980 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:34:17.062 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:34:32.150 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:34:47.234 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:35:02.310 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:35:17.382 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:35:32.454 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:35:47.526 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:36:02.614 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:36:17.686 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:36:32.762 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-09-11T14:36:32.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:36:35.898 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:36:41.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:36:44.958 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:36:50.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:36:54.042 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:37:00.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:37:03.102 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:37:09.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:37:12.190 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:37:18.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:37:21.274 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:37:27.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:37:30.362 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-09-11T14:37:36.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:38:36.422 WARNING:teuthology.provision.fog.smithi069:timed out 2023-09-11T14:38:42.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:38:42.836 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-11T14:38:42.837 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-11T14:38:43.154 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-09-11T14:38:43.155 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-09-11T14:38:43.169 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-09-11T14:38:43.170 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-09-11T14:38:43.228 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-09-11T14:38:43.229 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-11T14:38:43.338 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-09-11T14:38:43.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-09-11T14:38:43.437 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-09-11T14:38:43.507 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-09-11T14:38:43.578 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-11T14:38:43.635 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-09-11T14:38:43.636 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-09-11T14:38:43.636 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-09-11T14:38:43.636 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:38:43.636 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:38:43.637 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:38:43.638 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:38:43.638 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:38:43.638 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:38:43.639 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-09-11T14:38:43.640 DEBUG:teuthology.parallel:result is None 2023-09-11T14:38:43.763 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-09-11T14:38:43.764 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-11T14:38:43.809 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-09-11T14:38:43.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-11T14:38:43.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-11T14:38:43.892 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-09-11T14:38:43.956 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-09-11T14:38:43.956 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-09-11T14:38:44.014 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-09-11T14:38:44.014 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-09-11T14:38:44.074 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-09-11T14:38:44.075 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-09-11T14:38:44.075 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-09-11T14:38:44.076 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-09-11T14:38:44.076 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-09-11T14:38:44.076 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-09-11T14:38:44.077 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-09-11T14:38:44.077 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-09-11T14:38:44.077 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-09-11T14:38:44.078 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-09-11T14:38:44.078 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-09-11T14:38:44.078 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-11T14:38:44.078 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-09-11T14:38:44.079 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-11T14:38:44.079 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-09-11T14:38:44.100 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:38:44.191 INFO:teuthology.dispatcher.supervisor:Running job 7393622 2023-09-11T14:38:44.192 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-09-11_14:31:38-crimson-rados-main-distro-crimson-smithi/7393622 --name matan-2023-09-11_14:31:38-crimson-rados-main-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4K_rand_rw} -- /home/teuthworker/archive/matan-2023-09-11_14:31:38-crimson-rados-main-distro-crimson-smithi/7393622/orig.config.yaml 2023-09-11T14:38:44.195 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-09-11_14:31:38-crimson-rados-main-distro-crimson-smithi/7393622 2023-09-11T14:38:44.196 INFO:teuthology.dispatcher.supervisor:Job PID: 3950835 2023-09-11T14:38:44.196 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-11T14:40:44.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:42:44.397 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:44:44.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:46:44.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:48:44.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:50:45.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:52:45.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:54:45.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:56:45.570 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:58:45.739 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-11T14:58:45.801 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-11T14:58:45.883 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-09-11T14:58:45.925 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com