2023-08-24T06:00:19.820 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-24T06:00:19.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:00:19.924 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4167705310>, signals=[15]) 2023-08-24T06:00:19.926 INFO:teuthology.lock.ops:Start node 'smithi003.front.sepia.ceph.com' reimaging 2023-08-24T06:00:19.926 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: reset os type and version on server 2023-08-24T06:00:19.926 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-24T06:00:19.943 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /host {"name": "smithi003"} 2023-08-24T06:00:20.007 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-24T06:00:20.048 DEBUG:teuthology.provision.fog.smithi003:Requesting image smithi_centos_8.stream (ID 3) 2023-08-24T06:00:20.048 DEBUG:teuthology.provision.fog.smithi003:FOG request: PUT /host/109 {"imageID": 3} 2023-08-24T06:00:20.105 INFO:teuthology.provision.fog.smithi003:Scheduling deploy of centos 8.stream 2023-08-24T06:00:20.105 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:00:20.263 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /tasktype {"name": "deploy"} 2023-08-24T06:00:20.303 DEBUG:teuthology.provision.fog.smithi003:FOG request: POST /host/109/task {"taskTypeID": 1} 2023-08-24T06:00:20.356 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:00:20.555 INFO:teuthology.orchestra.console.smithi003:Power off 2023-08-24T06:00:20.556 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-24T06:00:20.581 DEBUG:teuthology.orchestra.console.smithi003:power off output: Chassis Power Control: Down/Off 2023-08-24T06:00:20.582 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:20.604 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-24T06:00:24.607 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:24.716 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-24T06:00:28.718 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:28.828 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-24T06:00:28.929 INFO:teuthology.orchestra.console.smithi003:Power off completed 2023-08-24T06:00:29.030 INFO:teuthology.orchestra.console.smithi003:Power on 2023-08-24T06:00:29.030 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-24T06:00:29.051 DEBUG:teuthology.orchestra.console.smithi003:power on output: Chassis Power Control: Up/On 2023-08-24T06:00:29.051 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:29.072 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-24T06:00:33.076 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:33.185 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is off 2023-08-24T06:00:37.188 DEBUG:teuthology.orchestra.console.smithi003:pexpect command: ipmitool -H smithi003.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-24T06:00:37.297 DEBUG:teuthology.orchestra.console.smithi003:check power output: Chassis Power is on 2023-08-24T06:00:37.398 INFO:teuthology.orchestra.console.smithi003:Power on completed 2023-08-24T06:00:37.499 INFO:teuthology.provision.fog.smithi003:Waiting for deploy to finish 2023-08-24T06:00:37.499 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:00:52.691 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:01:07.879 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:01:23.089 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:01:38.308 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:01:53.499 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:02:08.723 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:02:24.044 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:02:39.384 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:02:54.643 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:03:09.900 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:03:25.166 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:03:40.390 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:03:55.568 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:04:10.792 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:04:25.979 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:04:41.136 DEBUG:teuthology.provision.fog.smithi003:FOG request: GET /task/active None 2023-08-24T06:04:41.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:04:44.368 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:04:50.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:04:53.456 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:04:59.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:05:02.512 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:05:08.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:05:11.600 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:05:17.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:05:20.656 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:05:26.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:05:29.712 WARNING:teuthology.provision.fog.smithi003:[Errno None] Unable to connect to port 22 on 172.21.15.3 2023-08-24T06:05:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:06:35.742 WARNING:teuthology.provision.fog.smithi003:timed out 2023-08-24T06:06:41.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:06:41.994 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-24T06:06:41.995 DEBUG:teuthology.orchestra.run.smithi003:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-24T06:06:42.253 INFO:teuthology.provision.fog.smithi003:Node is ready 2023-08-24T06:06:42.254 DEBUG:teuthology.orchestra.run.smithi003:> hostname 2023-08-24T06:06:42.273 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003.front.sepia.ceph.com 2023-08-24T06:06:42.274 DEBUG:teuthology.orchestra.run.smithi003:> grep smithi003.front.sepia.ceph.com /etc/hosts 2023-08-24T06:06:42.333 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3 smithi003.front.sepia.ceph.com smithi003 2023-08-24T06:06:42.333 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-24T06:06:42.435 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hosts 2023-08-24T06:06:42.465 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/172.21.15.3/172.21.15.3/g' /etc/hosts 2023-08-24T06:06:42.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i -e 's/smithi003.front.sepia.ceph.com/smithi003/g' /etc/hostname 2023-08-24T06:06:42.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname smithi003 2023-08-24T06:06:42.675 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-24T06:06:42.733 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-24T06:06:42.734 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-24T06:06:42.735 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-24T06:06:42.735 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-24T06:06:42.735 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-24T06:06:42.735 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-24T06:06:42.735 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-24T06:06:42.736 INFO:teuthology.provision.fog.smithi003:Deploy complete! 2023-08-24T06:06:42.737 DEBUG:teuthology.parallel:result is None 2023-08-24T06:06:42.869 INFO:teuthology.lock.ops:Checking smithi003.front.sepia.ceph.com 2023-08-24T06:06:42.870 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-24T06:06:42.897 INFO:teuthology.lock.ops:Updating [smithi003.front.sepia.ceph.com]: set os type and version on server 2023-08-24T06:06:42.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-24T06:06:42.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-24T06:06:42.964 DEBUG:teuthology.orchestra.run.smithi003:> true 2023-08-24T06:06:43.030 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2023-08-24T06:06:43.030 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2023-08-24T06:06:43.088 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2023-08-24T06:06:43.089 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="8" 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="8" 2023-08-24T06:06:43.147 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el8" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-24T06:06:43.148 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-24T06:06:43.149 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2023-08-24T06:06:43.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:06:43.276 INFO:teuthology.dispatcher.supervisor:Running job 7378233 2023-08-24T06:06:43.276 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-24_05:58:50-crimson-rados-wip-matanb-crimson-centos9-supp-distro-crimson-smithi/7378233 --name matan-2023-08-24_05:58:50-crimson-rados-wip-matanb-crimson-centos9-supp-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4K_rand_read} -- /home/teuthworker/archive/matan-2023-08-24_05:58:50-crimson-rados-wip-matanb-crimson-centos9-supp-distro-crimson-smithi/7378233/orig.config.yaml 2023-08-24T06:06:43.279 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-24_05:58:50-crimson-rados-wip-matanb-crimson-centos9-supp-distro-crimson-smithi/7378233 2023-08-24T06:06:43.284 INFO:teuthology.dispatcher.supervisor:Job PID: 32713 2023-08-24T06:06:43.285 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-24T06:08:43.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:10:43.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:12:43.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:14:43.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:16:44.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:18:44.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:20:44.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:22:44.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:24:45.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:26:45.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:28:45.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:30:45.505 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:32:45.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:34:45.818 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:36:45.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-24T06:36:46.038 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-24T06:36:46.117 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-08-24T06:36:46.161 INFO:teuthology.lock.ops:unlocked: smithi003.front.sepia.ceph.com