2023-08-14T10:06:15.580 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-14T10:06:15.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:06:15.683 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f07e771edc0>, signals=[15]) 2023-08-14T10:06:15.684 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2023-08-14T10:06:15.685 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2023-08-14T10:06:15.685 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-14T10:06:15.707 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /host {"name": "smithi160"} 2023-08-14T10:06:15.790 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-14T10:06:15.828 DEBUG:teuthology.provision.fog.smithi160:Requesting image smithi_centos_8.stream (ID 3) 2023-08-14T10:06:15.828 DEBUG:teuthology.provision.fog.smithi160:FOG request: PUT /host/265 {"imageID": 3} 2023-08-14T10:06:15.874 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of centos 8.stream 2023-08-14T10:06:15.874 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:06:15.973 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /tasktype {"name": "deploy"} 2023-08-14T10:06:16.022 DEBUG:teuthology.provision.fog.smithi160:FOG request: POST /host/265/task {"taskTypeID": 1} 2023-08-14T10:06:16.076 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:06:16.202 INFO:teuthology.orchestra.console.smithi160:Power off 2023-08-14T10:06:16.203 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-14T10:06:16.227 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-08-14T10:06:16.228 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:16.254 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-14T10:06:20.259 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:20.371 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-14T10:06:24.372 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:24.481 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-14T10:06:24.582 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-08-14T10:06:24.683 INFO:teuthology.orchestra.console.smithi160:Power on 2023-08-14T10:06:24.683 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-14T10:06:24.703 DEBUG:teuthology.orchestra.console.smithi160:power on output: Chassis Power Control: Up/On 2023-08-14T10:06:24.704 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:24.726 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-14T10:06:28.728 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:28.836 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-08-14T10:06:32.840 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-14T10:06:32.949 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-08-14T10:06:33.050 INFO:teuthology.orchestra.console.smithi160:Power on completed 2023-08-14T10:06:33.150 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2023-08-14T10:06:33.151 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:06:48.288 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:07:03.422 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:07:18.554 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:07:33.680 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:07:48.812 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:08:03.982 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:08:19.123 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:08:34.301 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:08:49.470 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:09:04.640 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:09:19.808 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:09:34.978 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:09:50.120 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:10:05.260 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:10:20.376 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:10:35.513 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:10:50.636 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:11:05.757 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:11:20.858 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:11:35.951 DEBUG:teuthology.provision.fog.smithi160:FOG request: GET /task/active None 2023-08-14T10:11:36.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:11:39.088 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:11:45.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:11:48.144 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:11:54.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:11:57.232 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:12:03.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:12:06.288 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:12:12.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:12:15.376 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:12:21.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:12:24.432 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:12:30.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:12:33.520 WARNING:teuthology.provision.fog.smithi160:[Errno None] Unable to connect to port 22 on 172.21.15.160 2023-08-14T10:12:39.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:13:39.550 WARNING:teuthology.provision.fog.smithi160:timed out 2023-08-14T10:13:45.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:13:45.781 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-14T10:13:45.782 DEBUG:teuthology.orchestra.run.smithi160:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-14T10:13:46.083 INFO:teuthology.provision.fog.smithi160:Node is ready 2023-08-14T10:13:46.084 DEBUG:teuthology.orchestra.run.smithi160:> hostname 2023-08-14T10:13:46.104 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2023-08-14T10:13:46.105 DEBUG:teuthology.orchestra.run.smithi160:> grep smithi160.front.sepia.ceph.com /etc/hosts 2023-08-14T10:13:46.164 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2023-08-14T10:13:46.164 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-14T10:13:46.265 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hosts 2023-08-14T10:13:46.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/172.21.15.160/172.21.15.160/g' /etc/hosts 2023-08-14T10:13:46.364 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i -e 's/smithi160.front.sepia.ceph.com/smithi160/g' /etc/hostname 2023-08-14T10:13:46.432 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname smithi160 2023-08-14T10:13:46.500 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-14T10:13:46.557 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-08-14T10:13:46.558 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-14T10:13:46.559 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-14T10:13:46.560 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2023-08-14T10:13:46.561 DEBUG:teuthology.parallel:result is None 2023-08-14T10:13:46.671 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2023-08-14T10:13:46.672 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-14T10:13:46.699 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2023-08-14T10:13:46.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-14T10:13:46.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-14T10:13:46.763 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-08-14T10:13:46.829 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-08-14T10:13:46.829 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-08-14T10:13:46.886 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-08-14T10:13:46.886 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-08-14T10:13:46.942 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-08-14T10:13:46.943 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-14T10:13:46.944 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-14T10:13:46.945 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-08-14T10:13:46.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:13:47.044 INFO:teuthology.dispatcher.supervisor:Running job 7367645 2023-08-14T10:13:47.044 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-14_10:05:19-crimson-rados-main-distro-crimson-smithi/7367645 --name matan-2023-08-14_10:05:19-crimson-rados-main-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/sample_radosbench} -- /home/teuthworker/archive/matan-2023-08-14_10:05:19-crimson-rados-main-distro-crimson-smithi/7367645/orig.config.yaml 2023-08-14T10:13:47.047 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-14_10:05:19-crimson-rados-main-distro-crimson-smithi/7367645 2023-08-14T10:13:47.048 INFO:teuthology.dispatcher.supervisor:Job PID: 12697 2023-08-14T10:13:47.048 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-14T10:15:47.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:17:47.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:19:47.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:21:47.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:23:47.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:25:47.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:27:48.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:29:48.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:31:48.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:33:48.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:35:48.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:37:49.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:39:49.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:41:49.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:43:49.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:45:49.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:47:49.665 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-14T10:47:49.721 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-14T10:47:49.797 INFO:teuthology.dispatcher.supervisor:Unlocking machines... 2023-08-14T10:47:49.837 INFO:teuthology.lock.ops:unlocked: smithi160.front.sepia.ceph.com