2023-08-27T10:34:25.896 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-27T10:34:25.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:34:26.005 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fde767ae970>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fde772a41f0>, signals=[15])
2023-08-27T10:34:26.006 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging
2023-08-27T10:34:26.007 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server
2023-08-27T10:34:26.007 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-08-27T10:34:26.028 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /host {"name": "smithi129"}
2023-08-27T10:34:26.108 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-27T10:34:26.147 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_8.stream (ID 3)
2023-08-27T10:34:26.147 DEBUG:teuthology.provision.fog.smithi129:FOG request: PUT /host/234 {"imageID": 3}
2023-08-27T10:34:26.192 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream
2023-08-27T10:34:26.193 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:34:26.269 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /tasktype {"name": "deploy"}
2023-08-27T10:34:26.312 DEBUG:teuthology.provision.fog.smithi129:FOG request: POST /host/234/task {"taskTypeID": 1}
2023-08-27T10:34:26.373 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:34:26.481 INFO:teuthology.orchestra.console.smithi129:Power off
2023-08-27T10:34:26.482 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T10:34:26.502 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off
2023-08-27T10:34:26.502 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:26.524 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2023-08-27T10:34:30.526 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:30.635 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2023-08-27T10:34:34.637 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:34.745 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2023-08-27T10:34:38.749 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:38.858 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-08-27T10:34:38.959 INFO:teuthology.orchestra.console.smithi129:Power off completed
2023-08-27T10:34:39.060 INFO:teuthology.orchestra.console.smithi129:Power on
2023-08-27T10:34:39.060 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-27T10:34:39.080 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On
2023-08-27T10:34:39.080 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:39.100 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-08-27T10:34:43.104 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:43.213 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-08-27T10:34:47.217 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:34:47.326 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2023-08-27T10:34:47.427 INFO:teuthology.orchestra.console.smithi129:Power on completed
2023-08-27T10:34:47.527 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2023-08-27T10:34:47.528 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:35:02.604 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:35:17.689 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:35:32.763 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:35:47.845 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:36:02.917 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:36:17.993 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:36:33.074 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:36:48.149 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:37:03.245 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:37:18.312 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:37:33.381 DEBUG:teuthology.provision.fog.smithi129:FOG request: GET /task/active None
2023-08-27T10:37:33.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:37:52.005 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-08-27T10:37:58.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:38:01.061 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-08-27T10:38:07.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:38:10.117 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-08-27T10:38:16.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:38:19.205 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-08-27T10:38:25.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:38:28.261 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-08-27T10:38:34.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:39:34.329 WARNING:teuthology.provision.fog.smithi129:timed out
2023-08-27T10:39:40.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:39:40.598 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-27T10:39:40.599 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-27T10:39:40.835 INFO:teuthology.provision.fog.smithi129:Node is ready
2023-08-27T10:39:40.835 DEBUG:teuthology.orchestra.run.smithi129:> hostname
2023-08-27T10:39:40.857 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2023-08-27T10:39:40.858 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts
2023-08-27T10:39:40.917 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2023-08-27T10:39:40.918 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2023-08-27T10:39:41.015 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts
2023-08-27T10:39:41.045 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts
2023-08-27T10:39:41.114 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname
2023-08-27T10:39:41.181 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2023-08-27T10:39:41.250 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2023-08-27T10:39:41.307 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2023-08-27T10:39:41.308 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2023-08-27T10:39:41.308 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2023-08-27T10:39:41.308 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2023-08-27T10:39:41.308 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2023-08-27T10:39:41.309 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2023-08-27T10:39:41.309 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-27T10:39:41.309 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2023-08-27T10:39:41.309 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-27T10:39:41.309 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2023-08-27T10:39:41.310 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T10:39:41.310 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T10:39:41.310 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-27T10:39:41.311 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2023-08-27T10:39:41.312 DEBUG:teuthology.parallel:result is None
2023-08-27T10:39:41.424 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2023-08-27T10:39:41.425 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-27T10:39:41.457 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2023-08-27T10:39:41.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-08-27T10:39:41.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:39:41.525 DEBUG:teuthology.orchestra.run.smithi129:> true
2023-08-27T10:39:41.590 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-08-27T10:39:41.591 DEBUG:teuthology.orchestra.run.smithi129:> uname -m
2023-08-27T10:39:41.648 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2023-08-27T10:39:41.649 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2023-08-27T10:39:41.706 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2023-08-27T10:39:41.706 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2023-08-27T10:39:41.706 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2023-08-27T10:39:41.707 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2023-08-27T10:39:41.707 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2023-08-27T10:39:41.707 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2023-08-27T10:39:41.707 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-27T10:39:41.707 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2023-08-27T10:39:41.708 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-27T10:39:41.708 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2023-08-27T10:39:41.708 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T10:39:41.708 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-27T10:39:41.708 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-27T10:39:41.709 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-08-27T10:39:41.731 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:39:41.821 INFO:teuthology.dispatcher.supervisor:Running job 7382107
2023-08-27T10:39:41.821 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-27_10:17:53-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382107 --name matan-2023-08-27_10:17:53-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_8 crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/matan-2023-08-27_10:17:53-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382107/orig.config.yaml
2023-08-27T10:39:41.824 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-27_10:17:53-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382107
2023-08-27T10:39:41.825 INFO:teuthology.dispatcher.supervisor:Job PID: 1578312
2023-08-27T10:39:41.826 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-27T10:41:41.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:43:42.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:45:42.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:47:42.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:49:42.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:51:42.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:53:42.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:55:43.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:57:43.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:59:43.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T11:01:43.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T11:03:43.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T11:03:43.855 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-27T11:03:43.999 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2023-08-27T11:03:44.046 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com