2023-11-14T15:02:48.616 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-14T15:02:48.618 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:02:48.738 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1af3355ac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1af3e58670>, signals=[15])
2023-11-14T15:02:48.739 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-11-14T15:02:48.740 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-11-14T15:02:48.740 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-11-14T15:02:48.762 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"}
2023-11-14T15:02:48.837 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-14T15:02:48.881 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_9.stream (ID 10)
2023-11-14T15:02:48.881 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 10}
2023-11-14T15:02:48.928 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 9.stream
2023-11-14T15:02:48.928 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:02:48.996 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"}
2023-11-14T15:02:49.038 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1}
2023-11-14T15:02:49.109 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:02:49.222 INFO:teuthology.orchestra.console.smithi115:Power off
2023-11-14T15:02:49.223 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-14T15:02:49.249 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-11-14T15:02:49.250 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:02:49.289 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-11-14T15:02:53.291 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:02:53.406 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-11-14T15:02:57.410 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:02:57.525 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-11-14T15:03:01.530 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:03:01.641 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-11-14T15:03:01.742 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-11-14T15:03:01.843 INFO:teuthology.orchestra.console.smithi115:Power on
2023-11-14T15:03:01.844 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-14T15:03:01.867 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2023-11-14T15:03:01.868 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:03:01.893 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-11-14T15:03:05.898 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-14T15:03:06.007 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-11-14T15:03:06.108 INFO:teuthology.orchestra.console.smithi115:Power on completed
2023-11-14T15:03:06.208 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-11-14T15:03:06.209 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:03:21.298 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:03:36.382 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:03:51.476 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:04:06.558 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:04:21.639 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:04:36.714 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:04:51.814 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:05:06.918 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:05:22.014 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:05:37.090 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:05:52.162 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-11-14T15:05:52.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:05:55.290 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:01.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:06:04.346 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:10.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:06:13.402 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:19.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:06:22.462 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:28.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:06:31.546 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:37.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:06:40.602 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-11-14T15:06:46.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:07:46.669 WARNING:teuthology.provision.fog.smithi115:timed out
2023-11-14T15:07:52.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:07:52.916 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-14T15:07:52.917 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-14T15:07:53.274 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-11-14T15:07:53.275 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2023-11-14T15:07:53.290 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2023-11-14T15:07:53.290 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2023-11-14T15:07:53.346 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2023-11-14T15:07:53.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-11-14T15:07:53.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2023-11-14T15:07:53.488 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2023-11-14T15:07:53.556 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2023-11-14T15:07:53.623 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-11-14T15:07:53.690 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-11-14T15:07:53.743 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2023-11-14T15:07:53.744 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2023-11-14T15:07:53.744 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2023-11-14T15:07:53.744 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2023-11-14T15:07:53.745 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2023-11-14T15:07:53.745 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2023-11-14T15:07:53.745 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-14T15:07:53.745 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-11-14T15:07:53.745 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2023-11-14T15:07:53.746 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-14T15:07:53.746 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2023-11-14T15:07:53.746 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T15:07:53.746 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-14T15:07:53.747 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-14T15:07:53.747 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2023-11-14T15:07:53.749 DEBUG:teuthology.parallel:result is None
2023-11-14T15:07:53.866 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2023-11-14T15:07:53.867 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-14T15:07:53.888 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2023-11-14T15:07:53.888 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-11-14T15:07:53.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-14T15:07:53.969 DEBUG:teuthology.orchestra.run.smithi115:> true
2023-11-14T15:07:54.036 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-11-14T15:07:54.036 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2023-11-14T15:07:54.091 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2023-11-14T15:07:54.091 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-11-14T15:07:54.146 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2023-11-14T15:07:54.146 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="9"
2023-11-14T15:07:54.146 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2023-11-14T15:07:54.146 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2023-11-14T15:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="9"
2023-11-14T15:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el9"
2023-11-14T15:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-14T15:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-11-14T15:07:54.147 INFO:teuthology.orchestra.run.smithi115.stdout:LOGO="fedora-logo-icon"
2023-11-14T15:07:54.148 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-14T15:07:54.148 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2023-11-14T15:07:54.148 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-14T15:07:54.148 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-14T15:07:54.148 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-14T15:07:54.149 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-11-14T15:07:54.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:07:54.259 INFO:teuthology.dispatcher.supervisor:Running job 7457345
2023-11-14T15:07:54.259 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-11-14_14:56:49-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-chained-distro-crimson-smithi/7457345 --name matan-2023-11-14_14:56:49-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-chained-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/fio_4M_rand_read} -- /home/teuthworker/archive/matan-2023-11-14_14:56:49-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-chained-distro-crimson-smithi/7457345/orig.config.yaml
2023-11-14T15:07:54.262 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-11-14_14:56:49-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-chained-distro-crimson-smithi/7457345
2023-11-14T15:07:54.263 INFO:teuthology.dispatcher.supervisor:Job PID: 1441772
2023-11-14T15:07:54.263 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-14T15:09:54.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:11:54.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:13:54.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:15:54.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:17:55.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:19:55.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:21:55.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:23:55.515 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:25:55.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:27:55.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:29:56.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:31:56.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-14T15:31:56.259 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-14T15:31:56.356 INFO:teuthology.dispatcher.supervisor:Unlocking machines...
2023-11-14T15:31:56.408 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com