2023-08-27T10:05:30.464 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-27T10:05:30.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:05:30.567 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fadb97489d0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fadba2481f0>, signals=[15])
2023-08-27T10:05:30.568 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-08-27T10:05:30.569 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-08-27T10:05:30.569 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-27T10:05:30.591 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-08-27T10:05:30.662 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-27T10:05:30.702 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_9.stream (ID 10)
2023-08-27T10:05:30.703 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 10}
2023-08-27T10:05:30.753 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 9.stream
2023-08-27T10:05:30.754 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:05:30.824 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-08-27T10:05:30.868 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-08-27T10:05:30.933 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:05:31.034 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-27T10:05:31.035 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T10:05:31.057 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-27T10:05:31.057 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:31.089 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-27T10:05:35.093 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:35.201 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-27T10:05:39.205 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:39.313 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-27T10:05:39.414 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-27T10:05:39.515 INFO:teuthology.orchestra.console.smithi169:Power on
2023-08-27T10:05:39.515 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-27T10:05:39.535 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2023-08-27T10:05:39.536 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:39.557 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-27T10:05:43.561 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:43.669 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-27T10:05:47.673 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:05:47.781 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-08-27T10:05:47.882 INFO:teuthology.orchestra.console.smithi169:Power on completed
2023-08-27T10:05:47.982 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-08-27T10:05:47.983 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:06:03.055 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:06:18.125 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:06:33.193 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:06:48.263 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:07:03.339 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:07:18.421 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:07:33.502 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:07:48.581 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:08:03.663 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:08:18.757 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-08-27T10:08:18.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:08:37.381 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:08:43.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:08:46.469 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:08:52.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:08:55.557 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:09:01.561 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:09:04.613 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:09:10.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:09:13.703 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:09:19.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:09:22.789 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-08-27T10:09:28.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:10:28.853 WARNING:teuthology.provision.fog.smithi169:timed out
2023-08-27T10:10:34.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:10:35.072 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-27T10:10:35.073 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-27T10:10:35.405 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-08-27T10:10:35.406 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-08-27T10:10:35.420 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-08-27T10:10:35.421 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-08-27T10:10:35.476 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-08-27T10:10:35.476 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-27T10:10:35.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-08-27T10:10:35.626 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-08-27T10:10:35.694 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-08-27T10:10:35.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-08-27T10:10:35.828 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-27T10:10:35.882 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-08-27T10:10:35.882 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2023-08-27T10:10:35.883 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-08-27T10:10:35.883 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-08-27T10:10:35.883 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2023-08-27T10:10:35.883 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2023-08-27T10:10:35.883 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-27T10:10:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-27T10:10:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2023-08-27T10:10:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-27T10:10:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-08-27T10:10:35.884 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T10:10:35.885 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-27T10:10:35.885 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-27T10:10:35.886 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-08-27T10:10:35.887 DEBUG:teuthology.parallel:result is None
2023-08-27T10:10:35.996 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-08-27T10:10:35.997 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-27T10:10:36.022 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-08-27T10:10:36.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-27T10:10:36.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-27T10:10:36.103 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-08-27T10:10:36.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-08-27T10:10:36.171 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-08-27T10:10:36.225 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-08-27T10:10:36.226 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-08-27T10:10:36.280 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-08-27T10:10:36.280 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9"
2023-08-27T10:10:36.281 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-08-27T10:10:36.281 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-08-27T10:10:36.281 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9"
2023-08-27T10:10:36.281 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9"
2023-08-27T10:10:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-27T10:10:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-08-27T10:10:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon"
2023-08-27T10:10:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-27T10:10:36.282 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-08-27T10:10:36.283 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-27T10:10:36.283 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-27T10:10:36.283 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-27T10:10:36.284 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-08-27T10:10:36.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:10:36.404 INFO:teuthology.dispatcher.supervisor:Running job 7382043
2023-08-27T10:10:36.404 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382043 --name matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382043/orig.config.yaml
2023-08-27T10:10:36.408 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382043
2023-08-27T10:10:36.409 INFO:teuthology.dispatcher.supervisor:Job PID: 1241455
2023-08-27T10:10:36.409 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-27T10:12:36.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:14:36.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:16:36.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:18:37.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:20:37.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:22:37.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:24:37.534 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:26:37.698 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:28:37.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-27T10:28:37.939 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-27T10:28:38.106 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-27T10:28:38.106 INFO:teuthology.nuke:Checking targets against current locks
2023-08-27T10:28:38.151 DEBUG:teuthology.nuke:shortname: smithi169
2023-08-27T10:28:38.152 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-27T10:28:38.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 10:05:29.667821', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9UbNxhXgwCseHm0RjNC3Z5o6Xt4cikM+x53+An4mA/yxjRtzi0gDkAgLS6w03AvTg0zLUHavELbb9fmqHYmzk='}
2023-08-27T10:28:38.229 INFO:teuthology.orchestra.console.smithi169:Power off
2023-08-27T10:28:38.229 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-27T10:28:38.252 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-08-27T10:28:38.253 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-27T10:28:38.277 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-08-27T10:28:38.378 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-08-27T10:28:38.530 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com