2023-10-12T02:05:02.062 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07
2023-10-12T02:05:02.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:05:02.159 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f4a5bc1bac0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f4a5c70e670>, signals=[15])
2023-10-12T02:05:02.161 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-10-12T02:05:02.162 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-10-12T02:05:02.163 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-10-12T02:05:02.183 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-10-12T02:05:02.254 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-10-12T02:05:02.294 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2023-10-12T02:05:02.295 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 10}
2023-10-12T02:05:02.343 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2023-10-12T02:05:02.343 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:05:02.390 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-10-12T02:05:02.429 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-10-12T02:05:02.481 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:05:02.558 INFO:teuthology.orchestra.console.smithi110:Power off
2023-10-12T02:05:02.559 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-12T02:05:02.583 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-10-12T02:05:02.584 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:02.608 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-10-12T02:05:06.610 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:06.718 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-10-12T02:05:10.722 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:10.830 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-12T02:05:10.931 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-10-12T02:05:11.032 INFO:teuthology.orchestra.console.smithi110:Power on
2023-10-12T02:05:11.033 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-12T02:05:11.057 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2023-10-12T02:05:11.058 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:11.081 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-12T02:05:15.082 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:15.192 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-12T02:05:19.194 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:05:19.302 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-10-12T02:05:19.403 INFO:teuthology.orchestra.console.smithi110:Power on completed
2023-10-12T02:05:19.504 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-10-12T02:05:19.505 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:05:34.586 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:05:49.666 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:06:04.743 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:06:19.826 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:06:34.914 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:06:50.002 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:07:05.110 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:07:20.202 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:07:35.300 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:07:50.390 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-10-12T02:07:50.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:08:08.826 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-12T02:08:14.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:08:17.886 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-12T02:08:23.893 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:08:26.970 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-12T02:08:32.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:08:36.026 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-10-12T02:08:42.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:09:42.090 WARNING:teuthology.provision.fog.smithi110:timed out
2023-10-12T02:09:48.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:09:48.416 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-12T02:09:48.416 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-12T02:09:48.739 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-10-12T02:09:48.740 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-10-12T02:09:48.754 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-10-12T02:09:48.754 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-10-12T02:09:48.809 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-10-12T02:09:48.810 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-10-12T02:09:48.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-10-12T02:09:48.971 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-10-12T02:09:49.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-10-12T02:09:49.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-10-12T02:09:49.173 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-10-12T02:09:49.227 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-10-12T02:09:49.227 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-10-12T02:09:49.228 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-10-12T02:09:49.228 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-10-12T02:09:49.228 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-10-12T02:09:49.228 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-10-12T02:09:49.229 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-12T02:09:49.229 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-10-12T02:09:49.229 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-10-12T02:09:49.229 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-12T02:09:49.229 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-10-12T02:09:49.230 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T02:09:49.230 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-12T02:09:49.230 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T02:09:49.231 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-10-12T02:09:49.232 DEBUG:teuthology.parallel:result is None
2023-10-12T02:09:49.351 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-10-12T02:09:49.352 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-12T02:09:49.377 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-10-12T02:09:49.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-10-12T02:09:49.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-12T02:09:49.460 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-10-12T02:09:49.524 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-10-12T02:09:49.524 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-10-12T02:09:49.578 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-10-12T02:09:49.578 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-10-12T02:09:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-10-12T02:09:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-10-12T02:09:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-10-12T02:09:49.632 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-10-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-10-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-10-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-10-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-10-12T02:09:49.633 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-10-12T02:09:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-10-12T02:09:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-10-12T02:09:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-12T02:09:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-10-12T02:09:49.634 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-12T02:09:49.635 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-10-12T02:09:49.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:09:49.758 INFO:teuthology.dispatcher.supervisor:Running job 7422389
2023-10-12T02:09:49.758 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/virtualenv/bin/teuthology -v --owner scheduled_yingxin@teuthology --archive /home/teuthworker/archive/yingxin-2023-10-12_01:35:43-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7422389 --name yingxin-2023-10-12_01:35:43-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi --description crimson-rados/perf/{clusters/{fixed-2} crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph objectstore/bluestore settings/optimized workloads/radosbench_4M_seq_read} -- /home/teuthworker/archive/yingxin-2023-10-12_01:35:43-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7422389/orig.config.yaml
2023-10-12T02:09:49.763 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yingxin-2023-10-12_01:35:43-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7422389
2023-10-12T02:09:49.765 INFO:teuthology.dispatcher.supervisor:Job PID: 3757892
2023-10-12T02:09:49.766 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-12T02:11:49.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:13:50.030 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:15:50.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:17:50.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:19:50.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:21:50.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:23:50.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:25:51.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-12T02:25:51.113 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-10-12T02:25:51.195 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-12T02:25:51.195 INFO:teuthology.nuke:Checking targets against current locks
2023-10-12T02:25:51.243 DEBUG:teuthology.nuke:shortname: smithi110
2023-10-12T02:25:51.243 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-12T02:25:51.266 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2023-10-12_01:35:43-crimson-rados-wip-yingxin-crimson-osd-crosscore-pg-submission-distro-default-smithi/7422389', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-12 02:05:01.258996', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLwyh8MSzOZSsPKX0VAfy8No0XDyNu9V7NrRS5FbmiWOgbccn/Bn+D5olQ5pf6ausgtYQvmIS0XqMEB/1QQ3WUc='}
2023-10-12T02:25:51.311 INFO:teuthology.orchestra.console.smithi110:Power off
2023-10-12T02:25:51.312 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-12T02:25:51.362 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-10-12T02:25:51.363 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-12T02:25:51.383 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-10-12T02:25:51.484 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-10-12T02:25:51.636 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com