2023-08-27T09:55:51.865 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-27T09:55:51.866 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T09:55:51.977 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3ee5f731f0>, signals=[15]) 2023-08-27T09:55:51.979 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging 2023-08-27T09:55:51.979 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server 2023-08-27T09:55:51.980 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-08-27T09:55:52.006 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"} 2023-08-27T09:55:52.073 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-27T09:55:52.114 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_9.stream (ID 10) 2023-08-27T09:55:52.115 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 10} 2023-08-27T09:55:52.157 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 9.stream 2023-08-27T09:55:52.157 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:55:52.208 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"} 2023-08-27T09:55:52.247 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1} 2023-08-27T09:55:52.311 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:55:52.392 INFO:teuthology.orchestra.console.smithi174:Power off 2023-08-27T09:55:52.392 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T09:55:52.414 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-08-27T09:55:52.415 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:55:52.435 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-27T09:55:56.439 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:55:56.547 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-27T09:56:00.549 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:00.657 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-27T09:56:04.661 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:04.769 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-08-27T09:56:04.870 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-08-27T09:56:04.971 INFO:teuthology.orchestra.console.smithi174:Power on 2023-08-27T09:56:04.972 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-27T09:56:04.993 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On 2023-08-27T09:56:04.994 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:05.013 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-08-27T09:56:09.017 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T09:56:09.125 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on 2023-08-27T09:56:09.226 INFO:teuthology.orchestra.console.smithi174:Power on completed 2023-08-27T09:56:09.326 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish 2023-08-27T09:56:09.327 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:56:24.395 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:56:39.457 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:56:54.523 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:57:09.601 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:57:24.671 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:57:39.741 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:57:54.817 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:58:09.889 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:58:24.970 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:58:40.045 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None 2023-08-27T09:58:40.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:58:58.565 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-27T09:59:04.569 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:07.625 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-27T09:59:13.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:16.709 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-27T09:59:22.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:25.797 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-27T09:59:31.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T09:59:34.853 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174 2023-08-27T09:59:40.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:40.911 WARNING:teuthology.provision.fog.smithi174:timed out 2023-08-27T10:00:46.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:47.115 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-27T10:00:47.116 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-27T10:00:47.394 INFO:teuthology.provision.fog.smithi174:Node is ready 2023-08-27T10:00:47.394 DEBUG:teuthology.orchestra.run.smithi174:> hostname 2023-08-27T10:00:47.412 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com 2023-08-27T10:00:47.413 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts 2023-08-27T10:00:47.472 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174 2023-08-27T10:00:47.473 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-08-27T10:00:47.582 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts 2023-08-27T10:00:47.616 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts 2023-08-27T10:00:47.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname 2023-08-27T10:00:47.762 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174 2023-08-27T10:00:47.838 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-08-27T10:00:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-08-27T10:00:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-08-27T10:00:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-08-27T10:00:47.898 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:00:47.899 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-08-27T10:00:47.899 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:00:47.899 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:00:47.899 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-08-27T10:00:47.899 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:00:47.900 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:00:47.900 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:00:47.900 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:00:47.900 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:00:47.900 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:00:47.904 INFO:teuthology.provision.fog.smithi174:Deploy complete! 2023-08-27T10:00:47.905 DEBUG:teuthology.parallel:result is None 2023-08-27T10:00:48.103 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com 2023-08-27T10:00:48.104 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-27T10:00:48.140 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server 2023-08-27T10:00:48.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-08-27T10:00:48.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-27T10:00:48.277 DEBUG:teuthology.orchestra.run.smithi174:> true 2023-08-27T10:00:48.343 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com' 2023-08-27T10:00:48.344 DEBUG:teuthology.orchestra.run.smithi174:> uname -m 2023-08-27T10:00:48.399 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64 2023-08-27T10:00:48.400 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release 2023-08-27T10:00:48.455 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream" 2023-08-27T10:00:48.455 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="9" 2023-08-27T10:00:48.455 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos" 2023-08-27T10:00:48.456 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora" 2023-08-27T10:00:48.456 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="9" 2023-08-27T10:00:48.456 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el9" 2023-08-27T10:00:48.456 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-27T10:00:48.457 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31" 2023-08-27T10:00:48.457 INFO:teuthology.orchestra.run.smithi174.stdout:LOGO="fedora-logo-icon" 2023-08-27T10:00:48.457 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-27T10:00:48.457 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/" 2023-08-27T10:00:48.457 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-27T10:00:48.458 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-27T10:00:48.458 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-27T10:00:48.459 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server 2023-08-27T10:00:48.486 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:00:48.591 INFO:teuthology.dispatcher.supervisor:Running job 7382023 2023-08-27T10:00:48.592 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382023 --name matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi --description crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} -- /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382023/orig.config.yaml 2023-08-27T10:00:48.595 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382023 2023-08-27T10:00:48.596 INFO:teuthology.dispatcher.supervisor:Job PID: 1208438 2023-08-27T10:00:48.596 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-27T10:02:48.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-27T10:02:48.792 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-27T10:02:48.852 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-27T10:02:48.853 INFO:teuthology.nuke:Checking targets against current locks 2023-08-27T10:02:48.899 DEBUG:teuthology.nuke:shortname: smithi174 2023-08-27T10:02:48.900 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-27T10:02:48.922 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-08-27_09:28:12-crimson-rados-wip-matanb-crimson-testing-24.8-v3-distro-crimson-smithi/7382023', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-27 09:55:51.094250', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMrUmbuK6RfSOLey6xrBXk2nlZu1c3/GVGsS5RxQa20nFJa9gu3M8Y0XA3xaqmBminLQapoNBKsuXp473EMoYEU='} 2023-08-27T10:02:48.972 INFO:teuthology.orchestra.console.smithi174:Power off 2023-08-27T10:02:48.972 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-27T10:02:48.996 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off 2023-08-27T10:02:48.997 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-27T10:02:49.018 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off 2023-08-27T10:02:49.119 INFO:teuthology.orchestra.console.smithi174:Power off completed 2023-08-27T10:02:49.298 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com