2023-10-07T03:55:51.947 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-07T03:55:51.947 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T03:55:52.062 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f617ea86b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f617f578670>, signals=[15])
2023-10-07T03:55:52.062 INFO:teuthology.lock.ops:Start node 'smithi174.front.sepia.ceph.com' reimaging
2023-10-07T03:55:52.062 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: reset os type and version on server
2023-10-07T03:55:52.062 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2023-10-07T03:55:52.081 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /host {"name": "smithi174"}
2023-10-07T03:55:52.153 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-07T03:55:52.196 DEBUG:teuthology.provision.fog.smithi174:Requesting image smithi_centos_8.stream (ID 3)
2023-10-07T03:55:52.196 DEBUG:teuthology.provision.fog.smithi174:FOG request: PUT /host/279 {"imageID": 3}
2023-10-07T03:55:52.241 INFO:teuthology.provision.fog.smithi174:Scheduling deploy of centos 8.stream
2023-10-07T03:55:52.241 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:55:52.311 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /tasktype {"name": "deploy"}
2023-10-07T03:55:52.350 DEBUG:teuthology.provision.fog.smithi174:FOG request: POST /host/279/task {"taskTypeID": 1}
2023-10-07T03:55:52.405 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:55:52.508 INFO:teuthology.orchestra.console.smithi174:Power off
2023-10-07T03:55:52.509 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-07T03:55:52.529 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off
2023-10-07T03:55:52.530 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:55:52.550 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2023-10-07T03:55:56.554 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:55:56.663 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2023-10-07T03:56:00.666 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:56:00.776 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-10-07T03:56:00.877 INFO:teuthology.orchestra.console.smithi174:Power off completed
2023-10-07T03:56:00.977 INFO:teuthology.orchestra.console.smithi174:Power on
2023-10-07T03:56:00.977 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-07T03:56:00.997 DEBUG:teuthology.orchestra.console.smithi174:power on output: Chassis Power Control: Up/On
2023-10-07T03:56:00.998 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:56:01.017 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-10-07T03:56:05.018 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:56:05.126 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-10-07T03:56:09.130 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T03:56:09.239 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is on
2023-10-07T03:56:09.340 INFO:teuthology.orchestra.console.smithi174:Power on completed
2023-10-07T03:56:09.440 INFO:teuthology.provision.fog.smithi174:Waiting for deploy to finish
2023-10-07T03:56:09.441 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:56:24.533 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:56:39.621 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:56:54.702 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:57:09.786 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:57:24.874 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:57:39.958 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:57:55.054 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:58:10.150 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:58:25.248 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:58:40.322 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:58:55.410 DEBUG:teuthology.provision.fog.smithi174:FOG request: GET /task/active None
2023-10-07T03:58:55.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:58:58.554 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:04.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:59:07.610 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:13.614 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:59:16.666 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:22.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:59:25.726 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:31.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:59:34.810 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:40.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T03:59:43.866 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T03:59:49.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T04:00:08.314 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T04:00:14.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T04:00:17.370 WARNING:teuthology.provision.fog.smithi174:[Errno None] Unable to connect to port 22 on 172.21.15.174
2023-10-07T04:00:23.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T04:00:23.635 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-07T04:00:23.635 DEBUG:teuthology.orchestra.run.smithi174:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-07T04:00:48.604 INFO:teuthology.provision.fog.smithi174:Node is ready
2023-10-07T04:00:48.604 DEBUG:teuthology.orchestra.run.smithi174:> hostname
2023-10-07T04:00:48.629 INFO:teuthology.orchestra.run.smithi174.stdout:smithi174.front.sepia.ceph.com
2023-10-07T04:00:48.629 DEBUG:teuthology.orchestra.run.smithi174:> grep smithi174.front.sepia.ceph.com /etc/hosts
2023-10-07T04:00:48.690 INFO:teuthology.orchestra.run.smithi174.stdout:172.21.15.174 smithi174.front.sepia.ceph.com smithi174
2023-10-07T04:00:48.690 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-10-07T04:00:48.816 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hosts
2023-10-07T04:00:48.848 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/172.21.15.174/172.21.15.174/g' /etc/hosts
2023-10-07T04:00:48.917 DEBUG:teuthology.orchestra.run.smithi174:> sudo sed -i -e 's/smithi174.front.sepia.ceph.com/smithi174/g' /etc/hostname
2023-10-07T04:00:48.987 DEBUG:teuthology.orchestra.run.smithi174:> sudo hostname smithi174
2023-10-07T04:00:49.056 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2023-10-07T04:00:49.115 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2023-10-07T04:00:49.115 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8"
2023-10-07T04:00:49.115 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-07T04:00:49.116 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-07T04:00:49.117 INFO:teuthology.provision.fog.smithi174:Deploy complete!
2023-10-07T04:00:49.118 DEBUG:teuthology.parallel:result is None
2023-10-07T04:00:49.230 INFO:teuthology.lock.ops:Checking smithi174.front.sepia.ceph.com
2023-10-07T04:00:49.231 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-07T04:00:49.257 INFO:teuthology.lock.ops:Updating [smithi174.front.sepia.ceph.com]: set os type and version on server
2023-10-07T04:00:49.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi174.front.sepia.ceph.com'
2023-10-07T04:00:49.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi174.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-07T04:00:49.326 DEBUG:teuthology.orchestra.run.smithi174:> true
2023-10-07T04:00:49.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi174.front.sepia.ceph.com'
2023-10-07T04:00:49.393 DEBUG:teuthology.orchestra.run.smithi174:> uname -m
2023-10-07T04:00:49.451 INFO:teuthology.orchestra.run.smithi174.stdout:x86_64
2023-10-07T04:00:49.452 DEBUG:teuthology.orchestra.run.smithi174:> cat /etc/os-release
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:NAME="CentOS Stream"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION="8"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:ID="centos"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:ID_LIKE="rhel fedora"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:VERSION_ID="8"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:PLATFORM_ID="platform:el8"
2023-10-07T04:00:49.510 INFO:teuthology.orchestra.run.smithi174.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:ANSI_COLOR="0;31"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:HOME_URL="https://centos.org/"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-07T04:00:49.511 INFO:teuthology.orchestra.run.smithi174.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-07T04:00:49.511 INFO:teuthology.lock.ops:Updating smithi174.front.sepia.ceph.com on lock server
2023-10-07T04:00:49.530 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:00:49.615 INFO:teuthology.dispatcher.supervisor:Running job 7415733
2023-10-07T04:00:49.615 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-06_20:52:05-rgw-wip-yuri4-testing-2023-10-05-0810-quincy-distro-default-smithi/7415733 --name yuriw-2023-10-06_20:52:05-rgw-wip-yuri4-testing-2023-10-05-0810-quincy-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/vault_kv 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-10-06_20:52:05-rgw-wip-yuri4-testing-2023-10-05-0810-quincy-distro-default-smithi/7415733/orig.config.yaml
2023-10-07T04:00:49.618 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-06_20:52:05-rgw-wip-yuri4-testing-2023-10-05-0810-quincy-distro-default-smithi/7415733
2023-10-07T04:00:49.618 INFO:teuthology.dispatcher.supervisor:Job PID: 1898295
2023-10-07T04:00:49.618 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-07T04:02:49.718 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:04:49.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:06:50.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:08:50.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:10:50.415 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:12:50.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:14:50.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:16:50.887 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:18:51.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:20:51.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:22:51.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-07T04:22:51.366 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-07T04:22:51.431 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-07T04:22:51.431 INFO:teuthology.nuke:Checking targets against current locks
2023-10-07T04:22:51.477 DEBUG:teuthology.nuke:shortname: smithi174
2023-10-07T04:22:51.477 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-07T04:22:51.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi174.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-06_20:52:05-rgw-wip-yuri4-testing-2023-10-05-0810-quincy-distro-default-smithi/7415733', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-07 03:55:51.174362', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNBI6oBbC+nKLkV6w5BfDrXRyiZaDekGJ4jsuUuacOa4PaTZimVFOh24IqB9bTonYYi4oBHxNkJ7LWdr6Fi2fP0='}
2023-10-07T04:22:51.547 INFO:teuthology.orchestra.console.smithi174:Power off
2023-10-07T04:22:51.547 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-07T04:22:51.569 DEBUG:teuthology.orchestra.console.smithi174:power off output: Chassis Power Control: Down/Off
2023-10-07T04:22:51.570 DEBUG:teuthology.orchestra.console.smithi174:pexpect command: ipmitool -H smithi174.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-07T04:22:51.589 DEBUG:teuthology.orchestra.console.smithi174:check power output: Chassis Power is off
2023-10-07T04:22:51.690 INFO:teuthology.orchestra.console.smithi174:Power off completed
2023-10-07T04:22:51.850 INFO:teuthology.lock.ops:unlocked: smithi174.front.sepia.ceph.com