2023-12-14T03:04:30.608 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e
2023-12-14T03:04:30.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:04:30.716 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f20d35df310>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f20d453c940>, signals=[15])
2023-12-14T03:04:30.716 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2023-12-14T03:04:30.717 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2023-12-14T03:04:30.717 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-12-14T03:04:30.860 DEBUG:teuthology.provision.fog.smithi178:Requesting image smithi_centos_8.stream (ID 3)
2023-12-14T03:04:30.910 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 8.stream
2023-12-14T03:04:31.158 INFO:teuthology.orchestra.console.smithi178:Power off
2023-12-14T03:04:31.158 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T03:04:31.182 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-12-14T03:04:31.182 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:31.204 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-12-14T03:04:35.205 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:35.314 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-12-14T03:04:39.317 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:39.426 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-12-14T03:04:39.527 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-12-14T03:04:39.628 INFO:teuthology.orchestra.console.smithi178:Power on
2023-12-14T03:04:39.628 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-14T03:04:39.649 DEBUG:teuthology.orchestra.console.smithi178:power on output: Chassis Power Control: Up/On
2023-12-14T03:04:39.649 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:39.672 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-12-14T03:04:43.673 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:43.783 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-12-14T03:04:47.785 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:04:47.894 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on
2023-12-14T03:04:47.995 INFO:teuthology.orchestra.console.smithi178:Power on completed
2023-12-14T03:04:48.096 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2023-12-14T03:07:49.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:07:52.210 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:07:58.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:01.269 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:07.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:10.357 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:16.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:19.441 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:25.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:28.497 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:34.502 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:37.557 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:43.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:46.644 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:08:52.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:08:55.729 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:09:01.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:09:20.274 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:09:26.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:09:29.366 WARNING:teuthology.provision.fog.smithi178:[Errno None] Unable to connect to port 22 on 172.21.15.178
2023-12-14T03:09:35.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:09:35.872 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-14T03:09:35.873 DEBUG:teuthology.orchestra.run.smithi178:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-14T03:10:00.848 INFO:teuthology.provision.fog.smithi178:Node is ready
2023-12-14T03:10:00.849 DEBUG:teuthology.orchestra.run.smithi178:> hostname
2023-12-14T03:10:00.873 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2023-12-14T03:10:00.874 DEBUG:teuthology.orchestra.run.smithi178:> grep smithi178.front.sepia.ceph.com /etc/hosts
2023-12-14T03:10:00.935 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2023-12-14T03:10:00.935 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-12-14T03:10:01.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hosts
2023-12-14T03:10:01.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/172.21.15.178/172.21.15.178/g' /etc/hosts
2023-12-14T03:10:01.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i -e 's/smithi178.front.sepia.ceph.com/smithi178/g' /etc/hostname
2023-12-14T03:10:01.246 DEBUG:teuthology.orchestra.run.smithi178:> sudo hostname smithi178
2023-12-14T03:10:01.315 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-12-14T03:10:01.373 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-12-14T03:10:01.373 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T03:10:01.374 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T03:10:01.375 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T03:10:01.375 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2023-12-14T03:10:01.376 DEBUG:teuthology.parallel:result is None
2023-12-14T03:10:01.523 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2023-12-14T03:10:01.524 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-14T03:10:01.551 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2023-12-14T03:10:01.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-12-14T03:10:01.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-14T03:10:01.622 DEBUG:teuthology.orchestra.run.smithi178:> true
2023-12-14T03:10:01.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com'
2023-12-14T03:10:01.647 DEBUG:teuthology.orchestra.run.smithi178:> uname -m
2023-12-14T03:10:01.706 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2023-12-14T03:10:01.707 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release
2023-12-14T03:10:01.764 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-14T03:10:01.765 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-14T03:10:01.766 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-14T03:10:01.766 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2023-12-14T03:10:01.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:10:01.880 INFO:teuthology.dispatcher.supervisor:Running job 7491049
2023-12-14T03:10:01.880 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-14_00:45:58-rgw-wip-yuri2-testing-2023-12-13-0747-quincy-distro-default-smithi/7491049 --name yuriw-2023-12-14_00:45:58-rgw-wip-yuri2-testing-2023-12-13-0747-quincy-distro-default-smithi --description rgw/crypt/{0-cluster/fixed-1 1-ceph-install/install 2-kms/barbican 3-rgw/rgw 4-tests/{s3tests} ignore-pg-availability supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-12-14_00:45:58-rgw-wip-yuri2-testing-2023-12-13-0747-quincy-distro-default-smithi/7491049/orig.config.yaml
2023-12-14T03:10:01.883 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-14_00:45:58-rgw-wip-yuri2-testing-2023-12-13-0747-quincy-distro-default-smithi/7491049
2023-12-14T03:10:01.884 INFO:teuthology.dispatcher.supervisor:Job PID: 1746918
2023-12-14T03:10:01.884 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-14T03:12:01.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:14:02.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:16:02.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:18:02.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:20:02.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:22:02.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:24:02.938 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:26:03.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:28:03.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:30:03.462 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:32:03.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-14T03:32:03.710 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-14T03:32:03.798 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-14T03:32:03.798 INFO:teuthology.nuke:Checking targets against current locks
2023-12-14T03:32:03.845 DEBUG:teuthology.nuke:shortname: smithi178
2023-12-14T03:32:03.846 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-14T03:32:03.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-14_00:45:58-rgw-wip-yuri2-testing-2023-12-13-0747-quincy-distro-default-smithi/7491049', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-14 03:04:29.798045', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNXQbuBnTeOW+/g0/u6uD8QehjJutgtzudJKHn1f9POCO3a0tJfqBjXy2NCKlMIfUAV0/6dHt9kfsDfbJeyYzF8='}
2023-12-14T03:32:03.913 INFO:teuthology.orchestra.console.smithi178:Power off
2023-12-14T03:32:03.913 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-14T03:32:03.935 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off
2023-12-14T03:32:03.936 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-14T03:32:03.957 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off
2023-12-14T03:32:04.058 INFO:teuthology.orchestra.console.smithi178:Power off completed
2023-12-14T03:32:04.210 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com