2023-08-08T11:20:49.479 INFO:root:teuthology version: 0.0.1.dev176+g250cac1
2023-08-08T11:20:49.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:20:49.598 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f844a5b8820>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8449cc3e50>, signals=[15])
2023-08-08T11:20:49.600 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-08-08T11:20:49.600 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-08-08T11:20:49.601 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-08-08T11:20:49.626 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /host {"name": "smithi161"}
2023-08-08T11:20:49.694 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-08T11:20:49.737 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3)
2023-08-08T11:20:49.738 DEBUG:teuthology.provision.fog.smithi161:FOG request: PUT /host/266 {"imageID": 3}
2023-08-08T11:20:49.789 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2023-08-08T11:20:49.789 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:20:49.853 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /tasktype {"name": "deploy"}
2023-08-08T11:20:49.892 DEBUG:teuthology.provision.fog.smithi161:FOG request: POST /host/266/task {"taskTypeID": 1}
2023-08-08T11:20:49.948 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:20:50.058 INFO:teuthology.orchestra.console.smithi161:Power off
2023-08-08T11:20:50.059 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T11:20:50.101 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-08-08T11:20:50.102 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:20:50.125 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-08-08T11:20:54.128 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:20:54.239 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-08-08T11:20:58.244 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:20:58.355 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-08-08T11:21:02.356 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:21:02.468 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-08-08T11:21:02.569 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-08-08T11:21:02.670 INFO:teuthology.orchestra.console.smithi161:Power on
2023-08-08T11:21:02.670 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-08T11:21:02.691 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On
2023-08-08T11:21:02.691 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:21:02.714 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-08-08T11:21:06.716 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:21:06.826 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on
2023-08-08T11:21:06.927 INFO:teuthology.orchestra.console.smithi161:Power on completed
2023-08-08T11:21:07.028 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-08-08T11:21:07.028 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:21:22.124 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:21:37.221 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:21:52.308 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:22:07.396 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:22:22.490 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:22:37.584 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:22:52.680 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:23:07.768 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:23:22.852 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:23:37.944 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:23:53.028 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:24:08.136 DEBUG:teuthology.provision.fog.smithi161:FOG request: GET /task/active None
2023-08-08T11:24:08.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:11.280 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:24:17.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:20.336 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:24:26.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:29.396 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:24:35.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:38.480 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:24:44.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:47.536 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:24:53.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:24:56.592 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:25:02.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:25:05.652 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-08-08T11:25:11.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:26:11.720 WARNING:teuthology.provision.fog.smithi161:timed out
2023-08-08T11:26:17.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:26:17.962 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-08T11:26:17.964 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-08T11:26:18.205 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-08-08T11:26:18.206 DEBUG:teuthology.orchestra.run.smithi161:> hostname
2023-08-08T11:26:18.225 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-08-08T11:26:18.226 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts
2023-08-08T11:26:18.284 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-08-08T11:26:18.284 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-08-08T11:26:18.393 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts
2023-08-08T11:26:18.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts
2023-08-08T11:26:18.491 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname
2023-08-08T11:26:18.559 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161
2023-08-08T11:26:18.628 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-08-08T11:26:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-08-08T11:26:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-08-08T11:26:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-08-08T11:26:18.686 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-08-08T11:26:18.687 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T11:26:18.688 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-08T11:26:18.688 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T11:26:18.688 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-08-08T11:26:18.690 DEBUG:teuthology.parallel:result is None
2023-08-08T11:26:18.797 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-08-08T11:26:18.798 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-08T11:26:18.824 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-08-08T11:26:18.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-08-08T11:26:18.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-08T11:26:18.891 DEBUG:teuthology.orchestra.run.smithi161:> true
2023-08-08T11:26:18.957 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-08-08T11:26:18.958 DEBUG:teuthology.orchestra.run.smithi161:> uname -m
2023-08-08T11:26:19.017 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-08-08T11:26:19.018 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release
2023-08-08T11:26:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-08-08T11:26:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-08-08T11:26:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-08-08T11:26:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-08-08T11:26:19.076 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-08T11:26:19.077 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-08T11:26:19.077 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-08T11:26:19.077 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-08-08T11:26:19.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:26:19.215 INFO:teuthology.dispatcher.supervisor:Running job 7358884
2023-08-08T11:26:19.215 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_250cac13884ccaca114f617952ff3b9f286ec3e7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358884 --name yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} -- /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358884/orig.config.yaml
2023-08-08T11:26:19.220 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358884
2023-08-08T11:26:19.221 INFO:teuthology.dispatcher.supervisor:Job PID: 29591
2023-08-08T11:26:19.221 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-08T11:28:19.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:30:19.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:32:19.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:34:19.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:36:19.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:38:20.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:40:20.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:42:20.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:44:20.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:46:20.793 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:48:20.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:50:21.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:52:21.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:54:21.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:56:21.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-08T11:56:21.729 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-08T11:56:21.794 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-08T11:56:21.794 INFO:teuthology.nuke:Checking targets against current locks
2023-08-08T11:56:21.842 DEBUG:teuthology.nuke:shortname: smithi161
2023-08-08T11:56:21.843 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-08T11:56:21.866 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-02_20:21:03-rados-wip-yuri3-testing-2023-08-01-0825-pacific-distro-default-smithi/7358884', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 11:20:48.684244', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDS/WZyb9GXaPzzcANS9J5Z60XVGkYYPOBaafvUbYUQuxsC3bpWCPkxJ8NBRqFKUxmpO/bWtI4e1ETkyX8y2gJyy1cQFCox7A02SIa/y9GePMrQNhWNqiT8bwExEnkIqvdyfYKscitZNjK06zfAcAqoBA7jGHhnYxTl1SRmWblQT8L4jTTsX7YEGHAr0xZn6bycsdkbLBAqSZU+7IXsSZgJpukDvfqTlCHCIhL7iqcGZ3iGd0kBCRnIBwfFJjbCbNFQmku1ib5WOf4/LBhpkQzKPQjX/xeB5kTL9TvtIlFJ93OPMjnTs/lYW1NRq7QRy68hGgsW6NvvufUvovKzS5R8bWNR8gbJYvtfjfR9Aiu7u2ve3y/mGUT1tP/rMTHC45ytG9ojk5BcMP2zfqUY+7RkHNusoIWwoQJ8vSuVWyRmoouCAg09uG63PRfcL67G+c3Qdw+jjGwpE0M50ghlGByKSSW0sF2tQFuYE2gUeE41OXBIqWfLn0f+VYFQO6c+muU='}
2023-08-08T11:56:21.915 INFO:teuthology.orchestra.console.smithi161:Power off
2023-08-08T11:56:21.916 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-08T11:56:21.940 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off
2023-08-08T11:56:21.941 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-08T11:56:21.965 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off
2023-08-08T11:56:22.066 INFO:teuthology.orchestra.console.smithi161:Power off completed
2023-08-08T11:56:22.230 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com