2023-08-17T20:08:19.850 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-17T20:08:19.852 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:08:19.952 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd05638ddf0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd05788b310>, signals=[15])
2023-08-17T20:08:19.953 INFO:teuthology.lock.ops:Start node 'smithi203.front.sepia.ceph.com' reimaging
2023-08-17T20:08:19.953 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: reset os type and version on server
2023-08-17T20:08:19.954 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-08-17T20:08:19.971 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /host {"name": "smithi203"}
2023-08-17T20:08:20.034 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-17T20:08:20.076 DEBUG:teuthology.provision.fog.smithi203:Requesting image smithi_centos_8.stream (ID 3)
2023-08-17T20:08:20.076 DEBUG:teuthology.provision.fog.smithi203:FOG request: PUT /host/307 {"imageID": 3}
2023-08-17T20:08:20.120 INFO:teuthology.provision.fog.smithi203:Scheduling deploy of centos 8.stream
2023-08-17T20:08:20.121 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:08:20.282 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /tasktype {"name": "deploy"}
2023-08-17T20:08:20.314 DEBUG:teuthology.provision.fog.smithi203:FOG request: POST /host/307/task {"taskTypeID": 1}
2023-08-17T20:08:20.372 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:08:20.589 INFO:teuthology.orchestra.console.smithi203:Power off
2023-08-17T20:08:20.590 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:08:20.611 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-08-17T20:08:20.612 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:20.631 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-08-17T20:08:24.636 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:24.745 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-08-17T20:08:28.750 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:28.860 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-08-17T20:08:32.865 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:32.974 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-08-17T20:08:33.075 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-08-17T20:08:33.176 INFO:teuthology.orchestra.console.smithi203:Power on
2023-08-17T20:08:33.176 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-17T20:08:33.195 DEBUG:teuthology.orchestra.console.smithi203:power on output: Chassis Power Control: Up/On
2023-08-17T20:08:33.196 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:33.215 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-08-17T20:08:37.220 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:37.331 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-08-17T20:08:41.336 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:08:41.445 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on
2023-08-17T20:08:41.546 INFO:teuthology.orchestra.console.smithi203:Power on completed
2023-08-17T20:08:41.647 INFO:teuthology.provision.fog.smithi203:Waiting for deploy to finish
2023-08-17T20:08:41.647 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:08:56.863 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:09:12.124 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:09:27.387 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:09:42.628 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:09:57.868 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:10:13.118 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:10:28.392 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:10:43.720 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:10:59.203 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:11:24.231 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:11:42.031 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:11:59.199 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:12:14.576 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:12:29.931 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:12:45.264 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:13:00.585 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:13:15.951 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:13:31.246 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:13:46.520 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:14:01.680 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:14:16.884 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:14:32.084 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:14:47.276 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:15:02.448 DEBUG:teuthology.provision.fog.smithi203:FOG request: GET /task/active None
2023-08-17T20:15:02.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:02.602 ERROR:teuthology.orchestra.connection:Error authenticating with smithi203.front.sepia.ceph.com: No SSH private key found!
2023-08-17T20:16:02.603 WARNING:teuthology.provision.fog.smithi203:No existing session
2023-08-17T20:16:08.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:32.112 WARNING:teuthology.provision.fog.smithi203:[Errno None] Unable to connect to port 22 on 172.21.15.203
2023-08-17T20:16:38.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:16:45.600 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-17T20:16:45.601 DEBUG:teuthology.orchestra.run.smithi203:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-17T20:16:49.268 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104)
2023-08-17T20:17:10.928 INFO:teuthology.provision.fog.smithi203:Node is ready
2023-08-17T20:17:10.928 DEBUG:teuthology.orchestra.run.smithi203:> hostname
2023-08-17T20:17:10.952 INFO:teuthology.orchestra.run.smithi203.stdout:smithi203.front.sepia.ceph.com
2023-08-17T20:17:10.952 DEBUG:teuthology.orchestra.run.smithi203:> grep smithi203.front.sepia.ceph.com /etc/hosts
2023-08-17T20:17:11.013 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.15.203 smithi203.front.sepia.ceph.com smithi203
2023-08-17T20:17:11.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-08-17T20:17:11.167 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hosts
2023-08-17T20:17:11.199 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/172.21.15.203/172.21.15.203/g' /etc/hosts
2023-08-17T20:17:11.268 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i -e 's/smithi203.front.sepia.ceph.com/smithi203/g' /etc/hostname
2023-08-17T20:17:11.338 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname smithi203
2023-08-17T20:17:11.405 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-08-17T20:17:11.463 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-08-17T20:17:11.463 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-08-17T20:17:11.463 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-08-17T20:17:11.463 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-08-17T20:17:11.463 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:17:11.464 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:17:11.465 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T20:17:11.465 INFO:teuthology.provision.fog.smithi203:Deploy complete!
2023-08-17T20:17:11.467 DEBUG:teuthology.parallel:result is None
2023-08-17T20:17:21.580 INFO:teuthology.lock.ops:Checking smithi203.front.sepia.ceph.com
2023-08-17T20:17:21.581 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-17T20:17:21.966 INFO:teuthology.lock.ops:Updating [smithi203.front.sepia.ceph.com]: set os type and version on server
2023-08-17T20:17:21.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-08-17T20:17:21.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-17T20:17:22.037 DEBUG:teuthology.orchestra.run.smithi203:> true
2023-08-17T20:17:22.171 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com'
2023-08-17T20:17:22.172 DEBUG:teuthology.orchestra.run.smithi203:> uname -m
2023-08-17T20:17:22.231 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64
2023-08-17T20:17:22.231 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release
2023-08-17T20:17:22.291 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream"
2023-08-17T20:17:22.291 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="8"
2023-08-17T20:17:22.291 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos"
2023-08-17T20:17:22.291 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="8"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el8"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/"
2023-08-17T20:17:22.292 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-17T20:17:22.293 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-17T20:17:22.293 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-17T20:17:22.293 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server
2023-08-17T20:17:22.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:17:22.407 INFO:teuthology.dispatcher.supervisor:Running job 7371944
2023-08-17T20:17:22.408 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371944 --name yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} -- /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371944/orig.config.yaml
2023-08-17T20:17:22.412 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371944
2023-08-17T20:17:22.413 INFO:teuthology.dispatcher.supervisor:Job PID: 14585
2023-08-17T20:17:22.413 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-17T20:19:22.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:21:27.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:23:32.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:25:38.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:27:38.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:29:38.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:31:38.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:33:38.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:35:39.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:37:39.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:39:39.453 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:41:39.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:43:39.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:45:39.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:47:40.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:49:40.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:51:40.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-17T20:51:40.474 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-17T20:51:40.598 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-17T20:51:40.598 INFO:teuthology.nuke:Checking targets against current locks
2023-08-17T20:51:40.642 DEBUG:teuthology.nuke:shortname: smithi203
2023-08-17T20:51:40.642 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-17T20:51:40.663 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-17_20:06:11-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371944', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-17 20:08:19.141564', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMaUIGgw48Zd/pbT3y/XS/kNqR/G6Zs7Xfsy9CtWDr5X0sLHXhLUDbWIERVC7qdPLxQNuhXcb7J5lc2ixkE6bLM='}
2023-08-17T20:51:40.705 INFO:teuthology.orchestra.console.smithi203:Power off
2023-08-17T20:51:40.706 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-17T20:51:40.725 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off
2023-08-17T20:51:40.726 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-17T20:51:40.745 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off
2023-08-17T20:51:40.846 INFO:teuthology.orchestra.console.smithi203:Power off completed
2023-08-17T20:51:40.998 INFO:teuthology.lock.ops:unlocked: smithi203.front.sepia.ceph.com