2023-08-11T07:51:06.283 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-11T07:51:06.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T07:51:06.400 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fbb053077c0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fbb053b8e50>, signals=[15])
2023-08-11T07:51:06.401 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging
2023-08-11T07:51:06.402 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server
2023-08-11T07:51:06.402 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-08-11T07:51:06.423 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /host {"name": "smithi079"}
2023-08-11T07:51:06.496 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-11T07:51:06.530 DEBUG:teuthology.provision.fog.smithi079:Requesting image smithi_centos_8.stream (ID 3)
2023-08-11T07:51:06.532 DEBUG:teuthology.provision.fog.smithi079:FOG request: PUT /host/184 {"imageID": 3}
2023-08-11T07:51:06.597 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 8.stream
2023-08-11T07:51:06.597 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:51:06.643 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /tasktype {"name": "deploy"}
2023-08-11T07:51:06.673 DEBUG:teuthology.provision.fog.smithi079:FOG request: POST /host/184/task {"taskTypeID": 1}
2023-08-11T07:51:06.746 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:51:06.835 INFO:teuthology.orchestra.console.smithi079:Power off
2023-08-11T07:51:06.837 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T07:51:06.859 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-08-11T07:51:06.860 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:06.883 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-08-11T07:51:10.888 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:11.000 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-08-11T07:51:15.004 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:15.115 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-08-11T07:51:19.120 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:19.230 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-08-11T07:51:19.331 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-08-11T07:51:19.432 INFO:teuthology.orchestra.console.smithi079:Power on
2023-08-11T07:51:19.432 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-11T07:51:19.456 DEBUG:teuthology.orchestra.console.smithi079:power on output: Chassis Power Control: Up/On
2023-08-11T07:51:19.457 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:19.478 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-08-11T07:51:23.480 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T07:51:23.590 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is on
2023-08-11T07:51:23.690 INFO:teuthology.orchestra.console.smithi079:Power on completed
2023-08-11T07:51:23.791 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish
2023-08-11T07:51:23.792 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:51:38.868 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:51:53.940 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:52:09.011 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:52:24.087 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:52:39.164 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:52:54.236 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:53:09.312 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:53:24.384 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:53:39.452 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:53:54.520 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:54:09.584 DEBUG:teuthology.provision.fog.smithi079:FOG request: GET /task/active None
2023-08-11T07:54:09.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:12.688 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:54:18.695 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:21.780 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:54:27.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:30.864 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:54:36.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:39.952 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:54:45.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:49.044 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:54:55.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:54:58.128 WARNING:teuthology.provision.fog.smithi079:[Errno None] Unable to connect to port 22 on 172.21.15.79
2023-08-11T07:55:04.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:56:04.200 WARNING:teuthology.provision.fog.smithi079:timed out
2023-08-11T07:56:10.208 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:56:10.416 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-11T07:56:10.417 DEBUG:teuthology.orchestra.run.smithi079:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-11T07:56:10.669 INFO:teuthology.provision.fog.smithi079:Node is ready
2023-08-11T07:56:10.670 DEBUG:teuthology.orchestra.run.smithi079:> hostname
2023-08-11T07:56:10.689 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com
2023-08-11T07:56:10.690 DEBUG:teuthology.orchestra.run.smithi079:> grep smithi079.front.sepia.ceph.com /etc/hosts
2023-08-11T07:56:10.749 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079
2023-08-11T07:56:10.749 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-08-11T07:56:10.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hosts
2023-08-11T07:56:10.880 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts
2023-08-11T07:56:10.949 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079.front.sepia.ceph.com/smithi079/g' /etc/hostname
2023-08-11T07:56:11.018 DEBUG:teuthology.orchestra.run.smithi079:> sudo hostname smithi079
2023-08-11T07:56:11.086 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-08-11T07:56:11.144 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-11T07:56:11.145 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-08-11T07:56:11.146 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-11T07:56:11.146 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2023-08-11T07:56:11.146 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T07:56:11.146 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T07:56:11.146 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-11T07:56:11.147 INFO:teuthology.provision.fog.smithi079:Deploy complete!
2023-08-11T07:56:11.148 DEBUG:teuthology.parallel:result is None
2023-08-11T07:56:11.292 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com
2023-08-11T07:56:11.293 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-11T07:56:11.322 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server
2023-08-11T07:56:11.323 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-08-11T07:56:11.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-11T07:56:11.391 DEBUG:teuthology.orchestra.run.smithi079:> true
2023-08-11T07:56:11.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com'
2023-08-11T07:56:11.459 DEBUG:teuthology.orchestra.run.smithi079:> uname -m
2023-08-11T07:56:11.517 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64
2023-08-11T07:56:11.517 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release
2023-08-11T07:56:11.574 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Stream"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="8"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="8"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:PLATFORM_ID="platform:el8"
2023-08-11T07:56:11.575 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://centos.org/"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-11T07:56:11.576 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-11T07:56:11.577 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server
2023-08-11T07:56:11.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T07:56:11.701 INFO:teuthology.dispatcher.supervisor:Running job 7366497
2023-08-11T07:56:11.701 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-10_20:19:11-rados-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7366497 --name yuriw-2023-08-10_20:19:11-rados-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} -- /home/teuthworker/archive/yuriw-2023-08-10_20:19:11-rados-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7366497/orig.config.yaml
2023-08-11T07:56:11.706 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-10_20:19:11-rados-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7366497
2023-08-11T07:56:11.707 INFO:teuthology.dispatcher.supervisor:Job PID: 7904
2023-08-11T07:56:11.707 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-11T07:58:11.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:00:11.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:02:12.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:04:12.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:06:12.420 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:08:12.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:10:12.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:12:12.933 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:14:13.110 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:16:13.276 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:18:13.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:20:13.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:22:13.801 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:24:13.936 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:26:14.106 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:28:14.277 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:30:14.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:32:14.605 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:34:14.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:36:14.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:38:15.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:40:15.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-11T08:40:15.352 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-11T08:40:15.472 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-11T08:40:15.472 INFO:teuthology.nuke:Checking targets against current locks
2023-08-11T08:40:15.519 DEBUG:teuthology.nuke:shortname: smithi079
2023-08-11T08:40:15.520 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-11T08:40:15.544 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-10_20:19:11-rados-wip-yuri2-testing-2023-08-08-0755-pacific-distro-default-smithi/7366497', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-11 07:51:05.448226', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDIZ+2iur9+SWKDR1zlxbW3FwQ1AmJZopJVvGKVO4N20RI/FGg1G59rEjeUB1m7UCNelCBQSClD2Bst1xmfdDKU='}
2023-08-11T08:40:15.593 INFO:teuthology.orchestra.console.smithi079:Power off
2023-08-11T08:40:15.594 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-11T08:40:15.619 DEBUG:teuthology.orchestra.console.smithi079:power off output: Chassis Power Control: Down/Off
2023-08-11T08:40:15.620 DEBUG:teuthology.orchestra.console.smithi079:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-11T08:40:15.645 DEBUG:teuthology.orchestra.console.smithi079:check power output: Chassis Power is off
2023-08-11T08:40:15.746 INFO:teuthology.orchestra.console.smithi079:Power off completed
2023-08-11T08:40:15.900 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com