2023-08-30T06:34:24.072 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc
2023-08-30T06:34:24.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T06:34:24.177 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f724c21d9a0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f724cd001f0>, signals=[15])
2023-08-30T06:34:24.178 INFO:teuthology.lock.ops:Start node 'smithi110.front.sepia.ceph.com' reimaging
2023-08-30T06:34:24.179 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: reset os type and version on server
2023-08-30T06:34:24.181 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-08-30T06:34:24.206 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /host {"name": "smithi110"}
2023-08-30T06:34:24.288 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-08-30T06:34:24.328 DEBUG:teuthology.provision.fog.smithi110:Requesting image smithi_centos_9.stream (ID 10)
2023-08-30T06:34:24.328 DEBUG:teuthology.provision.fog.smithi110:FOG request: PUT /host/215 {"imageID": 10}
2023-08-30T06:34:24.377 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of centos 9.stream
2023-08-30T06:34:24.377 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:34:24.463 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /tasktype {"name": "deploy"}
2023-08-30T06:34:24.508 DEBUG:teuthology.provision.fog.smithi110:FOG request: POST /host/215/task {"taskTypeID": 1}
2023-08-30T06:34:24.580 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:34:24.700 INFO:teuthology.orchestra.console.smithi110:Power off
2023-08-30T06:34:24.701 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T06:34:24.723 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-08-30T06:34:24.723 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:24.747 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-08-30T06:34:28.750 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:28.858 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-08-30T06:34:32.862 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:32.971 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-08-30T06:34:33.072 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-08-30T06:34:33.173 INFO:teuthology.orchestra.console.smithi110:Power on
2023-08-30T06:34:33.173 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-30T06:34:33.195 DEBUG:teuthology.orchestra.console.smithi110:power on output: Chassis Power Control: Up/On
2023-08-30T06:34:33.195 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:33.216 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-08-30T06:34:37.220 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:37.329 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-08-30T06:34:41.334 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:34:41.444 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on
2023-08-30T06:34:41.545 INFO:teuthology.orchestra.console.smithi110:Power on completed
2023-08-30T06:34:41.646 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2023-08-30T06:34:41.646 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:34:56.730 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:35:11.806 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:35:26.894 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:35:41.975 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:35:57.052 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:36:12.142 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:36:27.226 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:36:42.328 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:36:57.435 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:37:12.543 DEBUG:teuthology.provision.fog.smithi110:FOG request: GET /task/active None
2023-08-30T06:37:12.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:37:15.674 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:37:21.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:37:24.769 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:37:30.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:37:33.850 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:37:39.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:37:42.906 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:37:48.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:37:51.966 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:37:57.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:38:01.053 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:38:07.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:38:10.138 WARNING:teuthology.provision.fog.smithi110:[Errno None] Unable to connect to port 22 on 172.21.15.110
2023-08-30T06:38:16.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:39:16.202 WARNING:teuthology.provision.fog.smithi110:timed out
2023-08-30T06:39:22.209 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:39:22.408 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-30T06:39:22.409 DEBUG:teuthology.orchestra.run.smithi110:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-30T06:39:22.691 INFO:teuthology.provision.fog.smithi110:Node is ready
2023-08-30T06:39:22.692 DEBUG:teuthology.orchestra.run.smithi110:> hostname
2023-08-30T06:39:22.706 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2023-08-30T06:39:22.707 DEBUG:teuthology.orchestra.run.smithi110:> grep smithi110.front.sepia.ceph.com /etc/hosts
2023-08-30T06:39:22.765 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2023-08-30T06:39:22.766 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-08-30T06:39:22.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hosts
2023-08-30T06:39:22.922 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/172.21.15.110/172.21.15.110/g' /etc/hosts
2023-08-30T06:39:22.993 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i -e 's/smithi110.front.sepia.ceph.com/smithi110/g' /etc/hostname
2023-08-30T06:39:23.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo hostname smithi110
2023-08-30T06:39:23.135 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-08-30T06:39:23.193 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-08-30T06:39:23.193 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-08-30T06:39:23.193 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-08-30T06:39:23.194 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-08-30T06:39:23.194 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-08-30T06:39:23.194 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-08-30T06:39:23.195 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-30T06:39:23.195 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-08-30T06:39:23.195 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-08-30T06:39:23.195 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-30T06:39:23.195 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-08-30T06:39:23.196 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T06:39:23.196 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-30T06:39:23.196 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-30T06:39:23.197 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2023-08-30T06:39:23.198 DEBUG:teuthology.parallel:result is None
2023-08-30T06:39:23.326 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2023-08-30T06:39:23.327 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-30T06:39:23.360 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2023-08-30T06:39:23.361 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-08-30T06:39:23.362 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-30T06:39:23.446 DEBUG:teuthology.orchestra.run.smithi110:> true
2023-08-30T06:39:23.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com'
2023-08-30T06:39:23.517 DEBUG:teuthology.orchestra.run.smithi110:> uname -m
2023-08-30T06:39:23.575 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2023-08-30T06:39:23.576 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release
2023-08-30T06:39:23.631 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream"
2023-08-30T06:39:23.632 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9"
2023-08-30T06:39:23.632 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos"
2023-08-30T06:39:23.632 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora"
2023-08-30T06:39:23.632 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9"
2023-08-30T06:39:23.633 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9"
2023-08-30T06:39:23.633 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9"
2023-08-30T06:39:23.633 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31"
2023-08-30T06:39:23.633 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon"
2023-08-30T06:39:23.634 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-08-30T06:39:23.634 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/"
2023-08-30T06:39:23.634 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-30T06:39:23.634 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-08-30T06:39:23.634 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-30T06:39:23.635 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2023-08-30T06:39:23.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T06:39:23.738 INFO:teuthology.dispatcher.supervisor:Running job 7383199
2023-08-30T06:39:23.738 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-29_20:59:15-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7383199 --name yuriw-2023-08-29_20:59:15-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi --description rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/archive/yuriw-2023-08-29_20:59:15-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7383199/orig.config.yaml
2023-08-30T06:39:23.741 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-29_20:59:15-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7383199
2023-08-30T06:39:23.742 INFO:teuthology.dispatcher.supervisor:Job PID: 1912617
2023-08-30T06:39:23.742 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-30T06:41:23.842 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-30T06:41:23.907 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-30T06:41:23.970 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-30T06:41:23.971 INFO:teuthology.nuke:Checking targets against current locks
2023-08-30T06:41:24.016 DEBUG:teuthology.nuke:shortname: smithi110
2023-08-30T06:41:24.016 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-30T06:41:24.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-29_20:59:15-rados-wip-yuri6-testing-2023-08-28-1308-distro-default-smithi/7383199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 06:34:23.318875', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNHIl8b1MJxW9/voMpgNsoQzyD0LGkM1QI2G/kOKSG5nICOooGzxmjl1h8ec0AHxrBeDi36Eq8Do5Hg6T45CMqc='}
2023-08-30T06:41:24.087 INFO:teuthology.orchestra.console.smithi110:Power off
2023-08-30T06:41:24.087 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-30T06:41:24.115 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off
2023-08-30T06:41:24.115 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-30T06:41:24.136 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off
2023-08-30T06:41:24.238 INFO:teuthology.orchestra.console.smithi110:Power off completed
2023-08-30T06:41:24.390 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com