2023-08-10T15:36:06.154 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-10T15:36:06.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:36:06.272 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3f1b815850>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3f1ccd5280>, signals=[15])
2023-08-10T15:36:06.273 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging
2023-08-10T15:36:06.274 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server
2023-08-10T15:36:06.275 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-08-10T15:36:06.298 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /host {"name": "smithi115"}
2023-08-10T15:36:06.449 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-10T15:36:06.487 DEBUG:teuthology.provision.fog.smithi115:Requesting image smithi_centos_8.stream (ID 3)
2023-08-10T15:36:06.488 DEBUG:teuthology.provision.fog.smithi115:FOG request: PUT /host/220 {"imageID": 3}
2023-08-10T15:36:06.534 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream
2023-08-10T15:36:06.535 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:36:06.588 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /tasktype {"name": "deploy"}
2023-08-10T15:36:06.627 DEBUG:teuthology.provision.fog.smithi115:FOG request: POST /host/220/task {"taskTypeID": 1}
2023-08-10T15:36:06.687 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:36:06.768 INFO:teuthology.orchestra.console.smithi115:Power off
2023-08-10T15:36:06.769 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T15:36:06.791 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-08-10T15:36:06.792 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:06.812 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-10T15:36:10.816 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:10.925 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-10T15:36:14.928 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:15.040 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-10T15:36:19.044 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:19.157 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-10T15:36:19.258 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-08-10T15:36:19.358 INFO:teuthology.orchestra.console.smithi115:Power on
2023-08-10T15:36:19.359 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-10T15:36:19.379 DEBUG:teuthology.orchestra.console.smithi115:power on output: Chassis Power Control: Up/On
2023-08-10T15:36:19.380 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:19.401 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-10T15:36:23.404 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:23.513 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-10T15:36:27.516 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T15:36:27.626 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is on
2023-08-10T15:36:27.727 INFO:teuthology.orchestra.console.smithi115:Power on completed
2023-08-10T15:36:27.828 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish
2023-08-10T15:36:27.829 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:36:42.903 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:36:57.971 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:37:13.044 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:37:28.112 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:37:43.176 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:37:58.240 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:38:13.316 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:38:28.388 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:38:43.460 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:38:58.532 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:39:13.615 DEBUG:teuthology.provision.fog.smithi115:FOG request: GET /task/active None
2023-08-10T15:39:13.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:39:16.752 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:39:22.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:39:25.808 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:39:31.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:39:34.864 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:39:40.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:39:43.924 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:39:49.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:39:53.008 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:39:59.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:40:02.068 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:40:08.073 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:40:11.156 WARNING:teuthology.provision.fog.smithi115:[Errno None] Unable to connect to port 22 on 172.21.15.115
2023-08-10T15:40:17.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:41:17.221 WARNING:teuthology.provision.fog.smithi115:timed out
2023-08-10T15:41:23.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:41:23.477 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-10T15:41:23.478 DEBUG:teuthology.orchestra.run.smithi115:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-10T15:41:23.746 INFO:teuthology.provision.fog.smithi115:Node is ready
2023-08-10T15:41:23.746 DEBUG:teuthology.orchestra.run.smithi115:> hostname
2023-08-10T15:41:23.766 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com
2023-08-10T15:41:23.766 DEBUG:teuthology.orchestra.run.smithi115:> grep smithi115.front.sepia.ceph.com /etc/hosts
2023-08-10T15:41:23.826 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115
2023-08-10T15:41:23.826 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-08-10T15:41:23.938 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hosts
2023-08-10T15:41:23.969 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/172.21.15.115/172.21.15.115/g' /etc/hosts
2023-08-10T15:41:24.038 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i -e 's/smithi115.front.sepia.ceph.com/smithi115/g' /etc/hostname
2023-08-10T15:41:24.108 DEBUG:teuthology.orchestra.run.smithi115:> sudo hostname smithi115
2023-08-10T15:41:24.176 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-08-10T15:41:24.233 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2023-08-10T15:41:24.234 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8"
2023-08-10T15:41:24.234 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2023-08-10T15:41:24.234 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2023-08-10T15:41:24.234 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2023-08-10T15:41:24.234 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T15:41:24.235 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T15:41:24.236 INFO:teuthology.provision.fog.smithi115:Deploy complete!
2023-08-10T15:41:24.237 DEBUG:teuthology.parallel:result is None
2023-08-10T15:41:24.340 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com
2023-08-10T15:41:24.341 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-10T15:41:24.377 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server
2023-08-10T15:41:24.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-08-10T15:41:24.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T15:41:24.445 DEBUG:teuthology.orchestra.run.smithi115:> true
2023-08-10T15:41:24.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com'
2023-08-10T15:41:24.512 DEBUG:teuthology.orchestra.run.smithi115:> uname -m
2023-08-10T15:41:24.568 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64
2023-08-10T15:41:24.569 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release
2023-08-10T15:41:24.627 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream"
2023-08-10T15:41:24.627 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8"
2023-08-10T15:41:24.627 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos"
2023-08-10T15:41:24.627 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/"
2023-08-10T15:41:24.628 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T15:41:24.629 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T15:41:24.629 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T15:41:24.629 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server
2023-08-10T15:41:24.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:41:24.735 INFO:teuthology.dispatcher.supervisor:Running job 7364816
2023-08-10T15:41:24.735 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_adking@teuthology --archive /home/teuthworker/archive/adking-2023-08-10_11:40:35-orch:cephadm-wip-adk-testing-2023-08-09-2121-distro-default-smithi/7364816 --name adking-2023-08-10_11:40:35-orch:cephadm-wip-adk-testing-2023-08-09-2121-distro-default-smithi --description orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} -- /home/teuthworker/archive/adking-2023-08-10_11:40:35-orch:cephadm-wip-adk-testing-2023-08-09-2121-distro-default-smithi/7364816/orig.config.yaml
2023-08-10T15:41:24.743 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/adking-2023-08-10_11:40:35-orch:cephadm-wip-adk-testing-2023-08-09-2121-distro-default-smithi/7364816
2023-08-10T15:41:24.745 INFO:teuthology.dispatcher.supervisor:Job PID: 26977
2023-08-10T15:41:24.745 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-10T15:43:24.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:45:24.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:47:25.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:49:25.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:51:25.447 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:53:25.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:55:25.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:57:25.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T15:59:26.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T16:01:26.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T16:01:26.360 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-10T16:01:26.418 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-10T16:01:26.418 INFO:teuthology.nuke:Checking targets against current locks
2023-08-10T16:01:26.461 DEBUG:teuthology.nuke:shortname: smithi115
2023-08-10T16:01:26.461 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-10T16:01:26.484 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/adking-2023-08-10_11:40:35-orch:cephadm-wip-adk-testing-2023-08-09-2121-distro-default-smithi/7364816', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 15:36:05.396691', 'locked_by': 'scheduled_adking@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPaTbk2ZafV1F2Mpd6Yoi/9qC06X9Ev+L+9SqI64ZAVzVBlOMBROL2Gb5lr+ckuUdY0SvGj1FetY2MfpzNIwSKUvcarUibBAUUTyWteNki2wcgVXNacsuWrQnjLYmlEDAXLRq8n0JO6cSMPwdr/fXibyXDSS8A6Boq/ljUBd7E+6ChacABiFjMwiCJQN6tZghPA7qL2sW4ipgZDH2xjrWXeR0Zpk/bYANWdXcZEkrJuSKg6hX9xvs65XQeH+T1jiAXLFIwCKLfgN7iGaHokrcPNPA+/ZOZMY3Go315uNIsDWFKKvG+0XA6u1DyOiqdIp44XjSN761pL1E14cpP61r+ZkVhLAWoM3Qh17kSsvra0IZs+3JKnql/ukdmf4+x48kw7z/tJVVJ6r1wfeBWm5t58nc5Gu5RzsJVn79OjmQ1JIFw/PxBWCP5ZXUp4hPcSiEG/SUDGe7Xf13Qr/2MVynOZ5L50HVH+R9bl3Wx+GxEDsSk0udVAFlAX3WDyxF7WKk='}
2023-08-10T16:01:26.532 INFO:teuthology.orchestra.console.smithi115:Power off
2023-08-10T16:01:26.533 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T16:01:26.553 DEBUG:teuthology.orchestra.console.smithi115:power off output: Chassis Power Control: Down/Off
2023-08-10T16:01:26.554 DEBUG:teuthology.orchestra.console.smithi115:pexpect command: ipmitool -H smithi115.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T16:01:26.575 DEBUG:teuthology.orchestra.console.smithi115:check power output: Chassis Power is off
2023-08-10T16:01:26.676 INFO:teuthology.orchestra.console.smithi115:Power off completed
2023-08-10T16:01:26.827 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com