2023-07-05T11:35:42.327 INFO:root:teuthology version: 0.0.1.dev140+gb53f236
2023-07-05T11:35:42.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:35:42.329 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:35:42.443 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0cd08fd640>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0cd0257670>, signals=[15])
2023-07-05T11:35:42.445 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging
2023-07-05T11:35:42.446 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server
2023-07-05T11:35:42.446 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-07-05T11:35:42.470 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /host {"name": "smithi016"}
2023-07-05T11:35:42.539 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-07-05T11:35:42.590 DEBUG:teuthology.provision.fog.smithi016:Requesting image smithi_centos_8.stream (ID 3)
2023-07-05T11:35:42.590 DEBUG:teuthology.provision.fog.smithi016:FOG request: PUT /host/122 {"imageID": 3}
2023-07-05T11:35:42.643 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of centos 8.stream
2023-07-05T11:35:42.643 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:35:42.693 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /tasktype {"name": "deploy"}
2023-07-05T11:35:42.734 DEBUG:teuthology.provision.fog.smithi016:FOG request: POST /host/122/task {"taskTypeID": 1}
2023-07-05T11:35:42.817 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:35:42.900 INFO:teuthology.orchestra.console:Power off smithi016
2023-07-05T11:35:42.901 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T11:35:42.924 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T11:35:43.046 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2023-07-05T11:35:43.147 INFO:teuthology.orchestra.console:Power on smithi016
2023-07-05T11:35:43.148 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-05T11:35:43.169 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T11:35:47.194 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T11:35:51.309 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T11:35:51.521 INFO:teuthology.orchestra.console:Power on for smithi016 completed
2023-07-05T11:35:51.622 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish
2023-07-05T11:35:51.622 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:36:06.706 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:36:21.792 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:36:36.875 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:36:51.957 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:37:07.040 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:37:22.127 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:37:37.206 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:37:52.294 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:38:07.385 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:38:22.469 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:38:37.645 DEBUG:teuthology.provision.fog.smithi016:FOG request: GET /task/active None
2023-07-05T11:38:37.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:38:56.240 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-07-05T11:39:02.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:39:05.296 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-07-05T11:39:11.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:39:14.352 WARNING:teuthology.provision.fog.smithi016:[Errno None] Unable to connect to port 22 on 172.21.15.16
2023-07-05T11:39:20.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:40:20.407 WARNING:teuthology.provision.fog.smithi016:timed out
2023-07-05T11:40:26.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:40:26.648 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-05T11:40:26.650 DEBUG:teuthology.orchestra.run.smithi016:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-05T11:40:26.934 INFO:teuthology.provision.fog.smithi016:Node is ready
2023-07-05T11:40:26.934 DEBUG:teuthology.orchestra.run.smithi016:> hostname
2023-07-05T11:40:26.954 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com
2023-07-05T11:40:26.955 DEBUG:teuthology.orchestra.run.smithi016:> grep smithi016.front.sepia.ceph.com /etc/hosts
2023-07-05T11:40:27.014 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016
2023-07-05T11:40:27.014 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2023-07-05T11:40:27.140 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hosts
2023-07-05T11:40:27.170 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/172.21.15.16/172.21.15.16/g' /etc/hosts
2023-07-05T11:40:27.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i -e 's/smithi016.front.sepia.ceph.com/smithi016/g' /etc/hostname
2023-07-05T11:40:27.308 DEBUG:teuthology.orchestra.run.smithi016:> sudo hostname smithi016
2023-07-05T11:40:27.377 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8"
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8"
2023-07-05T11:40:27.436 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T11:40:27.437 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-05T11:40:27.438 INFO:teuthology.provision.fog.smithi016:Deploy complete!
2023-07-05T11:40:27.440 DEBUG:teuthology.parallel:result is None
2023-07-05T11:40:37.617 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com
2023-07-05T11:40:37.617 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-05T11:40:42.646 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server
2023-07-05T11:40:42.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-05T11:40:42.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-05T11:40:42.716 DEBUG:teuthology.orchestra.run.smithi016:> true
2023-07-05T11:40:42.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com'
2023-07-05T11:40:42.851 DEBUG:teuthology.orchestra.run.smithi016:> uname -m
2023-07-05T11:40:42.910 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64
2023-07-05T11:40:42.910 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release
2023-07-05T11:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="CentOS Stream"
2023-07-05T11:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8"
2023-07-05T11:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:ID="centos"
2023-07-05T11:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="rhel fedora"
2023-07-05T11:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="CentOS Stream 8"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://centos.org/"
2023-07-05T11:40:42.970 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-05T11:40:42.971 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-07-05T11:40:42.971 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-05T11:40:42.971 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server
2023-07-05T11:40:42.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:40:42.995 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:40:53.095 INFO:teuthology.dispatcher.supervisor:Running job 7326927
2023-07-05T11:40:53.096 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-07-05_11:34:30-crimson-rados-wip-matanb-crimson-only-61651-distro-crimson-smithi/7326927 --name matan-2023-07-05_11:34:30-crimson-rados-wip-matanb-crimson-only-61651-distro-crimson-smithi --description crimson-rados/rbd/{centos_latest clusters/fixed-1 crimson_qa_overrides deploy/ceph tasks/rbd_api_tests} -- /home/teuthworker/archive/matan-2023-07-05_11:34:30-crimson-rados-wip-matanb-crimson-only-61651-distro-crimson-smithi/7326927/orig.config.yaml
2023-07-05T11:40:53.099 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-07-05_11:34:30-crimson-rados-wip-matanb-crimson-only-61651-distro-crimson-smithi/7326927
2023-07-05T11:40:53.100 INFO:teuthology.dispatcher.supervisor:Job PID: 18741
2023-07-05T11:40:53.100 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-05T11:42:53.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:42:53.192 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:44:58.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:44:58.375 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:47:03.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:47:03.550 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:49:05.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:49:05.637 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:51:05.810 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:51:05.811 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:53:05.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:53:05.982 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:55:06.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:55:06.154 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:57:06.307 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:57:06.308 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T11:59:06.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T11:59:06.453 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:01:06.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T12:01:06.621 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:03:06.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T12:03:06.798 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:05:06.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T12:05:06.972 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:07:07.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T12:07:07.157 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:09:07.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-05T12:09:07.334 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-05T12:09:07.427 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-07-05T12:09:07.530 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-07-05T12:09:07.531 INFO:teuthology.nuke:Checking targets against current locks
2023-07-05T12:09:07.594 DEBUG:teuthology.nuke:shortname: smithi016
2023-07-05T12:09:07.595 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-07-05T12:09:07.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-07-05_11:34:30-crimson-rados-wip-matanb-crimson-only-61651-distro-crimson-smithi/7326927', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-05 11:35:41.612332', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjEua+uRYRghdRHAfSpK4VEz0hnw9XzfXM7Y75iTkL8TOzRfpOw0XRPD/zJC4j85S8m6dWjSmLEx9kuV89tQPL/HRKSWAh5q4dt4sZSkbiYfEnlS5zW8PCGg2Ygy/6DRnelHOcPvY18P2Pgv2c0WvEocZJzBgatTvo4+adAAhJNOIZRwU7BmDHDHwkF7OMsM5u+2+cjy30HmW7qwVSM+t22zBwPSzvrKz0R4xgex9hsn3V/F+eOlC6rrB+EZB2qim3FfUKfaMJIc5wlssUL78N1pe8cw9M7kyNTDfrxJlWfNairuQ8Tvi3hTRHRDozHluLnUMA+9SH/AMAhjnfT1raU6x/b8/QKS/ka/8xNsQkKwijW0KIz3yGho5opDt5KO5Dd8asmt19eh9SCvX3wNk2bLTr7ph0jft374w+GDF/17PJBK1vblwFx1qrg42wkoEnwLqODkH/Wlk34jMF+ngNqYPbpOVjnrp/RcBx4gW5EqmHUvC2sHLu2PMoVp9eNw8='}
2023-07-05T12:09:07.691 INFO:teuthology.orchestra.console:Power off smithi016
2023-07-05T12:09:07.692 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-05T12:09:07.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-05T12:09:07.876 INFO:teuthology.orchestra.console:Power off for smithi016 completed
2023-07-05T12:09:08.038 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com