2023-11-01T19:12:16.988 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-01T19:12:16.990 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:12:17.099 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8849191bb0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8849c94670>, signals=[15])
2023-11-01T19:12:17.101 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-11-01T19:12:17.101 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-11-01T19:12:17.101 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-01T19:12:17.127 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-11-01T19:12:17.196 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-01T19:12:17.233 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10)
2023-11-01T19:12:17.233 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 10}
2023-11-01T19:12:17.282 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream
2023-11-01T19:12:17.283 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:12:17.348 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-11-01T19:12:17.387 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-11-01T19:12:17.445 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:12:17.543 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-01T19:12:17.543 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T19:12:17.565 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-01T19:12:17.566 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:17.590 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-01T19:12:21.594 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:21.702 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-01T19:12:25.704 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:25.812 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-01T19:12:29.817 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:29.926 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-01T19:12:30.027 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-01T19:12:30.128 INFO:teuthology.orchestra.console.smithi159:Power on
2023-11-01T19:12:30.128 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-01T19:12:30.151 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-11-01T19:12:30.151 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:30.172 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-01T19:12:34.177 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T19:12:34.285 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-01T19:12:34.386 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-11-01T19:12:34.487 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-11-01T19:12:34.487 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:12:49.570 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:13:04.637 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:13:19.726 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:13:34.815 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:13:49.892 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:14:04.971 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:14:20.063 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:14:35.146 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:14:50.234 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:15:05.310 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:15:20.382 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-01T19:15:20.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:15:20.681 ERROR:teuthology.orchestra.connection:Error authenticating with smithi159.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-01T19:15:59.226 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-01T19:16:05.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:16:08.282 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-01T19:16:14.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:16:17.338 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-01T19:16:23.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:16:26.394 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-01T19:16:32.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:17:32.398 WARNING:teuthology.provision.fog.smithi159:timed out
2023-11-01T19:17:38.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:17:38.660 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-01T19:17:38.661 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-01T19:17:39.018 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-11-01T19:17:39.018 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-11-01T19:17:39.033 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-11-01T19:17:39.033 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-11-01T19:17:39.088 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-11-01T19:17:39.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-01T19:17:39.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-11-01T19:17:39.225 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-11-01T19:17:39.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-11-01T19:17:39.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-01T19:17:39.427 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-01T19:17:39.481 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-11-01T19:17:39.481 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9"
2023-11-01T19:17:39.482 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-11-01T19:17:39.482 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-11-01T19:17:39.482 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9"
2023-11-01T19:17:39.482 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9"
2023-11-01T19:17:39.482 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T19:17:39.483 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-01T19:17:39.483 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon"
2023-11-01T19:17:39.483 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T19:17:39.483 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-11-01T19:17:39.483 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T19:17:39.484 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T19:17:39.484 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T19:17:39.485 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-11-01T19:17:39.486 DEBUG:teuthology.parallel:result is None
2023-11-01T19:17:39.604 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-11-01T19:17:39.604 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-01T19:17:39.629 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-11-01T19:17:39.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-01T19:17:39.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-01T19:17:39.713 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-11-01T19:17:39.780 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-01T19:17:39.781 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-11-01T19:17:39.834 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-11-01T19:17:39.834 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-01T19:17:39.888 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-11-01T19:17:39.888 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9"
2023-11-01T19:17:39.888 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-01T19:17:39.889 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon"
2023-11-01T19:17:39.890 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-01T19:17:39.890 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-11-01T19:17:39.890 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-01T19:17:39.890 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-01T19:17:39.890 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-01T19:17:39.891 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-01T19:17:39.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:17:40.004 INFO:teuthology.dispatcher.supervisor:Running job 7442764
2023-11-01T19:17:40.005 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2023-11-01_12:57:02-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-distro-crimson-smithi/7442764 --name matan-2023-11-01_12:57:02-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-distro-crimson-smithi --description crimson-rados/rbd/{clusters/fixed-1 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rbd_lock_and_fence} -- /home/teuthworker/archive/matan-2023-11-01_12:57:02-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-distro-crimson-smithi/7442764/orig.config.yaml
2023-11-01T19:17:40.008 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2023-11-01_12:57:02-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-distro-crimson-smithi/7442764
2023-11-01T19:17:40.008 INFO:teuthology.dispatcher.supervisor:Job PID: 1365530
2023-11-01T19:17:40.009 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-01T19:19:40.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:21:40.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:23:40.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:25:40.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:27:40.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:29:40.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:31:40.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:33:40.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:35:40.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:37:40.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:39:40.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:41:40.785 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:43:40.849 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:45:40.913 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:47:40.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:49:41.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:51:41.124 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:53:41.188 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:55:41.254 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:57:41.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T19:59:41.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:01:41.472 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:03:41.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:05:41.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:07:41.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:09:41.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:11:41.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:13:41.881 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:15:41.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:17:42.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:19:42.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:21:42.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:23:42.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:25:42.282 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:27:42.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:29:42.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:31:42.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:33:42.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:35:42.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:37:42.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:39:42.766 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:41:42.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:43:42.919 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:45:42.988 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:47:43.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:49:43.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:51:43.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:53:43.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:55:43.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:57:43.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T20:59:43.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:01:43.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:03:43.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:05:43.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:07:43.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:09:43.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:11:43.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:13:43.897 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:15:43.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:17:44.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:19:44.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:21:44.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:23:44.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:25:44.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:27:44.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:29:44.432 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:31:44.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:33:44.560 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:35:44.626 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:37:44.693 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:39:44.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:41:44.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:43:44.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:45:44.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:47:45.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:49:45.085 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:51:45.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:53:45.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:55:45.290 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:57:45.356 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T21:59:45.410 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:01:45.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:03:45.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:05:45.632 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:07:45.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:09:45.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:11:45.833 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:13:45.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:15:45.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:17:46.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:19:46.090 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:21:46.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:23:46.224 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:25:46.286 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:27:46.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:29:46.424 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:31:46.490 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:33:46.557 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:35:46.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-01T22:35:46.696 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-01T22:35:46.755 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-01T22:35:46.756 INFO:teuthology.nuke:Checking targets against current locks
2023-11-01T22:35:46.799 DEBUG:teuthology.nuke:shortname: smithi159
2023-11-01T22:35:46.799 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-01T22:35:46.822 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/matan-2023-11-01_12:57:02-crimson-rados-wip-matanb-crimson-do_osd_ops_execute-v3-distro-crimson-smithi/7442764', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-01 19:12:16.228786', 'locked_by': 'scheduled_matan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBI71qhp/tAIPWLcparhNkTwsZOzZQhUruzK5W6mWD+SGRpbE8Xujv9YVb6c0KuVWqHCCoDlYfQiw7shrV0hOthM='}
2023-11-01T22:35:46.872 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-01T22:35:46.873 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-01T22:35:46.895 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-01T22:35:46.895 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-01T22:35:46.913 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-01T22:35:47.015 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-01T22:35:47.170 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com