2023-02-12T07:41:56.380 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-12T07:41:56.684 INFO:teuthology.lock.ops:Start node 'smithi037.front.sepia.ceph.com' reimaging 2023-02-12T07:41:56.684 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: reset os type and version on server 2023-02-12T07:41:56.684 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-02-12T07:41:56.758 INFO:teuthology.lock.ops:Node 'smithi037.front.sepia.ceph.com' reimaging is complete 2023-02-12T07:41:56.919 INFO:teuthology.provision.fog.smithi037:Scheduling deploy of rhel 8.4 2023-02-12T07:41:57.147 INFO:teuthology.orchestra.console:Power off smithi037 2023-02-12T07:42:05.930 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2023-02-12T07:42:06.031 INFO:teuthology.orchestra.console:Power on smithi037 2023-02-12T07:42:10.286 INFO:teuthology.orchestra.console:Power on for smithi037 completed 2023-02-12T07:42:10.387 INFO:teuthology.provision.fog.smithi037:Waiting for deploy to finish 2023-02-12T07:44:59.653 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-02-12T07:45:08.741 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-02-12T07:45:17.801 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-02-12T07:46:23.868 WARNING:teuthology.provision.fog:timed out 2023-02-12T07:46:30.211 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-12T07:46:30.499 INFO:teuthology.provision.fog.smithi037:Node is ready 2023-02-12T07:46:30.514 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037.front.sepia.ceph.com 2023-02-12T07:46:30.570 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37 smithi037.front.sepia.ceph.com smithi037 2023-02-12T07:46:30.919 INFO:teuthology.provision.fog.smithi037:Deploy complete! 2023-02-12T07:46:31.076 INFO:teuthology.lock.ops:Checking smithi037.front.sepia.ceph.com 2023-02-12T07:46:31.076 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-12T07:46:31.192 INFO:teuthology.lock.ops:Updating [smithi037.front.sepia.ceph.com]: set os type and version on server 2023-02-12T07:46:31.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-02-12T07:46:31.374 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-02-12T07:46:31.429 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-02-12T07:46:31.429 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.4 (Ootpa)" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.4" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-02-12T07:46:31.430 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-02-12T07:46:31.432 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-02-12T07:46:31.667 INFO:teuthology.dispatcher.supervisor:Running job 7161123 2023-02-12T07:46:31.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161123 --name yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi --description rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} -- /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161123/orig.config.yaml 2023-02-12T07:46:31.671 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161123 2023-02-12T07:46:31.671 INFO:teuthology.dispatcher.supervisor:Job PID: 3831 2023-02-12T07:46:31.671 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-12T10:20:44.354 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:45.420 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:47.018 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:49.152 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:51.823 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:55.034 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:20:58.783 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:21:03.068 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:21:07.897 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:21:13.262 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:21:13.262 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7161123' reached maximum tries (10) after waiting for 34.20542673667787 seconds 2023-02-12T10:21:13.264 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7161123' reached maximum tries (10) after waiting for 34.20542673667787 seconds