2023-02-12T09:38:08.521 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-12T09:38:08.689 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2023-02-12T09:38:08.690 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2023-02-12T09:38:08.690 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-02-12T09:38:08.708 INFO:teuthology.lock.ops:Node 'smithi187.front.sepia.ceph.com' reimaging is complete 2023-02-12T09:38:08.861 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2023-02-12T09:38:09.317 INFO:teuthology.orchestra.console:Power off smithi187 2023-02-12T09:38:19.258 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-02-12T09:38:19.359 INFO:teuthology.orchestra.console:Power on smithi187 2023-02-12T09:38:27.735 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2023-02-12T09:38:27.836 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2023-02-12T09:41:32.038 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-12T09:41:41.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-12T09:41:50.441 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-12T09:41:59.525 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-12T09:42:08.581 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-02-12T09:42:46.439 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-12T09:43:07.039 INFO:teuthology.provision.fog.smithi187:Node is ready 2023-02-12T09:43:07.058 INFO:teuthology.orchestra.run.smithi187.stdout:smithi001 2023-02-12T09:43:07.115 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.1 smithi001 smithi001 2023-02-12T09:43:07.475 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2023-02-12T09:43:07.790 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2023-02-12T09:43:07.790 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-12T09:43:07.840 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2023-02-12T09:43:07.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-02-12T09:43:08.038 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-02-12T09:43:08.095 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-12T09:43:08.096 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-02-12T09:43:08.097 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-02-12T09:43:08.183 INFO:teuthology.dispatcher.supervisor:Running job 7161192 2023-02-12T09:43:08.183 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161192 --name yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi --description rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161192/orig.config.yaml 2023-02-12T09:43:08.244 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/7161192 2023-02-12T09:43:08.245 INFO:teuthology.dispatcher.supervisor:Job PID: 3090 2023-02-12T09:43:08.245 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-12T10:19:11.179 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:12.264 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:13.680 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:15.456 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:17.590 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:20.083 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:22.938 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:26.154 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:29.729 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:33.670 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-08_19:47:33-rados-wip-yuri-testing-2023-02-06-1155-quincy-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-12T10:19:33.670 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7161192' reached maximum tries (10) after waiting for 26.184719025777103 seconds 2023-02-12T10:19:33.672 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7161192' reached maximum tries (10) after waiting for 26.184719025777103 seconds