2023-02-22T09:45:59.269 INFO:root:teuthology version: 0.0.1.dev41+gfbbadb5 2023-02-22T09:45:59.387 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2023-02-22T09:45:59.388 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2023-02-22T09:45:59.388 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-02-22T09:45:59.437 INFO:teuthology.lock.ops:Node 'smithi181.front.sepia.ceph.com' reimaging is complete 2023-02-22T09:45:59.588 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2023-02-22T09:45:59.867 INFO:teuthology.orchestra.console:Power off smithi181 2023-02-22T09:46:12.354 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2023-02-22T09:46:12.455 INFO:teuthology.orchestra.console:Power on smithi181 2023-02-22T09:46:16.711 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2023-02-22T09:46:16.811 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2023-02-22T09:49:21.029 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-02-22T09:49:30.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-02-22T09:49:39.145 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-02-22T09:49:48.229 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2023-02-22T09:50:54.288 WARNING:teuthology.provision.fog:timed out 2023-02-22T09:51:00.588 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-02-22T09:51:00.837 INFO:teuthology.provision.fog.smithi181:Node is ready 2023-02-22T09:51:00.895 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2023-02-22T09:51:00.953 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2023-02-22T09:51:01.304 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2023-02-22T09:51:01.427 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2023-02-22T09:51:01.427 INFO:teuthology.lock.ops:New key found. Updating... 2023-02-22T09:51:01.447 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2023-02-22T09:51:01.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2023-02-22T09:51:01.635 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2023-02-22T09:51:01.693 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-02-22T09:51:01.694 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-02-22T09:51:01.696 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2023-02-22T09:51:01.816 INFO:teuthology.dispatcher.supervisor:Running job 7181663 2023-02-22T09:51:01.817 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/7181663 --name yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi --description rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/7181663/orig.config.yaml 2023-02-22T09:51:01.820 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/7181663 2023-02-22T09:51:01.821 INFO:teuthology.dispatcher.supervisor:Job PID: 24042 2023-02-22T09:51:01.821 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-02-22T10:11:03.402 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:04.500 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:06.128 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:08.110 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:10.906 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:13.999 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:17.412 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:21.257 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:25.554 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:30.305 ERROR:teuthology.report:POST to http://paddles.front.sepia.ceph.com/runs/yuriw-2023-02-20_23:16:20-rados-wip-yuri11-testing-2023-02-20-1329-distro-default-smithi/jobs/ failed with status 500: Internal Server Error

Internal Server Error

2023-02-22T10:11:30.305 ERROR:teuthology.dispatcher.supervisor:run_with_watchdog had an unhandled exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7181663' reached maximum tries (10) after waiting for 30.750674450714023 seconds 2023-02-22T10:11:30.306 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/virtualenv/bin/teuthology-dispatcher", line 8, in sys.exit(main()) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/scripts/dispatcher.py", line 35, in main sys.exit(teuthology.dispatcher.main(args)) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/__init__.py", line 63, in main return supervisor.main(args) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 57, in main return run_job( File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 140, in run_job run_with_watchdog(p, job_config) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog report.try_push_job_info(job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 508, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 473, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/report.py", line 298, in report_job while proceed(): File "/home/teuthworker/src/git.ceph.com_teuthology_fbbadb5ff5cfccce0d20e136f8956e65ec955359/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: 'report job 7181663' reached maximum tries (10) after waiting for 30.750674450714023 seconds