2023-03-12T18:41:19.672 INFO:root:teuthology version: 0.0.1.dev57+g5c9057f 2023-03-12T18:41:19.903 INFO:teuthology.lock.ops:Start node 'smithi002.front.sepia.ceph.com' reimaging 2023-03-12T18:41:19.904 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: reset os type and version on server 2023-03-12T18:41:19.904 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-03-12T18:41:19.931 INFO:teuthology.lock.ops:Node 'smithi002.front.sepia.ceph.com' reimaging is complete 2023-03-12T18:41:19.931 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2023-03-12T18:41:19.931 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2023-03-12T18:41:19.932 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-03-12T18:41:19.955 INFO:teuthology.lock.ops:Node 'smithi122.front.sepia.ceph.com' reimaging is complete 2023-03-12T18:41:19.955 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging 2023-03-12T18:41:19.956 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server 2023-03-12T18:41:19.956 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-03-12T18:41:19.981 INFO:teuthology.lock.ops:Node 'smithi172.front.sepia.ceph.com' reimaging is complete 2023-03-12T18:41:19.981 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging 2023-03-12T18:41:19.981 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server 2023-03-12T18:41:19.981 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-03-12T18:41:20.005 INFO:teuthology.lock.ops:Node 'smithi178.front.sepia.ceph.com' reimaging is complete 2023-03-12T18:41:20.104 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of centos 8.stream 2023-03-12T18:41:20.126 INFO:teuthology.provision.fog.smithi002:Scheduling deploy of centos 8.stream 2023-03-12T18:41:20.164 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of centos 8.stream 2023-03-12T18:41:20.167 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 8.stream 2023-03-12T18:41:20.352 INFO:teuthology.orchestra.console:Power off smithi122 2023-03-12T18:41:20.373 INFO:teuthology.orchestra.console:Power off smithi178 2023-03-12T18:41:20.391 INFO:teuthology.orchestra.console:Power off smithi002 2023-03-12T18:41:20.439 INFO:teuthology.orchestra.console:Power off smithi172 2023-03-12T18:41:20.551 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-03-12T18:41:20.552 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-03-12T18:41:20.552 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2023-03-12T18:41:20.652 INFO:teuthology.orchestra.console:Power on smithi178 2023-03-12T18:41:20.663 INFO:teuthology.orchestra.console:Power on smithi002 2023-03-12T18:41:20.672 INFO:teuthology.orchestra.console:Power on smithi122 2023-03-12T18:41:24.947 INFO:teuthology.orchestra.console:Power on for smithi122 completed 2023-03-12T18:41:25.048 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2023-03-12T18:41:28.816 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-03-12T18:41:28.918 INFO:teuthology.orchestra.console:Power on smithi172 2023-03-12T18:41:29.061 INFO:teuthology.orchestra.console:Power on for smithi002 completed 2023-03-12T18:41:29.101 INFO:teuthology.orchestra.console:Power on for smithi178 completed 2023-03-12T18:41:29.163 INFO:teuthology.provision.fog.smithi002:Waiting for deploy to finish 2023-03-12T18:41:29.202 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish 2023-03-12T18:41:37.324 INFO:teuthology.orchestra.console:Power on for smithi172 completed 2023-03-12T18:41:37.425 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish 2023-03-12T18:44:13.834 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:44:18.309 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-12T18:44:22.917 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:44:27.369 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-12T18:44:31.974 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:44:33.001 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:44:36.421 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-12T18:44:41.030 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:44:42.085 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:44:45.481 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-03-12T18:44:50.089 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:44:51.148 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:44:56.717 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:44:59.173 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:45:00.233 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:45:05.797 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:45:09.285 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:45:14.857 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:45:18.345 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:45:23.590 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:45:23.941 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:45:27.397 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-03-12T18:45:32.645 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-03-12T18:45:32.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:45:38.933 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-12T18:45:42.057 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.172 2023-03-12T18:45:51.485 WARNING:teuthology.provision.fog:timed out 2023-03-12T18:45:57.856 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-12T18:45:58.131 INFO:teuthology.provision.fog.smithi002:Node is ready 2023-03-12T18:45:58.152 INFO:teuthology.orchestra.run.smithi002.stdout:smithi002.front.sepia.ceph.com 2023-03-12T18:45:58.214 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.15.2 smithi002.front.sepia.ceph.com smithi002 2023-03-12T18:45:58.581 INFO:teuthology.provision.fog.smithi002:Deploy complete! 2023-03-12T18:46:05.090 INFO:teuthology.provision.fog.smithi122:Node is ready 2023-03-12T18:46:05.114 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2023-03-12T18:46:05.176 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2023-03-12T18:46:05.557 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2023-03-12T18:46:19.994 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-12T18:46:33.401 WARNING:teuthology.provision.fog:timed out 2023-03-12T18:46:39.666 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-12T18:46:39.926 INFO:teuthology.provision.fog.smithi178:Node is ready 2023-03-12T18:46:39.944 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com 2023-03-12T18:46:40.002 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178 2023-03-12T18:46:40.360 INFO:teuthology.provision.fog.smithi178:Deploy complete! 2023-03-12T18:46:40.639 INFO:teuthology.provision.fog.smithi172:Node is ready 2023-03-12T18:46:40.662 INFO:teuthology.orchestra.run.smithi172.stdout:smithi001 2023-03-12T18:46:40.721 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.1 smithi001 smithi001 2023-03-12T18:46:41.134 INFO:teuthology.provision.fog.smithi172:Deploy complete! 2023-03-12T18:46:41.376 INFO:teuthology.lock.ops:Checking smithi002.front.sepia.ceph.com 2023-03-12T18:46:41.377 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-12T18:46:41.407 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2023-03-12T18:46:41.407 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-12T18:46:41.432 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com 2023-03-12T18:46:41.432 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-12T18:46:41.457 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com 2023-03-12T18:46:41.457 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-12T18:46:41.484 INFO:teuthology.lock.ops:Updating [smithi002.front.sepia.ceph.com]: set os type and version on server 2023-03-12T18:46:41.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-03-12T18:46:41.751 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-03-12T18:46:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-03-12T18:46:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="8" 2023-03-12T18:46:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="8" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el8" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-12T18:46:41.812 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-03-12T18:46:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-12T18:46:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-12T18:46:41.813 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-12T18:46:41.814 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-03-12T18:46:41.841 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2023-03-12T18:46:41.841 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-03-12T18:46:42.048 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-03-12T18:46:42.107 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="CentOS Stream" 2023-03-12T18:46:42.107 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="8" 2023-03-12T18:46:42.107 INFO:teuthology.orchestra.run.smithi122.stdout:ID="centos" 2023-03-12T18:46:42.107 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE="rhel fedora" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="8" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:PLATFORM_ID="platform:el8" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:ANSI_COLOR="0;31" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-12T18:46:42.108 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://centos.org/" 2023-03-12T18:46:42.109 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-12T18:46:42.109 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-12T18:46:42.109 INFO:teuthology.orchestra.run.smithi122.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-12T18:46:42.109 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-03-12T18:46:42.132 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server 2023-03-12T18:46:42.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-12T18:46:42.334 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64 2023-03-12T18:46:42.391 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream" 2023-03-12T18:46:42.391 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8" 2023-03-12T18:46:42.391 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/" 2023-03-12T18:46:42.392 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-12T18:46:42.393 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-12T18:46:42.393 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-12T18:46:42.393 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server 2023-03-12T18:46:42.415 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server 2023-03-12T18:46:42.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-03-12T18:46:42.611 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-03-12T18:46:42.669 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="CentOS Stream" 2023-03-12T18:46:42.669 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8" 2023-03-12T18:46:42.669 INFO:teuthology.orchestra.run.smithi178.stdout:ID="centos" 2023-03-12T18:46:42.670 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="rhel fedora" 2023-03-12T18:46:42.670 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8" 2023-03-12T18:46:42.670 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8" 2023-03-12T18:46:42.670 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="CentOS Stream 8" 2023-03-12T18:46:42.670 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31" 2023-03-12T18:46:42.671 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-03-12T18:46:42.671 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://centos.org/" 2023-03-12T18:46:42.671 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-12T18:46:42.672 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-12T18:46:42.672 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-03-12T18:46:42.672 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-03-12T18:46:42.789 INFO:teuthology.dispatcher.supervisor:Running job 7204276 2023-03-12T18:46:42.790 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-03-12_18:26:24-rados-WIP_GBH_snap_mapper_2-distro-default-smithi/7204276 --name benhanokh-2023-03-12_18:26:24-rados-WIP_GBH_snap_mapper_2-distro-default-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/benhanokh-2023-03-12_18:26:24-rados-WIP_GBH_snap_mapper_2-distro-default-smithi/7204276/orig.config.yaml 2023-03-12T18:46:42.794 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-03-12_18:26:24-rados-WIP_GBH_snap_mapper_2-distro-default-smithi/7204276 2023-03-12T18:46:42.795 INFO:teuthology.dispatcher.supervisor:Job PID: 19284 2023-03-12T18:46:42.795 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-13T06:47:39.673 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-13T06:47:39.852 INFO:teuthology.kill:Killing Pids: {19284} 2023-03-13T06:47:39.859 ERROR:teuthology.dispatcher.supervisor:Failed to kill job Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog kill_job(job_info['name'], job_info['job_id'], File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/teuthology/kill.py", line 90, in kill_job teuthology.exporter.JobResults().record(job_info["machine_type"], job_info["status"]) KeyError: 'status' 2023-03-13T06:47:39.892 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2023-03-13T06:47:39.892 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2023-03-13T06:47:39.893 INFO:teuthology.task.internal:roles: ubuntu@smithi172.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2023-03-13T06:47:39.893 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2023-03-13T06:47:39.893 INFO:teuthology.misc:Compressing logs... 2023-03-13T06:47:39.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-03-13T06:47:40.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-03-13T06:47:40.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com' 2023-03-13T06:47:40.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-03-13T06:47:41.049 INFO:teuthology.misc:Compressing logs... 2023-03-13T06:47:41.636 INFO:teuthology.orchestra.run.smithi172.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-13T06:47:41.642 INFO:teuthology.orchestra.run.smithi122.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-13T06:47:41.644 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-13T06:47:41.697 INFO:teuthology.orchestra.run.smithi002.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-13T06:49:19.834 INFO:teuthology.misc:Compressing logs... 2023-03-13T06:49:22.319 INFO:teuthology.kill:No teuthology processes running 2023-03-13T06:49:22.319 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog kill_job(job_info['name'], job_info['job_id'], File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/teuthology/kill.py", line 90, in kill_job teuthology.exporter.JobResults().record(job_info["machine_type"], job_info["status"]) File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/teuthology/exporter.py", line 175, in __init__ self.metric = Counter( File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__ registry.register(self) File "/home/teuthworker/src/git.ceph.com_teuthology_5c9057f4b1ecae7b7410e418e40b739ff0616d25/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register raise ValueError( ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'} 2023-03-13T06:51:22.568 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-13T06:51:22.732 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-03-13T06:51:22.732 INFO:teuthology.nuke:Checking targets against current locks 2023-03-13T06:51:22.788 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-13T06:51:22.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-13T06:51:22.838 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-13T06:51:22.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-13T06:51:22.869 INFO:teuthology.orchestra.console:Power off smithi002 2023-03-13T06:51:22.918 INFO:teuthology.orchestra.console:Power off smithi122 2023-03-13T06:51:22.970 INFO:teuthology.orchestra.console:Power off smithi172 2023-03-13T06:51:22.992 INFO:teuthology.orchestra.console:Power off smithi178 2023-03-13T06:51:31.269 INFO:teuthology.orchestra.console:Power off for smithi002 completed 2023-03-13T06:51:31.365 INFO:teuthology.orchestra.console:Power off for smithi178 completed 2023-03-13T06:51:31.432 INFO:teuthology.lock.ops:unlocked: smithi002.front.sepia.ceph.com 2023-03-13T06:51:31.525 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com 2023-03-13T06:51:35.447 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2023-03-13T06:51:35.466 INFO:teuthology.orchestra.console:Power off for smithi172 completed 2023-03-13T06:51:35.609 INFO:teuthology.lock.ops:unlocked: smithi122.front.sepia.ceph.com 2023-03-13T06:51:35.614 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com