2023-03-18T21:46:21.450 INFO:root:teuthology version: 0.0.1.dev59+g7f7f7c3
2023-03-18T21:46:22.736 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging
2023-03-18T21:46:25.910 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server
2023-03-18T21:46:25.910 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-03-18T21:46:25.938 INFO:teuthology.lock.ops:Node 'smithi043.front.sepia.ceph.com' reimaging is complete
2023-03-18T21:46:27.256 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging
2023-03-18T21:46:27.257 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server
2023-03-18T21:46:27.257 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-03-18T21:46:27.287 INFO:teuthology.lock.ops:Node 'smithi086.front.sepia.ceph.com' reimaging is complete
2023-03-18T21:46:28.552 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-03-18T21:46:28.553 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-03-18T21:46:28.553 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-03-18T21:46:28.578 INFO:teuthology.lock.ops:Node 'smithi136.front.sepia.ceph.com' reimaging is complete
2023-03-18T21:46:29.660 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging
2023-03-18T21:46:29.660 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server
2023-03-18T21:46:29.660 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-03-18T21:46:29.757 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 8.stream
2023-03-18T21:46:31.047 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of centos 8.stream
2023-03-18T21:46:31.049 INFO:teuthology.lock.ops:Node 'smithi161.front.sepia.ceph.com' reimaging is complete
2023-03-18T21:46:34.274 INFO:teuthology.lock.ops:Start node 'smithi202.front.sepia.ceph.com' reimaging
2023-03-18T21:46:34.274 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: reset os type and version on server
2023-03-18T21:46:34.275 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server
2023-03-18T21:46:34.302 INFO:teuthology.lock.ops:Node 'smithi202.front.sepia.ceph.com' reimaging is complete
2023-03-18T21:46:35.987 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream
2023-03-18T21:46:36.119 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream
2023-03-18T21:46:39.205 INFO:teuthology.provision.fog.smithi202:Scheduling deploy of centos 8.stream
2023-03-18T21:46:41.016 INFO:teuthology.orchestra.console:Power off smithi043
2023-03-18T21:46:43.074 INFO:teuthology.orchestra.console:Power off smithi086
2023-03-18T21:46:44.915 INFO:teuthology.orchestra.console:Power off smithi136
2023-03-18T21:46:46.418 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-03-18T21:46:48.126 INFO:teuthology.orchestra.console:Power off smithi161
2023-03-18T21:46:49.387 INFO:teuthology.orchestra.console:Power on smithi086
2023-03-18T21:46:51.729 INFO:teuthology.orchestra.console:Power off smithi202
2023-03-18T21:46:53.299 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2023-03-18T21:46:55.174 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-03-18T21:46:55.175 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2023-03-18T21:46:55.275 INFO:teuthology.orchestra.console:Power on smithi043
2023-03-18T21:46:56.540 INFO:teuthology.orchestra.console:Power on smithi161
2023-03-18T21:46:58.289 INFO:teuthology.orchestra.console:Power on smithi202
2023-03-18T21:47:00.237 INFO:teuthology.orchestra.console:Power on for smithi086 completed
2023-03-18T21:47:01.165 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-03-18T21:47:02.372 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish
2023-03-18T21:47:02.473 INFO:teuthology.orchestra.console:Power on smithi136
2023-03-18T21:47:05.089 INFO:teuthology.orchestra.console:Power on for smithi043 completed
2023-03-18T21:47:06.259 INFO:teuthology.orchestra.console:Power on for smithi202 completed
2023-03-18T21:47:06.259 INFO:teuthology.orchestra.console:Power on for smithi161 completed
2023-03-18T21:47:06.360 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish
2023-03-18T21:47:07.610 INFO:teuthology.provision.fog.smithi202:Waiting for deploy to finish
2023-03-18T21:47:07.610 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish
2023-03-18T21:47:13.242 INFO:teuthology.orchestra.console:Power on for smithi136 completed
2023-03-18T21:47:13.371 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-03-18T21:47:16.809 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:47:26.821 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:47:36.837 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:47:46.533 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:47:56.517 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:48:09.189 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:48:19.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:48:36.997 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:48:47.946 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:48:54.990 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:48:57.396 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:48:59.946 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:01.563 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:03.790 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:07.194 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:08.894 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:11.448 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:13.889 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:16.486 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:17.796 WARNING:teuthology.provision.fog:'connect to smithi136.front.sepia.ceph.com' reached maximum tries (10) after waiting for 10 seconds
2023-03-18T21:49:26.692 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-03-18T21:49:27.031 ERROR:paramiko.transport:Traceback (most recent call last):
2023-03-18T21:49:27.980 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-03-18T21:49:27.980 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-03-18T21:49:27.980 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-03-18T21:49:27.980 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-03-18T21:49:27.981 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
2023-03-18T21:49:27.981 ERROR:paramiko.transport:    raise EOFError()
2023-03-18T21:49:27.981 ERROR:paramiko.transport:EOFError
2023-03-18T21:49:27.981 ERROR:paramiko.transport:
2023-03-18T21:49:27.981 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-03-18T21:49:27.981 ERROR:paramiko.transport:
2023-03-18T21:49:27.981 ERROR:paramiko.transport:Traceback (most recent call last):
2023-03-18T21:49:27.981 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-03-18T21:49:28.836 ERROR:paramiko.transport:    self._check_banner()
2023-03-18T21:49:28.837 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-03-18T21:49:28.837 ERROR:paramiko.transport:    raise SSHException(
2023-03-18T21:49:28.837 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-03-18T21:49:28.837 ERROR:paramiko.transport:
2023-03-18T21:49:28.837 WARNING:teuthology.provision.fog:Error reading SSH protocol banner
2023-03-18T21:49:34.909 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:36.505 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:37.865 ERROR:paramiko.transport:Exception (client): Error reading SSH protocol banner
2023-03-18T21:49:38.611 ERROR:paramiko.transport:Traceback (most recent call last):
2023-03-18T21:49:38.611 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2270, in _check_banner
2023-03-18T21:49:38.611 ERROR:paramiko.transport:    buf = self.packetizer.readline(timeout)
2023-03-18T21:49:38.611 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 380, in readline
2023-03-18T21:49:38.611 ERROR:paramiko.transport:    buf += self._read_timeout(timeout)
2023-03-18T21:49:38.611 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/packet.py", line 609, in _read_timeout
2023-03-18T21:49:38.611 ERROR:paramiko.transport:    raise EOFError()
2023-03-18T21:49:38.611 ERROR:paramiko.transport:EOFError
2023-03-18T21:49:38.611 ERROR:paramiko.transport:
2023-03-18T21:49:38.612 ERROR:paramiko.transport:During handling of the above exception, another exception occurred:
2023-03-18T21:49:38.612 ERROR:paramiko.transport:
2023-03-18T21:49:38.612 ERROR:paramiko.transport:Traceback (most recent call last):
2023-03-18T21:49:38.612 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2093, in run
2023-03-18T21:49:38.612 ERROR:paramiko.transport:    self._check_banner()
2023-03-18T21:49:38.612 ERROR:paramiko.transport:  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 2274, in _check_banner
2023-03-18T21:49:38.612 ERROR:paramiko.transport:    raise SSHException(
2023-03-18T21:49:38.612 ERROR:paramiko.transport:paramiko.ssh_exception.SSHException: Error reading SSH protocol banner
2023-03-18T21:49:38.612 ERROR:paramiko.transport:
2023-03-18T21:49:39.225 WARNING:teuthology.provision.fog:Error reading SSH protocol banner
2023-03-18T21:49:43.657 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-03-18T21:49:45.337 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:48.005 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:50.040 ERROR:teuthology.orchestra.connection:Error authenticating with smithi136.front.sepia.ceph.com: Authentication failed.
2023-03-18T21:49:56.005 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-03-18T21:49:56.832 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-03-18T21:49:58.693 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:05.893 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-03-18T21:50:07.041 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-03-18T21:50:08.325 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:13.765 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:50:16.101 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-03-18T21:50:17.381 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-03-18T21:50:18.396 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:22.821 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:50:25.765 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.43
2023-03-18T21:50:28.613 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:50:30.048 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-03-18T21:50:30.048 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:34.725 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:50:39.109 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:50:40.183 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86
2023-03-18T21:50:40.689 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:44.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:50:49.797 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-03-18T21:50:50.797 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.202
2023-03-18T21:50:55.813 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:51:06.181 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.161
2023-03-18T21:51:28.899 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-18T21:51:33.387 WARNING:teuthology.provision.fog:timed out
2023-03-18T21:51:41.068 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-18T21:51:41.642 INFO:teuthology.provision.fog.smithi043:Node is ready
2023-03-18T21:51:43.503 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com
2023-03-18T21:51:45.061 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043
2023-03-18T21:51:47.141 WARNING:teuthology.provision.fog:timed out
2023-03-18T21:51:47.445 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-18T21:51:48.564 INFO:teuthology.provision.fog.smithi043:Deploy complete!
2023-03-18T21:51:50.648 INFO:teuthology.provision.fog.smithi202:Node is ready
2023-03-18T21:51:52.012 INFO:teuthology.orchestra.run.smithi202.stdout:smithi202.front.sepia.ceph.com
2023-03-18T21:51:53.422 INFO:teuthology.orchestra.run.smithi202.stdout:172.21.15.202 smithi202.front.sepia.ceph.com smithi202
2023-03-18T21:51:54.860 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-18T21:51:55.745 INFO:teuthology.provision.fog.smithi086:Node is ready
2023-03-18T21:51:57.724 WARNING:teuthology.provision.fog:timed out
2023-03-18T21:51:57.742 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com
2023-03-18T21:51:59.775 INFO:teuthology.provision.fog.smithi202:Deploy complete!
2023-03-18T21:51:59.791 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086
2023-03-18T21:52:02.311 INFO:teuthology.provision.fog.smithi086:Deploy complete!
2023-03-18T21:52:04.296 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-03-18T21:52:05.841 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-03-18T21:52:07.276 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-03-18T21:52:07.614 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-03-18T21:52:08.258 INFO:teuthology.provision.fog.smithi161:Node is ready
2023-03-18T21:52:08.649 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com
2023-03-18T21:52:08.987 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161
2023-03-18T21:52:10.194 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-03-18T21:52:11.092 INFO:teuthology.provision.fog.smithi161:Deploy complete!
2023-03-18T21:52:14.887 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com
2023-03-18T21:52:15.536 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-18T21:52:15.565 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com
2023-03-18T21:52:16.396 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-18T21:52:16.423 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-03-18T21:52:16.849 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-18T21:52:16.873 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com
2023-03-18T21:52:18.088 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-18T21:52:18.114 INFO:teuthology.lock.ops:Checking smithi202.front.sepia.ceph.com
2023-03-18T21:52:20.047 INFO:teuthology.lock.ops:New key found. Updating...
2023-03-18T21:52:20.890 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server
2023-03-18T21:52:21.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-18T21:52:21.699 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64
2023-03-18T21:52:22.500 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream"
2023-03-18T21:52:23.662 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="8"
2023-03-18T21:52:23.662 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos"
2023-03-18T21:52:23.663 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora"
2023-03-18T21:52:24.963 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="8"
2023-03-18T21:52:24.963 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el8"
2023-03-18T21:52:24.963 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-18T21:52:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31"
2023-03-18T21:52:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-18T21:52:25.507 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/"
2023-03-18T21:52:25.844 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-18T21:52:25.844 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-18T21:52:25.844 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-18T21:52:25.846 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server
2023-03-18T21:52:25.880 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server
2023-03-18T21:52:27.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-18T21:52:27.514 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64
2023-03-18T21:52:28.464 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream"
2023-03-18T21:52:30.639 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-18T21:52:30.640 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-18T21:52:30.641 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server
2023-03-18T21:52:30.662 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-03-18T21:52:31.779 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-18T21:52:32.032 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-03-18T21:52:32.775 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2023-03-18T21:52:33.930 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2023-03-18T21:52:33.930 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2023-03-18T21:52:33.930 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2023-03-18T21:52:33.930 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-18T21:52:33.931 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-18T21:52:33.931 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-03-18T21:52:33.962 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server
2023-03-18T21:52:34.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-18T21:52:34.523 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64
2023-03-18T21:52:34.957 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream"
2023-03-18T21:52:35.480 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8"
2023-03-18T21:52:35.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos"
2023-03-18T21:52:35.480 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora"
2023-03-18T21:52:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8"
2023-03-18T21:52:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8"
2023-03-18T21:52:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-18T21:52:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31"
2023-03-18T21:52:35.483 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-18T21:52:35.484 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/"
2023-03-18T21:52:35.484 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-18T21:52:35.484 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-18T21:52:35.484 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-18T21:52:35.484 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server
2023-03-18T21:52:35.512 INFO:teuthology.lock.ops:Updating [smithi202.front.sepia.ceph.com]: set os type and version on server
2023-03-18T21:52:36.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-18T21:52:36.595 INFO:teuthology.orchestra.run.smithi202.stdout:x86_64
2023-03-18T21:52:36.762 INFO:teuthology.orchestra.run.smithi202.stdout:NAME="CentOS Stream"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION="8"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:ID="centos"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:ID_LIKE="rhel fedora"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:VERSION_ID="8"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:PLATFORM_ID="platform:el8"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:PRETTY_NAME="CentOS Stream 8"
2023-03-18T21:52:37.252 INFO:teuthology.orchestra.run.smithi202.stdout:ANSI_COLOR="0;31"
2023-03-18T21:52:37.696 INFO:teuthology.orchestra.run.smithi202.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-03-18T21:52:37.697 INFO:teuthology.orchestra.run.smithi202.stdout:HOME_URL="https://centos.org/"
2023-03-18T21:52:37.697 INFO:teuthology.orchestra.run.smithi202.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-03-18T21:52:37.697 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-03-18T21:52:37.697 INFO:teuthology.orchestra.run.smithi202.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-03-18T21:52:37.697 INFO:teuthology.lock.ops:Updating smithi202.front.sepia.ceph.com on lock server
2023-03-18T21:52:38.631 INFO:teuthology.dispatcher.supervisor:Running job 7211184
2023-03-18T21:52:39.959 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-03-16_21:59:27-rados-wip-yuri6-testing-2023-03-12-0918-pacific-distro-default-smithi/7211184 --name yuriw-2023-03-16_21:59:27-rados-wip-yuri6-testing-2023-03-12-0918-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} -- /home/teuthworker/archive/yuriw-2023-03-16_21:59:27-rados-wip-yuri6-testing-2023-03-12-0918-pacific-distro-default-smithi/7211184/orig.config.yaml
2023-03-18T21:52:39.962 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-03-16_21:59:27-rados-wip-yuri6-testing-2023-03-12-0918-pacific-distro-default-smithi/7211184
2023-03-18T21:52:41.305 INFO:teuthology.dispatcher.supervisor:Job PID: 14061
2023-03-18T21:52:41.305 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-03-19T09:53:04.176 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T09:53:06.458 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T09:53:08.960 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T09:53:11.942 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T09:53:14.886 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T09:53:14.886 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T09:53:14.886 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T09:53:14.886 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:53:14.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T09:53:15.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T09:53:17.120 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T09:53:19.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T09:53:21.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T09:53:23.389 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:53:24.829 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-19T09:53:26.164 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-19T09:53:26.164 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-19T09:53:26.164 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2023-03-19T09:53:26.907 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:53:34.624 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-mon.smithi202.log: file size changed while zipping
2023-03-19T09:53:35.832 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2023-03-19T09:53:35.832 INFO:teuthology.orchestra.run.smithi086.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2023-03-19T09:53:37.387 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.9.log: file size changed while zipping
2023-03-19T09:53:42.480 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.14.log: file size changed while zipping
2023-03-19T09:53:44.273 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.8.log: file size changed while zipping
2023-03-19T09:53:45.356 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.11.log: file size changed while zipping
2023-03-19T09:53:49.143 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.12.log: file size changed while zipping
2023-03-19T09:53:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.10.log: file size changed while zipping
2023-03-19T09:53:54.612 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2023-03-19T09:53:58.117 INFO:teuthology.orchestra.run.smithi202.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-osd.13.log: file size changed while zipping
2023-03-19T09:53:59.270 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /var/log/ceph/78fbd7f0-c5db-11ed-9afc-001a4aab830c/ceph-mon.smithi161.log: file size changed while zipping
2023-03-19T09:54:24.715 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T09:54:26.648 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T09:56:31.076 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T09:56:34.264 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T09:56:35.673 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T09:56:36.617 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T09:56:37.437 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T09:56:37.437 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T09:56:37.437 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T09:56:37.437 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T09:56:37.437 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:56:37.437 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T09:56:37.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T09:56:39.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T09:56:41.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T09:56:44.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T09:56:46.550 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:56:49.171 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:57:14.975 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T09:57:18.242 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T09:59:22.027 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T09:59:23.673 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T09:59:25.862 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T09:59:27.943 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T09:59:29.428 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T09:59:33.268 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T09:59:33.268 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T09:59:33.268 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T09:59:33.268 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:59:33.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T09:59:33.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T09:59:34.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T09:59:37.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T09:59:38.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T09:59:41.346 INFO:teuthology.misc:Compressing logs...
2023-03-19T09:59:44.363 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:00:11.895 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:00:13.456 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:02:15.195 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:02:16.913 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:02:18.943 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:02:20.496 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:02:21.615 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:02:21.615 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:02:21.615 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:02:21.615 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:02:21.615 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:02:21.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:02:21.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:02:23.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:02:24.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:02:25.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:02:26.193 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:02:27.940 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:02:55.390 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:02:56.441 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:04:57.859 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:04:58.907 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:05:01.482 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:05:03.182 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:05:04.508 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:05:06.990 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:05:06.990 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:05:06.990 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:05:06.990 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:05:06.990 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:05:07.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:05:12.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:05:14.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:05:15.262 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:05:16.624 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:05:18.480 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:05:44.668 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:05:45.439 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:07:46.035 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:07:47.734 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:07:49.121 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:07:49.936 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:07:52.021 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:07:52.021 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:07:52.021 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:07:52.021 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:07:52.021 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:07:52.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:07:52.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:07:53.943 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:07:57.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:07:58.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:08:00.689 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:08:03.268 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:08:29.735 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:08:32.191 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:10:33.498 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:10:36.610 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:10:39.903 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:10:44.738 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:10:47.203 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:10:47.203 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:10:47.203 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:10:47.203 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:10:47.203 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:10:48.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:10:48.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:10:49.304 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:10:50.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:10:51.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:10:52.571 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:10:53.853 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:11:19.405 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:11:20.525 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:13:21.939 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:13:21.979 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:13:25.648 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:13:28.238 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:13:29.635 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:13:29.635 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:13:29.635 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:13:29.635 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:13:29.635 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:13:29.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:13:29.820 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:13:32.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:13:35.591 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:13:40.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:13:44.890 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:13:48.455 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:14:17.177 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:14:19.661 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:16:21.096 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:16:22.119 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:16:24.314 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:16:25.786 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:16:28.127 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:16:28.128 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:16:28.128 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:16:28.128 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:16:28.128 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:16:28.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:16:28.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:16:31.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:16:33.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:16:34.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:16:36.277 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:16:39.982 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:17:07.236 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:17:11.106 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:19:13.102 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:19:17.599 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:19:20.707 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:19:24.441 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:19:25.850 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:19:25.850 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:19:25.850 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:19:25.850 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:19:25.850 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:19:25.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:19:26.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:19:27.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:19:29.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:19:31.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:19:32.752 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:19:34.615 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:20:01.633 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:20:02.493 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:22:04.438 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-03-19T10:22:05.850 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:22:08.611 ERROR:teuthology.dispatcher.supervisor:Failed to kill job
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 288, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:22:10.648 INFO:teuthology.task.internal:roles: ubuntu@smithi043.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'mon.a', 'mgr.a', 'client.0']
2023-03-19T10:22:11.673 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['host.b', 'osd.3', 'osd.4', 'osd.5', 'mon.b', 'mgr.b', 'client.1']
2023-03-19T10:22:11.673 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['host.c', 'osd.6', 'osd.7', 'osd.8', 'mon.c', 'mgr.c', 'client.2']
2023-03-19T10:22:11.673 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['host.d', 'osd.9', 'osd.10', 'osd.11', 'mon.d', 'mgr.d', 'client.3']
2023-03-19T10:22:11.673 INFO:teuthology.task.internal:roles: ubuntu@smithi202.front.sepia.ceph.com - ['host.e', 'osd.12', 'osd.13', 'osd.14', 'mon.e', 'mgr.e', 'client.4']
2023-03-19T10:22:11.674 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:22:11.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com'
2023-03-19T10:22:11.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com'
2023-03-19T10:22:13.297 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-03-19T10:22:13.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com'
2023-03-19T10:22:14.317 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi202.front.sepia.ceph.com'
2023-03-19T10:22:15.606 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:22:17.404 INFO:teuthology.misc:Compressing logs...
2023-03-19T10:22:43.295 INFO:teuthology.kill:Killing Pids: {14061}
2023-03-19T10:22:44.038 ERROR:teuthology.dispatcher.supervisor:Failed to kill job and unlock machines
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/dispatcher/supervisor.py", line 302, in run_with_watchdog
    kill_job(job_info['name'], job_info['job_id'],
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/kill.py", line 90, in kill_job
    teuthology.exporter.JobResults().record(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/teuthology/exporter.py", line 175, in __init__
    self.metric = Counter(
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/metrics.py", line 143, in __init__
    registry.register(self)
  File "/home/teuthworker/src/git.ceph.com_teuthology_7f7f7c33a372789d0252bbbcd5798300b0f044d0/virtualenv/lib/python3.8/site-packages/prometheus_client/registry.py", line 43, in register
    raise ValueError(
ValueError: Duplicated timeseries in CollectorRegistry: {'teuthology_job_results_total', 'teuthology_job_results', 'teuthology_job_results_created'}
2023-03-19T10:24:45.195 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-03-19T10:24:48.960 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-03-19T10:24:52.604 INFO:teuthology.nuke:Checking targets against current locks
2023-03-19T10:24:52.663 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-19T10:24:54.357 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-19T10:24:55.115 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-19T10:24:57.614 INFO:teuthology.orchestra.console:Power off smithi043
2023-03-19T10:24:59.134 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-19T10:25:01.060 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-03-19T10:25:02.077 INFO:teuthology.orchestra.console:Power off smithi136
2023-03-19T10:25:04.033 INFO:teuthology.orchestra.console:Power off smithi086
2023-03-19T10:25:05.886 INFO:teuthology.orchestra.console:Power off smithi202
2023-03-19T10:25:07.003 INFO:teuthology.orchestra.console:Power off smithi161
2023-03-19T10:25:12.683 INFO:teuthology.orchestra.console:Power off for smithi043 completed
2023-03-19T10:25:18.372 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com
2023-03-19T10:25:20.948 INFO:teuthology.orchestra.console:Power off for smithi136 completed
2023-03-19T10:25:21.505 INFO:teuthology.orchestra.console:Power off for smithi086 completed
2023-03-19T10:25:21.505 INFO:teuthology.orchestra.console:Power off for smithi202 completed
2023-03-19T10:25:21.505 INFO:teuthology.orchestra.console:Power off for smithi161 completed
2023-03-19T10:25:21.672 INFO:teuthology.lock.ops:unlocked: smithi202.front.sepia.ceph.com
2023-03-19T10:25:24.323 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2023-03-19T10:25:25.722 INFO:teuthology.lock.ops:unlocked: smithi086.front.sepia.ceph.com
2023-03-19T10:25:25.722 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com