2023-05-10T13:46:36.929 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-10T13:46:37.103 INFO:teuthology.lock.ops:Start node 'smithi039.front.sepia.ceph.com' reimaging 2023-05-10T13:46:37.105 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: reset os type and version on server 2023-05-10T13:46:37.105 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-05-10T13:46:37.130 INFO:teuthology.lock.ops:Node 'smithi039.front.sepia.ceph.com' reimaging is complete 2023-05-10T13:46:37.130 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2023-05-10T13:46:37.131 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2023-05-10T13:46:37.131 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-05-10T13:46:37.154 INFO:teuthology.lock.ops:Node 'smithi083.front.sepia.ceph.com' reimaging is complete 2023-05-10T13:46:37.155 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging 2023-05-10T13:46:37.155 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server 2023-05-10T13:46:37.155 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-05-10T13:46:37.179 INFO:teuthology.lock.ops:Node 'smithi098.front.sepia.ceph.com' reimaging is complete 2023-05-10T13:46:37.292 INFO:teuthology.provision.fog.smithi039:Scheduling deploy of rhel 8.6 2023-05-10T13:46:37.319 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of rhel 8.6 2023-05-10T13:46:37.327 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2023-05-10T13:46:37.596 INFO:teuthology.orchestra.console:Power off smithi039 2023-05-10T13:46:37.611 INFO:teuthology.orchestra.console:Power off smithi098 2023-05-10T13:46:37.625 INFO:teuthology.orchestra.console:Power off smithi083 2023-05-10T13:46:45.995 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-05-10T13:46:46.002 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-05-10T13:46:46.097 INFO:teuthology.orchestra.console:Power on smithi039 2023-05-10T13:46:46.105 INFO:teuthology.orchestra.console:Power on smithi083 2023-05-10T13:46:50.101 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-05-10T13:46:50.203 INFO:teuthology.orchestra.console:Power on smithi098 2023-05-10T13:46:54.455 INFO:teuthology.orchestra.console:Power on for smithi098 completed 2023-05-10T13:46:54.462 INFO:teuthology.orchestra.console:Power on for smithi039 completed 2023-05-10T13:46:54.531 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2023-05-10T13:46:54.556 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish 2023-05-10T13:46:54.563 INFO:teuthology.provision.fog.smithi039:Waiting for deploy to finish 2023-05-10T13:46:54.631 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2023-05-10T13:49:40.447 ERROR:teuthology.orchestra.connection:Error authenticating with smithi098.front.sepia.ceph.com: Authentication failed. 2023-05-10T13:49:43.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-05-10T13:49:52.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-05-10T13:50:01.552 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-05-10T13:50:10.608 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-05-10T13:50:13.520 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:50:19.664 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2023-05-10T13:50:22.576 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:50:31.632 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:50:40.688 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:50:41.451 WARNING:teuthology.provision.fog:timed out 2023-05-10T13:50:49.744 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:50:58.800 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:51:07.856 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:51:16.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:51:25.668 WARNING:teuthology.provision.fog:timed out 2023-05-10T13:51:25.968 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.39 2023-05-10T13:51:32.008 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-10T13:51:32.321 INFO:teuthology.provision.fog.smithi083:Node is ready 2023-05-10T13:51:32.339 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2023-05-10T13:51:32.396 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2023-05-10T13:51:32.741 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2023-05-10T13:51:47.454 WARNING:teuthology.provision.fog:timed out 2023-05-10T13:51:53.690 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-10T13:51:53.983 INFO:teuthology.provision.fog.smithi098:Node is ready 2023-05-10T13:51:53.999 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com 2023-05-10T13:51:54.059 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098 2023-05-10T13:51:54.405 INFO:teuthology.provision.fog.smithi098:Deploy complete! 2023-05-10T13:52:31.971 WARNING:teuthology.provision.fog:timed out 2023-05-10T13:52:38.208 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-05-10T13:52:38.490 INFO:teuthology.provision.fog.smithi039:Node is ready 2023-05-10T13:52:38.509 INFO:teuthology.orchestra.run.smithi039.stdout:smithi039.front.sepia.ceph.com 2023-05-10T13:52:38.566 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.15.39 smithi039.front.sepia.ceph.com smithi039 2023-05-10T13:52:38.916 INFO:teuthology.provision.fog.smithi039:Deploy complete! 2023-05-10T13:52:39.114 INFO:teuthology.lock.ops:Checking smithi039.front.sepia.ceph.com 2023-05-10T13:52:39.115 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-10T13:52:39.147 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2023-05-10T13:52:39.147 INFO:teuthology.lock.ops:New key found. Updating... 2023-05-10T13:52:39.171 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com 2023-05-10T13:52:39.173 INFO:teuthology.lock.ops:Updating [smithi039.front.sepia.ceph.com]: set os type and version on server 2023-05-10T13:52:39.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-10T13:52:39.360 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2023-05-10T13:52:39.416 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T13:52:39.416 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="8.6 (Ootpa)" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:ID="rhel" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="fedora" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="8.6" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el8" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2023-05-10T13:52:39.417 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout: 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T13:52:39.418 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-10T13:52:39.419 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2023-05-10T13:52:39.447 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2023-05-10T13:52:39.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-05-10T13:52:39.703 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2023-05-10T13:52:39.761 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T13:52:39.761 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2023-05-10T13:52:39.761 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-10T13:52:39.762 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout: 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T13:52:39.763 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-10T13:52:39.764 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2023-05-10T13:52:39.789 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server 2023-05-10T13:52:39.789 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-05-10T13:52:40.048 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64 2023-05-10T13:52:40.106 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T13:52:40.106 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8.6 (Ootpa)" 2023-05-10T13:52:40.106 INFO:teuthology.orchestra.run.smithi098.stdout:ID="rhel" 2023-05-10T13:52:40.106 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="fedora" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8.6" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T13:52:40.107 INFO:teuthology.orchestra.run.smithi098.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout: 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T13:52:40.108 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-10T13:52:40.109 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server 2023-05-10T13:52:40.244 INFO:teuthology.dispatcher.supervisor:Running job 7262263 2023-05-10T13:52:40.244 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262263 --name pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi --description fs:workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-workunit/postgres}} -- /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262263/orig.config.yaml 2023-05-10T13:52:40.248 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/7262263 2023-05-10T13:52:40.249 INFO:teuthology.dispatcher.supervisor:Job PID: 12380 2023-05-10T13:52:40.249 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-05-10T22:40:58.430 WARNING:urllib3.connectionpool:Retrying (Retry(total=9, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.463 WARNING:urllib3.connectionpool:Retrying (Retry(total=8, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.472 WARNING:urllib3.connectionpool:Retrying (Retry(total=7, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.480 WARNING:urllib3.connectionpool:Retrying (Retry(total=6, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.487 WARNING:urllib3.connectionpool:Retrying (Retry(total=5, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.494 WARNING:urllib3.connectionpool:Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.502 WARNING:urllib3.connectionpool:Retrying (Retry(total=3, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.508 WARNING:urllib3.connectionpool:Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.515 WARNING:urllib3.connectionpool:Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.524 WARNING:urllib3.connectionpool:Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')': /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ 2023-05-10T22:40:58.532 ERROR:teuthology.report:Could not report results to http://paddles.front.sepia.ceph.com/ Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 169, in _new_conn conn = connection.create_connection( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 96, in create_connection raise err File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/util/connection.py", line 86, in create_connection sock.connect(sa) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/gevent/_socketcommon.py", line 628, in connect raise _SocketError(result, strerror(result)) OSError: [Errno 99] Cannot assign requested address During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 699, in urlopen httplib_response = self._make_request( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 394, in _make_request conn.request(method, url, **httplib_request_kw) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 234, in request super(HTTPConnection, self).request(method, url, body=body, headers=headers) File "/usr/lib/python3.8/http/client.py", line 1234, in request self._send_request(method, url, body, headers, encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1280, in _send_request self.endheaders(body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1229, in endheaders self._send_output(message_body, encode_chunked=encode_chunked) File "/usr/lib/python3.8/http/client.py", line 1008, in _send_output self.send(msg) File "/usr/lib/python3.8/http/client.py", line 948, in send self.connect() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 200, in connect conn = self._new_conn() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connection.py", line 181, in _new_conn raise NewConnectionError( urllib3.exceptions.NewConnectionError: : Failed to establish a new connection: [Errno 99] Cannot assign requested address During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 440, in send resp = conn.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 783, in urlopen return self.urlopen( [Previous line repeated 7 more times] File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/connectionpool.py", line 755, in urlopen retries = retries.increment( File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/urllib3/util/retry.py", line 574, in increment raise MaxRetryError(_pool, url, error or ResponseError(cause)) urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/report.py", line 512, in try_push_job_info push_job_info(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/report.py", line 474, in push_job_info reporter.report_job(run_name, job_id, job_info) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/report.py", line 300, in report_job response = self.session.post(run_uri, data=job_json, headers=headers) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 577, in post return self.request('POST', url, data=data, json=json, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 529, in request resp = self.send(prep, **send_kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/requests/sessions.py", line 645, in send r = adapter.send(request, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/requests/adapters.py", line 519, in send raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='paddles.front.sepia.ceph.com', port=80): Max retries exceeded with url: /runs/pdonnell-2023-05-06_00:16:52-fs:workload-main-distro-default-smithi/jobs/ (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 99] Cannot assign requested address')) 2023-05-11T01:53:05.476 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-05-11T01:53:05.656 INFO:teuthology.kill:Killing Pids: {12380} 2023-05-11T01:53:06.545 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-05-11T01:53:06.546 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-05-11T01:53:06.546 INFO:teuthology.task.internal:roles: ubuntu@smithi098.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-05-11T01:53:06.547 INFO:teuthology.misc:Compressing logs... 2023-05-11T01:53:06.547 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2023-05-11T01:53:06.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2023-05-11T01:53:06.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com' 2023-05-11T01:53:07.407 INFO:teuthology.misc:Compressing logs... 2023-05-11T01:53:07.443 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T01:53:07.443 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T01:53:07.444 INFO:teuthology.orchestra.run.smithi098.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 79.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-11T01:53:07.450 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T01:53:07.454 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T01:53:07.472 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-11T01:53:07.473 INFO:teuthology.orchestra.run.smithi083.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 79.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-11T01:53:07.478 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-11T01:53:07.520 INFO:teuthology.orchestra.run.smithi039.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: /home/ubuntu/cephtest/archive/syslog/misc.log: 88.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2023-05-11T01:53:07.535 INFO:teuthology.orchestra.run.smithi098.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 90.1% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-11T01:53:07.572 INFO:teuthology.orchestra.run.smithi083.stderr: 90.2% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-11T01:53:07.632 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-05-11T01:53:07.633 INFO:teuthology.orchestra.run.smithi039.stderr: 90.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2023-05-11T01:53:07.812 INFO:teuthology.misc:Compressing logs... 2023-05-11T01:53:07.848 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.10.log 2023-05-11T01:53:07.849 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.h.log 2023-05-11T01:53:07.849 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.e.log 2023-05-11T01:53:07.849 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.4.log 2023-05-11T01:53:07.851 INFO:teuthology.orchestra.run.smithi083.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.1.log 2023-05-11T01:53:07.851 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.e.log: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.k.log 2023-05-11T01:53:07.851 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log 2023-05-11T01:53:07.851 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.7.log 2023-05-11T01:53:07.852 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.b.log 2023-05-11T01:53:07.852 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.b.log 2023-05-11T01:53:07.852 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.y.log 2023-05-11T01:53:07.852 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-11T01:53:07.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.5.log 2023-05-11T01:53:07.878 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.2.log 2023-05-11T01:53:07.879 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.11.log 2023-05-11T01:53:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.5.log: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.z.log 2023-05-11T01:53:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.8.log 2023-05-11T01:53:07.880 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.11.log: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.f.log 2023-05-11T01:53:07.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.0.log 2023-05-11T01:53:07.881 INFO:teuthology.orchestra.run.smithi039.stderr:gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.g.log 2023-05-11T01:53:07.881 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.8.log: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.c.log 2023-05-11T01:53:07.882 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.a.log 2023-05-11T01:53:07.882 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.6.log 2023-05-11T01:53:07.883 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.3.log 2023-05-11T01:53:07.885 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.d.log 2023-05-11T01:53:07.885 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.x.log 2023-05-11T01:53:07.886 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.i.log 2023-05-11T01:53:07.886 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.9.log 2023-05-11T01:53:07.887 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log 2023-05-11T01:53:07.889 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.j.log 2023-05-11T01:53:07.889 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.a.log 2023-05-11T01:53:07.889 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-11T01:53:07.890 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2023-05-11T01:53:07.894 INFO:teuthology.orchestra.run.smithi039.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2023-05-11T01:53:07.896 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.c.log 2023-05-11T01:53:07.916 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log 2023-05-11T01:53:07.939 INFO:teuthology.orchestra.run.smithi039.stderr: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-11T01:53:07.940 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.l.log 2023-05-11T01:53:07.952 INFO:teuthology.orchestra.run.smithi098.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-05-11T01:53:07.955 INFO:teuthology.orchestra.run.smithi098.stderr: 93.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log.gz 2023-05-11T01:53:07.975 INFO:teuthology.orchestra.run.smithi039.stderr: 93.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log.gz 2023-05-11T01:53:07.980 INFO:teuthology.orchestra.run.smithi098.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-11T01:53:08.005 INFO:teuthology.orchestra.run.smithi098.stderr: 94.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.z.log.gz 2023-05-11T01:53:08.220 INFO:teuthology.orchestra.run.smithi098.stderr: 94.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.l.log.gz 2023-05-11T01:53:08.333 INFO:teuthology.orchestra.run.smithi083.stderr:/var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.y.log: /var/log/ceph/cephadm.log: gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.k.log: file size changed while zipping 2023-05-11T01:53:08.333 INFO:teuthology.orchestra.run.smithi083.stderr: 94.3% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.k.log.gz 2023-05-11T01:53:08.422 INFO:teuthology.orchestra.run.smithi083.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2023-05-11T01:53:08.720 INFO:teuthology.orchestra.run.smithi083.stderr: 93.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-volume.log.gz 2023-05-11T01:53:08.728 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.e.log: file size changed while zipping 2023-05-11T01:53:08.728 INFO:teuthology.orchestra.run.smithi083.stderr: 94.2% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.e.log.gz 2023-05-11T01:53:08.778 INFO:teuthology.orchestra.run.smithi083.stderr: 94.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.y.log.gz 2023-05-11T01:53:10.185 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.f.log: file size changed while zipping 2023-05-11T01:53:10.185 INFO:teuthology.orchestra.run.smithi098.stderr: 94.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.f.log.gz 2023-05-11T01:53:10.228 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.j.log: file size changed while zipping 2023-05-11T01:53:10.229 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.j.log.gz 2023-05-11T01:53:10.240 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.d.log: file size changed while zipping 2023-05-11T01:53:10.241 INFO:teuthology.orchestra.run.smithi039.stderr: 94.6% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.d.log.gz 2023-05-11T01:53:10.265 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.a.log: file size changed while zipping 2023-05-11T01:53:10.265 INFO:teuthology.orchestra.run.smithi039.stderr: 94.7% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.a.log.gz 2023-05-11T01:53:14.372 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.h.log: file size changed while zipping 2023-05-11T01:53:14.372 INFO:teuthology.orchestra.run.smithi083.stderr: 93.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.h.log.gz 2023-05-11T01:53:17.262 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.c.log: file size changed while zipping 2023-05-11T01:53:17.263 INFO:teuthology.orchestra.run.smithi098.stderr: 94.6% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.c.log.gz 2023-05-11T01:53:17.981 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2023-05-11T01:53:17.981 INFO:teuthology.orchestra.run.smithi098.stderr: 91.7% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.c.log.gz 2023-05-11T01:53:24.365 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.x.log: file size changed while zipping 2023-05-11T01:53:24.366 INFO:teuthology.orchestra.run.smithi039.stderr: 90.1% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mgr.x.log.gz 2023-05-11T01:53:26.300 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.g.log: file size changed while zipping 2023-05-11T01:53:26.301 INFO:teuthology.orchestra.run.smithi039.stderr: 92.9% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.g.log.gz 2023-05-11T01:53:27.408 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.i.log: file size changed while zipping 2023-05-11T01:53:27.409 INFO:teuthology.orchestra.run.smithi098.stderr: 93.7% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.i.log.gz 2023-05-11T01:53:46.736 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.11.log: file size changed while zipping 2023-05-11T01:53:46.736 INFO:teuthology.orchestra.run.smithi098.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.11.log.gz 2023-05-11T01:53:50.297 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2023-05-11T01:53:50.297 INFO:teuthology.orchestra.run.smithi083.stderr: 91.6% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.b.log.gz 2023-05-11T01:53:52.335 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2023-05-11T01:53:52.336 INFO:teuthology.orchestra.run.smithi098.stderr: 92.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.2.log.gz 2023-05-11T01:53:54.959 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.8.log: file size changed while zipping 2023-05-11T01:53:54.959 INFO:teuthology.orchestra.run.smithi098.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.8.log.gz 2023-05-11T01:54:04.652 INFO:teuthology.orchestra.run.smithi098.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2023-05-11T01:54:04.653 INFO:teuthology.orchestra.run.smithi098.stderr: 92.3% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.5.log.gz 2023-05-11T01:54:11.028 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2023-05-11T01:54:11.028 INFO:teuthology.orchestra.run.smithi039.stderr: 90.1% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mon.a.log.gz 2023-05-11T01:54:27.456 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2023-05-11T01:54:27.456 INFO:teuthology.orchestra.run.smithi039.stderr: 92.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.0.log.gz 2023-05-11T01:54:41.476 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2023-05-11T01:54:41.477 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.1.log.gz 2023-05-11T01:54:43.572 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2023-05-11T01:54:43.573 INFO:teuthology.orchestra.run.smithi039.stderr: 92.2% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.6.log.gz 2023-05-11T01:54:45.900 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2023-05-11T01:54:45.901 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.7.log.gz 2023-05-11T01:54:54.779 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.9.log: file size changed while zipping 2023-05-11T01:54:54.779 INFO:teuthology.orchestra.run.smithi039.stderr: 92.3% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.9.log.gz 2023-05-11T01:54:54.787 INFO:teuthology.orchestra.run.smithi039.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2023-05-11T01:54:54.788 INFO:teuthology.orchestra.run.smithi039.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.3.log.gz 2023-05-11T01:54:58.646 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.10.log: file size changed while zipping 2023-05-11T01:54:58.646 INFO:teuthology.orchestra.run.smithi083.stderr: 92.2% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.10.log.gz 2023-05-11T01:55:01.680 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2023-05-11T01:55:01.681 INFO:teuthology.orchestra.run.smithi083.stderr: 92.4% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-osd.4.log.gz 2023-05-11T01:56:04.234 INFO:teuthology.orchestra.run.smithi083.stderr:gzip: /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.b.log: file size changed while zipping 2023-05-11T01:56:04.234 INFO:teuthology.orchestra.run.smithi083.stderr: 94.5% -- replaced with /var/log/ceph/f5b69916-ef3d-11ed-9b02-001a4aab830c/ceph-mds.b.log.gz 2023-05-11T01:57:36.129 INFO:teuthology.kill:No teuthology processes running 2023-05-11T01:57:37.043 INFO:teuthology.kill:Nuking machines: ['smithi039', 'smithi083', 'smithi098'] 2023-05-11T01:57:37.696 INFO:teuthology.kill:2023-05-11 01:57:37,696.696 INFO:teuthology.nuke:targets: 2023-05-11T01:57:37.697 INFO:teuthology.kill: smithi039.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-11T01:57:37.697 INFO:teuthology.kill: smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-11T01:57:37.697 INFO:teuthology.kill: smithi098.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-05-11T01:57:37.698 INFO:teuthology.kill:2023-05-11 01:57:37,698.698 INFO:teuthology.nuke:Checking targets against current locks 2023-05-11T01:57:37.754 INFO:teuthology.kill:2023-05-11 01:57:37,754.754 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-11T01:57:37.788 INFO:teuthology.kill:2023-05-11 01:57:37,787.787 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-11T01:57:37.816 INFO:teuthology.kill:2023-05-11 01:57:37,815.815 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-11T01:57:37.855 INFO:teuthology.kill:2023-05-11 01:57:37,854.854 INFO:teuthology.orchestra.console:Power off smithi039 2023-05-11T01:57:37.906 INFO:teuthology.kill:2023-05-11 01:57:37,906.906 INFO:teuthology.orchestra.console:Power off smithi083 2023-05-11T01:57:37.928 INFO:teuthology.kill:2023-05-11 01:57:37,928.928 INFO:teuthology.orchestra.console:Power off smithi098 2023-05-11T01:57:46.267 INFO:teuthology.kill:2023-05-11 01:57:46,266.266 INFO:teuthology.orchestra.console:Power off for smithi039 completed 2023-05-11T01:57:46.435 INFO:teuthology.kill:2023-05-11 01:57:46,434.434 INFO:teuthology.lock.ops:unlocked: smithi039.front.sepia.ceph.com 2023-05-11T01:57:50.403 INFO:teuthology.kill:2023-05-11 01:57:50,402.402 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2023-05-11T01:57:50.421 INFO:teuthology.kill:2023-05-11 01:57:50,421.421 INFO:teuthology.orchestra.console:Power off for smithi098 completed 2023-05-11T01:57:50.576 INFO:teuthology.kill:2023-05-11 01:57:50,575.575 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2023-05-11T01:57:50.584 INFO:teuthology.kill:2023-05-11 01:57:50,583.583 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com 2023-05-11T01:59:50.833 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-05-11T01:59:51.092 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi039 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-10_14:47:51-rados-wip-yuri5-testing-2023-05-09-1324-pacific-distro-default-smithi/7269780 2023-05-11T01:59:51.093 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-10_14:47:51-rados-wip-yuri5-testing-2023-05-09-1324-pacific-distro-default-smithi/7269781 2023-05-11T01:59:51.093 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi098 but it was locked by another job: /home/teuthworker/archive/yuriw-2023-05-10_14:47:51-rados-wip-yuri5-testing-2023-05-09-1324-pacific-distro-default-smithi/7269781