2022-05-26T06:20:21.880 INFO:root:teuthology version: 1.1.1.dev341+g1b30281f 2022-05-26T06:20:22.045 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2022-05-26T06:20:22.046 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2022-05-26T06:20:22.046 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-05-26T06:20:22.067 INFO:teuthology.lock.ops:Node 'smithi005.front.sepia.ceph.com' reimaging is complete 2022-05-26T06:20:22.067 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2022-05-26T06:20:22.067 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2022-05-26T06:20:22.067 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2022-05-26T06:20:22.091 INFO:teuthology.lock.ops:Node 'smithi134.front.sepia.ceph.com' reimaging is complete 2022-05-26T06:20:22.296 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of ubuntu 20.04 2022-05-26T06:20:22.325 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of ubuntu 20.04 2022-05-26T06:20:22.754 INFO:teuthology.orchestra.console:Power off smithi005 2022-05-26T06:20:22.803 INFO:teuthology.orchestra.console:Power off smithi134 2022-05-26T06:20:31.138 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-05-26T06:20:31.240 INFO:teuthology.orchestra.console:Power on smithi005 2022-05-26T06:20:35.289 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2022-05-26T06:20:35.390 INFO:teuthology.orchestra.console:Power on smithi134 2022-05-26T06:20:39.614 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2022-05-26T06:20:39.715 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2022-05-26T06:20:43.756 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2022-05-26T06:20:43.858 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2022-05-26T06:25:18.079 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-26T06:25:18.588 INFO:teuthology.provision.fog.smithi005:Node is ready 2022-05-26T06:25:18.594 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2022-05-26T06:25:18.600 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2022-05-26T06:25:18.806 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2022-05-26T06:25:44.805 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-26T06:25:45.306 INFO:teuthology.provision.fog.smithi134:Node is ready 2022-05-26T06:25:45.315 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2022-05-26T06:25:45.363 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2022-05-26T06:25:45.544 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2022-05-26T06:25:45.749 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2022-05-26T06:25:45.749 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-26T06:25:45.773 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2022-05-26T06:25:45.773 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-26T06:25:45.796 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2022-05-26T06:25:45.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-05-26T06:25:46.113 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="Ubuntu" 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:ID=ubuntu 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE=debian 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-26T06:25:46.120 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="20.04" 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_CODENAME=focal 2022-05-26T06:25:46.121 INFO:teuthology.orchestra.run.smithi005.stdout:UBUNTU_CODENAME=focal 2022-05-26T06:25:46.123 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-05-26T06:25:46.146 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2022-05-26T06:25:46.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2022-05-26T06:25:46.369 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2022-05-26T06:25:46.376 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2022-05-26T06:25:46.376 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-05-26T06:25:46.376 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2022-05-26T06:25:46.376 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="20.04" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=focal 2022-05-26T06:25:46.377 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=focal 2022-05-26T06:25:46.378 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2022-05-26T06:25:46.495 INFO:teuthology.dispatcher.supervisor:Running job 6848809 2022-05-26T06:25:46.496 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-05-26_05:07:02-rgw-pacific-distro-default-smithi/6848809 --name teuthology-2022-05-26_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2022-05-26_05:07:02-rgw-pacific-distro-default-smithi/6848809/orig.config.yaml 2022-05-26T06:25:46.501 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-05-26_05:07:02-rgw-pacific-distro-default-smithi/6848809 2022-05-26T06:25:46.502 INFO:teuthology.dispatcher.supervisor:Job PID: 29474 2022-05-26T06:25:46.502 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-26T12:56:18.552 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-26T12:56:18.704 INFO:teuthology.kill:Killing Pids: {29474} 2022-05-26T12:56:20.141 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-05-26T12:56:20.141 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-05-26T12:56:20.141 INFO:teuthology.misc:Compressing logs... 2022-05-26T12:56:20.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-05-26T12:56:20.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2022-05-26T12:56:20.828 INFO:teuthology.misc:Compressing logs... 2022-05-26T12:56:20.962 INFO:teuthology.misc:Compressing logs... 2022-05-26T12:58:21.562 INFO:teuthology.kill:No teuthology processes running 2022-05-26T12:58:23.082 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi134'] 2022-05-26T12:58:24.326 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_1b30281f276b97a8186594b7f92fe1f728418ada/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-26T12:58:24.327 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-26T12:58:24.327 INFO:teuthology.kill:2022-05-26 12:58:24,326.326 INFO:teuthology.nuke:targets: 2022-05-26T12:58:24.327 INFO:teuthology.kill: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr3HVG/5l5Z0QO9n0UP3OEKjrZc2WbKMwTKJFYLxm1/vKhGVUKZOw7AiwPXgNs9EtGMSuzyBaAOyM9RrFr6IF+4yrEjoi+LBWUNbKUpWQ2ISwX9VrDkN69IaIG/bcXG1k+Ai+2tk0gMa/bo2N/YcZLPR92gODr70rsd3ZREuqo5lgZAoA2278EJRe7y/NgROPcwStmFM1M2L1B7oRQ5Z+00nID9Z2cXAvbrvqz9KD7sWPaGxQ0dYe5Thf3DL2ADBkIC4Y1SFv1SbKW2VslhixzP/a/yRSVH7vH+pxsMF+TI40iwgBuqLX+0wfu+Ju9McEu+FbzdK5IUC/vKy+cmTEg4jsirhUFTfPoG/jaz5316Q9zoFMGi4CW6U0rqrzea2SHp4qhESN5qsjrkUE3G0VskraaBnKjM0LBAalt2Js4fmuVxiMffYUD2ZbTo0DvLxNobb3/3uV2FtkQKtaoIpTNQPhFp7P0q63gyh7NldzMRJA4BZJyjDmLpn5gxsVBn8M= 2022-05-26T12:58:24.327 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAdVW5okhlubPfFDJsDOORd+f9BG3nln4YjyKF85R+2KCinGqCSrMgLq0GncDzLg+kgj56HY0t5lqvJF1+JPaKeFs8VsKlCLYiiUM3oyMQmlv9sTHOBr3Y+bzYbb+MPXJ9AYMAYyuKXlHqQD2BQiK7xHI5IpkKD3nOEM1dePEQhnl5+3A4Uu3dZrjnYv0koDE6eJlacaVn9T1tOu2raYGgteZVl2r9N4X7vXLIZj5qqmdLC4mtCKmsX2dkbCTqDIEzqgjTb4oktQynrKxbHrc+icVQQs+DDZKuMpUxQdF6beeh00vUDvDGQaLZzy5WSbZ+db39EP92wEytW4/sUWw4hlFs+CHGKBb4s9nuDOU+Saq5zuo0c5nmGkzaQbdkaWKz9a24Atrtu876l2AjThQNKLRj7anzVRQzJ4hzInljtBYZfnKocuM6CeS430WQ/zgPdT6nZLfBEZHmYwdGRQJuwOFQ5Q7HZ8pdx9kVeBn+s+PEAILthhEAiZjq3xwuaQc= 2022-05-26T12:58:24.357 INFO:teuthology.kill:2022-05-26 12:58:24,357.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-26T12:58:24.362 INFO:teuthology.kill:2022-05-26 12:58:24,361.361 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-26T12:58:24.445 INFO:teuthology.kill:2022-05-26 12:58:24,445.445 INFO:teuthology.orchestra.console:Power off smithi005 2022-05-26T12:58:24.460 INFO:teuthology.kill:2022-05-26 12:58:24,459.459 INFO:teuthology.orchestra.console:Power off smithi134 2022-05-26T12:58:36.935 INFO:teuthology.kill:2022-05-26 12:58:36,934.934 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-05-26T12:58:36.940 INFO:teuthology.kill:2022-05-26 12:58:36,939.939 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2022-05-26T12:58:37.099 INFO:teuthology.kill:2022-05-26 12:58:37,098.098 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2022-05-26T12:58:37.100 INFO:teuthology.kill:2022-05-26 12:58:37,100.100 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2022-05-26T13:00:37.451 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-26T13:00:37.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi005 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-26_03:05:02-rgw-quincy-distro-default-smithi/6848618 2022-05-26T13:00:37.560 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-05-26_03:05:02-rgw-quincy-distro-default-smithi/6848618