2022-01-04T18:38:47.229 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-04T18:38:47.348 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi052.front.sepia.ceph.com' reimaging
2022-01-04T18:38:47.349 INFO:teuthology.lock.ops:Updating [ubuntu@smithi052.front.sepia.ceph.com]: reset os type and version on server
2022-01-04T18:38:47.350 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-01-04T18:38:47.366 INFO:teuthology.lock.ops:Node 'ubuntu@smithi052.front.sepia.ceph.com' reimaging is complete
2022-01-04T18:38:47.367 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging
2022-01-04T18:38:47.367 INFO:teuthology.lock.ops:Updating [ubuntu@smithi074.front.sepia.ceph.com]: reset os type and version on server
2022-01-04T18:38:47.367 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2022-01-04T18:38:47.387 INFO:teuthology.lock.ops:Node 'ubuntu@smithi074.front.sepia.ceph.com' reimaging is complete
2022-01-04T18:38:47.596 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of ubuntu 20.04
2022-01-04T18:38:47.599 INFO:teuthology.provision.fog.smithi052:Scheduling deploy of ubuntu 20.04
2022-01-04T18:38:47.950 INFO:teuthology.orchestra.console:Power off smithi052
2022-01-04T18:38:47.988 INFO:teuthology.orchestra.console:Power off smithi074
2022-01-04T18:38:56.327 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-01-04T18:38:56.429 INFO:teuthology.orchestra.console:Power on smithi052
2022-01-04T18:39:00.460 INFO:teuthology.orchestra.console:Power off for smithi074 completed
2022-01-04T18:39:00.562 INFO:teuthology.orchestra.console:Power on smithi074
2022-01-04T18:39:04.804 INFO:teuthology.orchestra.console:Power on for smithi052 completed
2022-01-04T18:39:04.811 INFO:teuthology.orchestra.console:Power on for smithi074 completed
2022-01-04T18:39:04.906 INFO:teuthology.provision.fog.smithi052:Waiting for deploy to finish
2022-01-04T18:39:04.912 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish
2022-01-04T18:41:51.240 ERROR:teuthology.orchestra.connection:Error authenticating with smithi052.front.sepia.ceph.com: Authentication failed.
2022-01-04T18:44:22.996 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-04T18:44:23.566 INFO:teuthology.provision.fog.smithi052:Node is ready
2022-01-04T18:44:23.573 INFO:teuthology.orchestra.run.smithi052.stdout:smithi052.front.sepia.ceph.com
2022-01-04T18:44:23.580 INFO:teuthology.orchestra.run.smithi052.stdout:172.21.15.52 smithi052.front.sepia.ceph.com smithi052
2022-01-04T18:44:23.816 INFO:teuthology.provision.fog.smithi052:Deploy complete!
2022-01-04T18:44:55.358 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-04T18:44:55.923 INFO:teuthology.provision.fog.smithi074:Node is ready
2022-01-04T18:44:55.930 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com
2022-01-04T18:44:55.984 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074
2022-01-04T18:44:56.170 INFO:teuthology.provision.fog.smithi074:Deploy complete!
2022-01-04T18:44:56.376 INFO:teuthology.lock.ops:Checking smithi052.front.sepia.ceph.com
2022-01-04T18:44:56.377 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-04T18:44:56.396 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com
2022-01-04T18:44:56.397 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-04T18:44:56.417 INFO:teuthology.lock.ops:Updating [smithi052.front.sepia.ceph.com]: set os type and version on server
2022-01-04T18:44:56.418 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-01-04T18:44:56.600 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64
2022-01-04T18:44:56.649 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu"
2022-01-04T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-04T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu
2022-01-04T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian
2022-01-04T18:44:56.650 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-04T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="20.04"
2022-01-04T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-04T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-04T18:44:56.651 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-04T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-04T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=focal
2022-01-04T18:44:56.652 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=focal
2022-01-04T18:44:56.653 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server
2022-01-04T18:44:56.672 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server
2022-01-04T18:44:56.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com'
2022-01-04T18:44:56.838 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64
2022-01-04T18:44:56.891 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="Ubuntu"
2022-01-04T18:44:56.892 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-04T18:44:56.892 INFO:teuthology.orchestra.run.smithi074.stdout:ID=ubuntu
2022-01-04T18:44:56.892 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE=debian
2022-01-04T18:44:56.892 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-04T18:44:56.893 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="20.04"
2022-01-04T18:44:56.893 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-04T18:44:56.893 INFO:teuthology.orchestra.run.smithi074.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-04T18:44:56.893 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-04T18:44:56.894 INFO:teuthology.orchestra.run.smithi074.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-04T18:44:56.894 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_CODENAME=focal
2022-01-04T18:44:56.894 INFO:teuthology.orchestra.run.smithi074.stdout:UBUNTU_CODENAME=focal
2022-01-04T18:44:56.894 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server
2022-01-04T18:44:56.980 INFO:teuthology.dispatcher.supervisor:Running job 6594836
2022-01-04T18:44:56.980 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-01-04_18:35:54-rgw-wip-yuri10-testing-2022-01-04-0850-pacific-distro-default-smithi/6594836 --name yuriw-2022-01-04_18:35:54-rgw-wip-yuri10-testing-2022-01-04-0850-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-01-04_18:35:54-rgw-wip-yuri10-testing-2022-01-04-0850-pacific-distro-default-smithi/6594836/orig.config.yaml
2022-01-04T18:44:56.983 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-01-04_18:35:54-rgw-wip-yuri10-testing-2022-01-04-0850-pacific-distro-default-smithi/6594836
2022-01-04T18:44:56.984 INFO:teuthology.dispatcher.supervisor:Job PID: 19029
2022-01-04T18:44:56.984 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-05T06:45:16.898 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-05T06:45:17.124 INFO:teuthology.kill:Killing Pids: {19029}
2022-01-05T06:45:18.337 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-01-05T06:45:18.338 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-01-05T06:45:18.339 INFO:teuthology.misc:Compressing logs...
2022-01-05T06:45:18.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com'
2022-01-05T06:45:18.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com'
2022-01-05T06:45:18.826 INFO:teuthology.misc:Compressing logs...
2022-01-05T06:45:18.953 INFO:teuthology.misc:Compressing logs...
2022-01-05T06:48:54.042 INFO:teuthology.kill:No teuthology processes running
2022-01-05T06:48:55.239 INFO:teuthology.kill:Nuking machines: ['smithi052', 'smithi074']
2022-01-05T06:48:56.252 INFO:teuthology.kill:2022-01-05 06:48:56,251.251 INFO:teuthology.nuke:targets:
2022-01-05T06:48:56.253 INFO:teuthology.kill:  smithi052.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIshejfppF+liGwBWu4ODSjIjwUXyYzXTa1C8umyB5pONMJNyScZ3++oCcs5OQ63YQcPRkFEEwCFeoxE1tawYsJ+kRY6asngG4sdJkWSZmN+2QyLgCGaxZLp85z+2tFFiT8jcC+Sqqigxe+390OZSofaNCZRhQoqHw/+p+mLVWUQpCIrXeCP8F4iDnOxLkE/caql+AsHDWB+p4WZ96be9L0ubvNrcbDHDFkfat8lMJqkPalgN2usCwE2TjP3sqewILnSdsYHluI8K8W6haovTaeGf/1yT3XVa+lIve/uy+z0BqzJbqFLalc9TaZgwkJiXLZH2CC5VqwO9rbT+JPWL+XfBMNBURO/lWB1Yq71cxSfo6qAr1OxTkwOjVCV6u+JK/O7W3ptGLncyAoOXoGE1sguGHqDzfcN/68bzdZBM1qlDIm6n3GDAS9a2X3HwuGVAMg/Ikek3G2o6qm713CEauHS+hdLH8fpETXeO9dZbnIqB8/gvLFQFTKSbWbi8dn9k=
2022-01-05T06:48:56.253 INFO:teuthology.kill:  smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8QM7OFQj0y3dCCrzz1m8ANDN36Q6ncVtq9rBqKe3B8WJsIyFj7NUqnxiQdBxDGTUnG3IAtb0h5SPCDkG3UupKSNJe1mrLCJZi8z+F5AbHe2/FFY+Bruvqyaq2wtJmxoZuwNRzNTuAN2m5M2Iz1g/UAv1gRiKGd3TnsMdFrR5ON+8Gi7K+kjCMMIDd2ZgzlmOCAdrqFE5K5qTL4s4621oga1MP85m5L5mOMhMhvGl9yRDC01RICGbRYII8V+PIQ3JMk9mKYXjR9VSvMJb+kG9cnCsEv9gNyY5cQme/6Xnfll5/Jye/O+GaB1eii5xwu2EjXnjaI/WZsO/IkI8nC/7YEZLCDuzjQlRcNPStMVbgD514fy+uTYgtYDnhgCwG0zy0jNsLjko+6xDskD6+8op9KgDd7CKaoNMYIWtRrqpG/S/mcVdh3bDwb9PeMKSGCqaSPbtNzUy8c2djK/nsGgUXBjR7rctQ8/ybGG1sdApeST0OGaMKmm8x7SNdtf3bvMc=
2022-01-05T06:48:56.279 INFO:teuthology.kill:2022-01-05 06:48:56,279.279 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-05T06:48:56.283 INFO:teuthology.kill:2022-01-05 06:48:56,283.283 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-05T06:48:56.359 INFO:teuthology.kill:2022-01-05 06:48:56,358.358 INFO:teuthology.orchestra.console:Power off smithi052
2022-01-05T06:48:56.377 INFO:teuthology.kill:2022-01-05 06:48:56,377.377 INFO:teuthology.orchestra.console:Power off smithi074
2022-01-05T06:49:04.737 INFO:teuthology.kill:2022-01-05 06:49:04,736.736 INFO:teuthology.orchestra.console:Power off for smithi052 completed
2022-01-05T06:49:04.741 INFO:teuthology.kill:2022-01-05 06:49:04,741.741 INFO:teuthology.orchestra.console:Power off for smithi074 completed
2022-01-05T06:49:04.891 INFO:teuthology.kill:2022-01-05 06:49:04,890.890 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com
2022-01-05T06:49:04.894 INFO:teuthology.kill:2022-01-05 06:49:04,894.894 INFO:teuthology.lock.ops:unlocked: smithi052.front.sepia.ceph.com
2022-01-05T06:51:05.138 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-05T06:51:05.238 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi052 but it was locked by another job: /home/teuthworker/archive/sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi/6595093
2022-01-05T06:51:05.238 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/sage-2022-01-04_21:11:23-rados-wip-sage2-testing-2022-01-03-1413-distro-basic-smithi/6595093