2022-01-20T06:25:53.921 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-20T06:25:54.176 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging
2022-01-20T06:25:54.177 INFO:teuthology.lock.ops:Updating [ubuntu@smithi110.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T06:25:54.177 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-20T06:25:54.199 INFO:teuthology.lock.ops:Node 'ubuntu@smithi110.front.sepia.ceph.com' reimaging is complete
2022-01-20T06:25:54.199 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging
2022-01-20T06:25:54.200 INFO:teuthology.lock.ops:Updating [ubuntu@smithi125.front.sepia.ceph.com]: reset os type and version on server
2022-01-20T06:25:54.200 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-01-20T06:25:54.220 INFO:teuthology.lock.ops:Node 'ubuntu@smithi125.front.sepia.ceph.com' reimaging is complete
2022-01-20T06:25:54.423 INFO:teuthology.provision.fog.smithi110:Scheduling deploy of ubuntu 20.04
2022-01-20T06:25:54.441 INFO:teuthology.provision.fog.smithi125:Scheduling deploy of ubuntu 20.04
2022-01-20T06:25:54.872 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-20T06:25:55.103 INFO:teuthology.orchestra.console:Power off smithi125
2022-01-20T06:26:07.363 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-20T06:26:07.465 INFO:teuthology.orchestra.console:Power on smithi110
2022-01-20T06:26:07.582 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-01-20T06:26:07.684 INFO:teuthology.orchestra.console:Power on smithi125
2022-01-20T06:26:11.724 INFO:teuthology.orchestra.console:Power on for smithi110 completed
2022-01-20T06:26:11.825 INFO:teuthology.provision.fog.smithi110:Waiting for deploy to finish
2022-01-20T06:26:16.052 INFO:teuthology.orchestra.console:Power on for smithi125 completed
2022-01-20T06:26:16.153 INFO:teuthology.provision.fog.smithi125:Waiting for deploy to finish
2022-01-20T06:31:13.948 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T06:31:14.448 INFO:teuthology.provision.fog.smithi110:Node is ready
2022-01-20T06:31:14.455 INFO:teuthology.orchestra.run.smithi110.stdout:smithi110.front.sepia.ceph.com
2022-01-20T06:31:14.506 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.15.110 smithi110.front.sepia.ceph.com smithi110
2022-01-20T06:31:14.688 INFO:teuthology.provision.fog.smithi110:Deploy complete!
2022-01-20T06:31:25.890 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-20T06:31:26.408 INFO:teuthology.provision.fog.smithi125:Node is ready
2022-01-20T06:31:26.457 INFO:teuthology.orchestra.run.smithi125.stdout:smithi125.front.sepia.ceph.com
2022-01-20T06:31:26.465 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.15.125 smithi125.front.sepia.ceph.com smithi125
2022-01-20T06:31:26.604 INFO:teuthology.provision.fog.smithi125:Deploy complete!
2022-01-20T06:31:26.838 INFO:teuthology.lock.ops:Checking smithi110.front.sepia.ceph.com
2022-01-20T06:31:26.839 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T06:31:26.860 INFO:teuthology.lock.ops:Checking smithi125.front.sepia.ceph.com
2022-01-20T06:31:26.861 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-20T06:31:26.879 INFO:teuthology.lock.ops:Updating [smithi110.front.sepia.ceph.com]: set os type and version on server
2022-01-20T06:31:26.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-20T06:31:27.197 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64
2022-01-20T06:31:27.204 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu"
2022-01-20T06:31:27.204 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-20T06:31:27.204 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu
2022-01-20T06:31:27.205 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian
2022-01-20T06:31:27.205 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-20T06:31:27.205 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="20.04"
2022-01-20T06:31:27.205 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-20T06:31:27.206 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-20T06:31:27.206 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-20T06:31:27.206 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-20T06:31:27.206 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=focal
2022-01-20T06:31:27.207 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=focal
2022-01-20T06:31:27.208 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server
2022-01-20T06:31:27.225 INFO:teuthology.lock.ops:Updating [smithi125.front.sepia.ceph.com]: set os type and version on server
2022-01-20T06:31:27.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-01-20T06:31:27.390 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64
2022-01-20T06:31:27.396 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="Ubuntu"
2022-01-20T06:31:27.397 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-20T06:31:27.397 INFO:teuthology.orchestra.run.smithi125.stdout:ID=ubuntu
2022-01-20T06:31:27.397 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE=debian
2022-01-20T06:31:27.397 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-20T06:31:27.398 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="20.04"
2022-01-20T06:31:27.398 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-20T06:31:27.398 INFO:teuthology.orchestra.run.smithi125.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-20T06:31:27.398 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-20T06:31:27.398 INFO:teuthology.orchestra.run.smithi125.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-20T06:31:27.399 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_CODENAME=focal
2022-01-20T06:31:27.399 INFO:teuthology.orchestra.run.smithi125.stdout:UBUNTU_CODENAME=focal
2022-01-20T06:31:27.399 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server
2022-01-20T06:31:27.525 INFO:teuthology.dispatcher.supervisor:Running job 6628555
2022-01-20T06:31:27.525 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_75f1bcd237a8b6022305cd53ba87e106d45aa665/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-01-20_05:07:02-rgw-pacific-distro-default-smithi/6628555 --name teuthology-2022-01-20_05:07:02-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/teuthology-2022-01-20_05:07:02-rgw-pacific-distro-default-smithi/6628555/orig.config.yaml
2022-01-20T06:31:27.529 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-01-20_05:07:02-rgw-pacific-distro-default-smithi/6628555
2022-01-20T06:31:27.530 INFO:teuthology.dispatcher.supervisor:Job PID: 31260
2022-01-20T06:31:27.530 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-20T13:01:55.943 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-01-20T13:01:56.140 INFO:teuthology.kill:Killing Pids: {31260}
2022-01-20T13:01:57.358 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-01-20T13:01:57.359 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-01-20T13:01:57.359 INFO:teuthology.misc:Compressing logs...
2022-01-20T13:01:57.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com'
2022-01-20T13:01:57.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com'
2022-01-20T13:01:57.889 INFO:teuthology.misc:Compressing logs...
2022-01-20T13:01:58.169 INFO:teuthology.misc:Compressing logs...
2022-01-20T13:04:08.214 INFO:teuthology.kill:No teuthology processes running
2022-01-20T13:04:09.504 INFO:teuthology.kill:Nuking machines: ['smithi110', 'smithi125']
2022-01-20T13:04:10.503 INFO:teuthology.kill:2022-01-20 13:04:10,503.503 INFO:teuthology.nuke:targets:
2022-01-20T13:04:10.504 INFO:teuthology.kill:  smithi110.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf6MxXwe0NJBuVO1A8wwQAmpTeMbjAmqQS1/x+qXEwAOFrPyaIiN+Cn45Op0WBbu9K4njw4oE0nL+DgirEzYaGnP+KvV66iMEHEtflrgauD8Y5UOlYiYVODUyRpaKOTc/FyPPTdyIXw/JI0tpkDx65EONWTHS6gphB4og9S8irbWZThoCvsHwcj8bM9+pSYtRhrUb77aFnQKID8w3TefzutB3346ap+A7+ntw2W6l6TcfcukN9GvTdWB2lXORL1G5xERT0ymBCWuGALJcijSOK23ChZU6phtwUJ6EzFnA2ggNBgwBIa7nEbwfdQENLFZs42AUt9SUS/aT5RLS6JpvoUklnBWI5cFkAi1A5Eeyo485sCK5O2mssbS4cWOP+JijSF+Xni85LBH7V34nCgGTQcrRwSoihzI9gdloqSv9mrS3db0VPUvkJpztB1l+ef4/yU1zHnRRiRfj4jd9T6Gdv1y9T6sCvV2q3k6KTDOxtVCisTqjo5yenQKaSXbiYDBs=
2022-01-20T13:04:10.504 INFO:teuthology.kill:  smithi125.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQ+/q50gshszJUy4Fg7cyA0lTVKLrSsfBOODtgfDBrV1hIYGivfOy21y44CzdEU6G7QFg/TnxuJhdN6dn/g5xoPDP6avioUwBrjJQoCvgRDD8VUZmFUfvx7fA0ci6Kdsubb87MawJbfzw6vm4m7MUz8v53LxsEDILV3TYTe52zGHhEyYLvb9Ra6eVMUZ2JkVqnO27UrtPdN8HCb9gT2BiLP4Ybm33NuFJVdD0bjYO8FTzW0d/214CCpVg4O5q0zoOmHdT8D+W1RVapRZAr+sO4RJPByizbGLkMmpI1humLYMeSo4ahH3IUVOefajm6nudqYQUSxkvyYanYHg8zSkInIPgKQz3dJ2FXU9skVdllxxOZEE4AzrgeekRxukHOzvqn9fuZFSGf0q6M92rxFd5Ws/hCYGNe12hgbSo97jE/LtYOrOi4TDoaGACcd4ln9IS5v6tS0RFCtZnyarpkltlBKaeLLbbU8Q8p63RqDyWg1ulB35C05pjJOdXG23Ve950=
2022-01-20T13:04:10.530 INFO:teuthology.kill:2022-01-20 13:04:10,530.530 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T13:04:10.534 INFO:teuthology.kill:2022-01-20 13:04:10,533.533 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-20T13:04:10.608 INFO:teuthology.kill:2022-01-20 13:04:10,608.608 INFO:teuthology.orchestra.console:Power off smithi110
2022-01-20T13:04:10.626 INFO:teuthology.kill:2022-01-20 13:04:10,625.625 INFO:teuthology.orchestra.console:Power off smithi125
2022-01-20T13:04:18.992 INFO:teuthology.kill:2022-01-20 13:04:18,992.992 INFO:teuthology.orchestra.console:Power off for smithi125 completed
2022-01-20T13:04:19.137 INFO:teuthology.kill:2022-01-20 13:04:19,136.136 INFO:teuthology.lock.ops:unlocked: smithi125.front.sepia.ceph.com
2022-01-20T13:04:23.089 INFO:teuthology.kill:2022-01-20 13:04:23,089.089 INFO:teuthology.orchestra.console:Power off for smithi110 completed
2022-01-20T13:04:23.235 INFO:teuthology.kill:2022-01-20 13:04:23,235.235 INFO:teuthology.lock.ops:unlocked: smithi110.front.sepia.ceph.com
2022-01-20T13:06:23.550 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-20T13:06:23.652 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi110 but it was locked by another job: /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623988
2022-01-20T13:06:23.652 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi125 but it was locked by another job: /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623988