2022-01-06T17:35:08.480 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-06T17:35:08.600 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi097.front.sepia.ceph.com' reimaging
2022-01-06T17:35:08.601 INFO:teuthology.lock.ops:Updating [ubuntu@smithi097.front.sepia.ceph.com]: reset os type and version on server
2022-01-06T17:35:08.602 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-01-06T17:35:08.620 INFO:teuthology.lock.ops:Node 'ubuntu@smithi097.front.sepia.ceph.com' reimaging is complete
2022-01-06T17:35:08.621 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi104.front.sepia.ceph.com' reimaging
2022-01-06T17:35:08.621 INFO:teuthology.lock.ops:Updating [ubuntu@smithi104.front.sepia.ceph.com]: reset os type and version on server
2022-01-06T17:35:08.621 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2022-01-06T17:35:08.639 INFO:teuthology.lock.ops:Node 'ubuntu@smithi104.front.sepia.ceph.com' reimaging is complete
2022-01-06T17:35:08.845 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of ubuntu 20.04
2022-01-06T17:35:08.853 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of ubuntu 20.04
2022-01-06T17:35:09.185 INFO:teuthology.orchestra.console:Power off smithi104
2022-01-06T17:35:09.229 INFO:teuthology.orchestra.console:Power off smithi097
2022-01-06T17:35:09.373 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-01-06T17:35:09.475 INFO:teuthology.orchestra.console:Power on smithi097
2022-01-06T17:35:13.728 INFO:teuthology.orchestra.console:Power on for smithi097 completed
2022-01-06T17:35:13.829 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish
2022-01-06T17:35:17.571 INFO:teuthology.orchestra.console:Power off for smithi104 completed
2022-01-06T17:35:17.673 INFO:teuthology.orchestra.console:Power on smithi104
2022-01-06T17:35:26.157 INFO:teuthology.orchestra.console:Power on for smithi104 completed
2022-01-06T17:35:26.258 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2022-01-06T17:40:48.147 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-06T17:40:48.700 INFO:teuthology.provision.fog.smithi104:Node is ready
2022-01-06T17:40:48.706 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2022-01-06T17:40:48.714 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2022-01-06T17:40:48.949 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2022-01-06T17:40:50.445 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-01-06T17:40:50.984 INFO:teuthology.provision.fog.smithi097:Node is ready
2022-01-06T17:40:50.991 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com
2022-01-06T17:40:50.999 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097
2022-01-06T17:40:51.202 INFO:teuthology.provision.fog.smithi097:Deploy complete!
2022-01-06T17:40:51.384 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com
2022-01-06T17:40:51.385 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-06T17:40:51.439 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2022-01-06T17:40:51.440 INFO:teuthology.lock.ops:New key found. Updating...
2022-01-06T17:40:51.458 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server
2022-01-06T17:40:51.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-01-06T17:40:51.639 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64
2022-01-06T17:40:51.646 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu"
2022-01-06T17:40:51.646 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-06T17:40:51.646 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu
2022-01-06T17:40:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian
2022-01-06T17:40:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-06T17:40:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="20.04"
2022-01-06T17:40:51.647 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-06T17:40:51.648 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-06T17:40:51.648 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-06T17:40:51.648 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-06T17:40:51.648 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=focal
2022-01-06T17:40:51.649 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=focal
2022-01-06T17:40:51.650 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server
2022-01-06T17:40:51.668 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2022-01-06T17:40:51.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2022-01-06T17:40:51.846 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2022-01-06T17:40:51.853 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="Ubuntu"
2022-01-06T17:40:51.853 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="20.04.3 LTS (Focal Fossa)"
2022-01-06T17:40:51.853 INFO:teuthology.orchestra.run.smithi104.stdout:ID=ubuntu
2022-01-06T17:40:51.854 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE=debian
2022-01-06T17:40:51.854 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS"
2022-01-06T17:40:51.854 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="20.04"
2022-01-06T17:40:51.855 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://www.ubuntu.com/"
2022-01-06T17:40:51.855 INFO:teuthology.orchestra.run.smithi104.stdout:SUPPORT_URL="https://help.ubuntu.com/"
2022-01-06T17:40:51.855 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
2022-01-06T17:40:51.855 INFO:teuthology.orchestra.run.smithi104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
2022-01-06T17:40:51.855 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_CODENAME=focal
2022-01-06T17:40:51.856 INFO:teuthology.orchestra.run.smithi104.stdout:UBUNTU_CODENAME=focal
2022-01-06T17:40:51.856 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2022-01-06T17:40:51.947 INFO:teuthology.dispatcher.supervisor:Running job 6600195
2022-01-06T17:40:51.948 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2022-01-06_17:34:10-rgw:multisite-wip-yuval-rgw-params-in-multisite-distro-basic-smithi/6600195 --name yuvalif-2022-01-06_17:34:10-rgw:multisite-wip-yuval-rgw-params-in-multisite-distro-basic-smithi --description rgw:multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{ubuntu_latest} tasks/test_multi} -- /home/teuthworker/archive/yuvalif-2022-01-06_17:34:10-rgw:multisite-wip-yuval-rgw-params-in-multisite-distro-basic-smithi/6600195/orig.config.yaml
2022-01-06T17:40:51.951 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2022-01-06_17:34:10-rgw:multisite-wip-yuval-rgw-params-in-multisite-distro-basic-smithi/6600195
2022-01-06T17:40:51.952 INFO:teuthology.dispatcher.supervisor:Job PID: 22364
2022-01-06T17:40:51.952 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-01-07T05:41:46.547 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-01-07T05:41:47.444 INFO:teuthology.kill:Killing Pids: {22364}
2022-01-07T05:41:48.622 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1']
2022-01-07T05:41:48.623 INFO:teuthology.task.internal:roles: ubuntu@smithi104.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']
2022-01-07T05:41:48.623 INFO:teuthology.misc:Compressing logs...
2022-01-07T05:41:48.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com'
2022-01-07T05:41:48.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2022-01-07T05:41:49.532 INFO:teuthology.misc:Compressing logs...
2022-01-07T05:41:49.680 INFO:teuthology.misc:Compressing logs...
2022-01-07T06:00:01.627 INFO:teuthology.kill:No teuthology processes running
2022-01-07T06:00:02.882 INFO:teuthology.kill:Nuking machines: ['smithi097', 'smithi104']
2022-01-07T06:00:03.937 INFO:teuthology.kill:2022-01-07 06:00:03,936.936 INFO:teuthology.nuke:targets:
2022-01-07T06:00:03.937 INFO:teuthology.kill:  smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMXKDQuaP0M33GDLb0fh3+0J5HxL1mz5VaKr6kKKopU6Vv/J+QOQxpoMjCx/btILDtbU6ixSlsgxDbXZf1QeFzI9dnTZ5RpiKjXq3K0L9NfEw6wSxCX30KQ8ljd5heyBB/70EBYmqBbJrslW/LVTekXthZ5hVXW3p9ujgh4rHSM4hEwUH0IpgkZdzU39AmL5pwpLtbbk0NU9n1TSffL7Aidp0+eE+cAUxwmrl/4kXbFkyxGKmz1r/3UimKfVHw4dy9UAcktFRyCt3GtpN/OBqvJivv27tPkFBGJGW8voZg4xeIl27aMg5SU1+2yF9fVHQDE7P7bdkGW4JhrUxKVRKntIhFrizi8DWrE6vELQcuDh/TE/BjszgTgmdXeSkgEeNZX3ZxODidH+zznC7mDbKBeZuY9sYCxnmkbBUxwjL5eaViNGRmUZFK8a4Gp1GABOL7f+INvSBr2hhctop+m8UAFMtc3d/t37+QslWh8zd8H+n5nvLoQ39XMb4rFhIpyzU=
2022-01-07T06:00:03.938 INFO:teuthology.kill:  smithi104.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXk5ccopMBMmiJ+Vh/noFOoMvv6azgam4FFn6pf017fCAOG6RpVR4mKl6CxC6F+V5+05S0mNvDpkP3XZmzjD73i4FOHXmU93sNZKkGIY9OybodFNGWx0lymwvkSkcHnu1+MyIpTHNyo56iAlvkscc0U4gOPRNHDR5Cme28zenOFi0hPBRivVt0vSF6RyzniK92bO4W+QDmj9S6L7MexJlRj3J8V3PSaJ6DVDAG1fdCFtLm1JarJ3qLYicXudtdSMwyfs0OQ2BySVLNrHfsjefho9D/s9+IIELVnOSNlMIxrgy/4i6VQ3jLNBTj8F3O1UJIovlGqAi7T74WoEYxkGVXsMlMqZz9wu8pHtt0eSy24qvJVeyxXyWXVcYBNYtiB4H3/C3/v6uwf0zxt8E7JKRgzzKU2pk9fzuMGLhZIrro5oC8Qe+wA7Er/SsoWo12QHIgZ9LR8oBB6k+FJmiHSdh7MunZKq/+u2+7W3kHf+T+YnQd5NZ46x8snreolYmXzhk=
2022-01-07T06:00:03.965 INFO:teuthology.kill:2022-01-07 06:00:03,965.965 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-07T06:00:03.969 INFO:teuthology.kill:2022-01-07 06:00:03,969.969 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-01-07T06:00:04.045 INFO:teuthology.kill:2022-01-07 06:00:04,045.045 INFO:teuthology.orchestra.console:Power off smithi104
2022-01-07T06:00:04.060 INFO:teuthology.kill:2022-01-07 06:00:04,060.060 INFO:teuthology.orchestra.console:Power off smithi097
2022-01-07T06:00:12.416 INFO:teuthology.kill:2022-01-07 06:00:12,416.416 INFO:teuthology.orchestra.console:Power off for smithi104 completed
2022-01-07T06:00:12.562 INFO:teuthology.kill:2022-01-07 06:00:12,561.561 INFO:teuthology.lock.ops:unlocked: smithi104.front.sepia.ceph.com
2022-01-07T06:00:16.547 INFO:teuthology.kill:2022-01-07 06:00:16,546.546 INFO:teuthology.orchestra.console:Power off for smithi097 completed
2022-01-07T06:00:16.708 INFO:teuthology.kill:2022-01-07 06:00:16,708.708 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com
2022-01-07T06:02:17.117 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-01-07T06:02:17.215 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi097 but it was locked by another job: /home/teuthworker/archive/gsalomon-2022-01-07_05:11:04-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6600680
2022-01-07T06:02:17.216 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi104 but it was locked by another job: /home/teuthworker/archive/gsalomon-2022-01-07_05:11:04-rgw:verify-wip-s3select-parquet-object-processing-2-distro-basic-smithi/6600680