2021-11-28T15:55:14.757 INFO:root:teuthology version: 1.1.0-a0bc3188 2021-11-28T15:55:14.883 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging 2021-11-28T15:55:14.884 INFO:teuthology.lock.ops:Updating [ubuntu@smithi109.front.sepia.ceph.com]: reset os type and version on server 2021-11-28T15:55:14.884 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server 2021-11-28T15:55:14.903 INFO:teuthology.lock.ops:Node 'ubuntu@smithi109.front.sepia.ceph.com' reimaging is complete 2021-11-28T15:55:14.904 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging 2021-11-28T15:55:14.904 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server 2021-11-28T15:55:14.904 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-11-28T15:55:14.924 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete 2021-11-28T15:55:15.111 INFO:teuthology.provision.fog.smithi109:Scheduling deploy of ubuntu 20.04 2021-11-28T15:55:15.123 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of ubuntu 20.04 2021-11-28T15:55:15.438 INFO:teuthology.orchestra.console:Power off smithi109 2021-11-28T15:55:15.455 INFO:teuthology.orchestra.console:Power off smithi134 2021-11-28T15:55:15.586 INFO:teuthology.orchestra.console:Power off for smithi109 completed 2021-11-28T15:55:15.597 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-11-28T15:55:15.688 INFO:teuthology.orchestra.console:Power on smithi109 2021-11-28T15:55:15.698 INFO:teuthology.orchestra.console:Power on smithi134 2021-11-28T15:55:19.947 INFO:teuthology.orchestra.console:Power on for smithi109 completed 2021-11-28T15:55:19.982 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2021-11-28T15:55:20.049 INFO:teuthology.provision.fog.smithi109:Waiting for deploy to finish 2021-11-28T15:55:20.084 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2021-11-28T16:00:55.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-28T16:00:55.644 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-28T16:00:56.089 INFO:teuthology.provision.fog.smithi134:Node is ready 2021-11-28T16:00:56.157 INFO:teuthology.provision.fog.smithi109:Node is ready 2021-11-28T16:00:56.192 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2021-11-28T16:00:56.408 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2021-11-28T16:00:56.409 INFO:teuthology.orchestra.run.smithi109.stdout:smithi109.front.sepia.ceph.com 2021-11-28T16:00:56.464 INFO:teuthology.orchestra.run.smithi109.stdout:172.21.15.109 smithi109.front.sepia.ceph.com smithi109 2021-11-28T16:00:56.872 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2021-11-28T16:00:56.946 INFO:teuthology.provision.fog.smithi109:Deploy complete! 2021-11-28T16:00:57.673 INFO:teuthology.lock.ops:Checking smithi109.front.sepia.ceph.com 2021-11-28T16:00:57.674 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-28T16:00:57.828 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2021-11-28T16:00:57.828 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-28T16:00:57.945 INFO:teuthology.lock.ops:Updating [smithi109.front.sepia.ceph.com]: set os type and version on server 2021-11-28T16:00:57.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-11-28T16:00:58.528 INFO:teuthology.orchestra.run.smithi109.stdout:x86_64 2021-11-28T16:00:58.596 INFO:teuthology.orchestra.run.smithi109.stdout:NAME="Ubuntu" 2021-11-28T16:00:58.597 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-28T16:00:58.597 INFO:teuthology.orchestra.run.smithi109.stdout:ID=ubuntu 2021-11-28T16:00:58.597 INFO:teuthology.orchestra.run.smithi109.stdout:ID_LIKE=debian 2021-11-28T16:00:58.597 INFO:teuthology.orchestra.run.smithi109.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-28T16:00:58.598 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_ID="20.04" 2021-11-28T16:00:58.598 INFO:teuthology.orchestra.run.smithi109.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-28T16:00:58.598 INFO:teuthology.orchestra.run.smithi109.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-28T16:00:58.608 INFO:teuthology.orchestra.run.smithi109.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-28T16:00:58.608 INFO:teuthology.orchestra.run.smithi109.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-28T16:00:58.608 INFO:teuthology.orchestra.run.smithi109.stdout:VERSION_CODENAME=focal 2021-11-28T16:00:58.609 INFO:teuthology.orchestra.run.smithi109.stdout:UBUNTU_CODENAME=focal 2021-11-28T16:00:58.610 INFO:teuthology.lock.ops:Updating smithi109.front.sepia.ceph.com on lock server 2021-11-28T16:00:58.674 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2021-11-28T16:00:58.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2021-11-28T16:00:59.076 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-11-28T16:00:59.126 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2021-11-28T16:00:59.127 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-11-28T16:00:59.129 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2021-11-28T16:00:59.129 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2021-11-28T16:00:59.132 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-11-28T16:00:59.135 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="20.04" 2021-11-28T16:00:59.137 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2021-11-28T16:00:59.141 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-11-28T16:00:59.141 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-11-28T16:00:59.141 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-11-28T16:00:59.141 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=focal 2021-11-28T16:00:59.142 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=focal 2021-11-28T16:00:59.183 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-11-28T16:00:59.739 INFO:teuthology.dispatcher.supervisor:Running job 6532033 2021-11-28T16:00:59.739 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a0bc318848afe71da1fbf34e1e1b44738d8e3d6d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-11-28_15:46:54-rgw-pacific-16.2.7_RC1-distro-default-smithi/6532033 --name yuriw-2021-11-28_15:46:54-rgw-pacific-16.2.7_RC1-distro-default-smithi --description rgw/multisite/{clusters frontend/civetweb ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2021-11-28_15:46:54-rgw-pacific-16.2.7_RC1-distro-default-smithi/6532033/orig.config.yaml 2021-11-28T16:00:59.843 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-11-28_15:46:54-rgw-pacific-16.2.7_RC1-distro-default-smithi/6532033 2021-11-28T16:00:59.845 INFO:teuthology.dispatcher.supervisor:Job PID: 10596 2021-11-28T16:00:59.845 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-29T04:01:51.514 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-29T04:01:51.687 INFO:teuthology.kill:Killing Pids: {10596} 2021-11-29T04:01:52.836 INFO:teuthology.task.internal:roles: ubuntu@smithi109.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-11-29T04:01:52.837 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-11-29T04:01:52.837 INFO:teuthology.misc:Compressing logs... 2021-11-29T04:01:52.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi109.front.sepia.ceph.com' 2021-11-29T04:01:53.014 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2021-11-29T04:01:53.363 INFO:teuthology.misc:Compressing logs... 2021-11-29T04:01:53.480 INFO:teuthology.misc:Compressing logs... 2021-11-29T04:05:28.788 INFO:teuthology.kill:No teuthology processes running 2021-11-29T04:05:29.917 INFO:teuthology.kill:Nuking machines: ['smithi109', 'smithi134'] 2021-11-29T04:05:30.883 INFO:teuthology.kill:2021-11-29 04:05:30,882.882 INFO:teuthology.nuke:targets: 2021-11-29T04:05:30.883 INFO:teuthology.kill: smithi109.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdEfyRdQo6QbJsVPs5Qp1Nmt3WjNFUYra/55ruQaKdkIQ8sroocp5PH3hil8KgUWAjGUXSIb5PqCxHUzjvOImVXX6LgYLeRQ+N6H4oNDBH5D/+Hk9tRlZeLYyXNuxUfpewYL7lIJRSDKx13jSUj9ldfoRGJjZ+sQjBBiYXIgZabVU7R3cb7K/+J/G9adGPR1TjcAdoMPxQ769GKx4UWNXeHJ9lxKkV+sCabh/gZAp30NQFGrqaLwOSW0w6ALmPlHze2Mq1ooVMoIVTAicsruJv52awmfMd08rK4w8b7IEtWd7C6jlvDUtblbnr/Y5EZVXSGSTTgXS7eo/8HQOeThzPJy5Wsdk7WwTEgAGUzz9ZUUqBbiqnmoeBXUeCdCEzVbrjAeEaz1fqn7s9Gx4Rw6PdAVQa9jGEv4Jb/ObXLZplaLN7IVeLHGSlMEQ2xCS4XBoYsjjmAWjLelgVznSdyUlxuS8Rdh4C2bfpNarz3uitBNdiQHPjtuJKKjxXaOxeToM= 2021-11-29T04:05:30.884 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC61YXG+vQnLY9/S2wZs15FokjH9zXdzUMDthfRne1XK9gL+7UUr9YVqdfh5k6BCWj/iCQ7ZSEQyuzngUY0xsSv6icIiNs8QieFxeF8meLEbmwv2hUGqYZHP3+DqB3vGeyOMC3jIuaKo5L01mf0ZtgH0YwixiIYZGFVidwi+4JWeHo+ntvfHB6nl6dtynryP1Gkcq+QY15wdvuQaYxjZ7z4o/NeJTVpF48BOjDdBHJe4ROxBKBDzr9dv14XX/P4WA0NaQy+tgpE30r1Q4LOubXF/xx92yw83wP9uxIcqtGf6QmeHfNjVvOBgYQv8W6PppWFG93nqhFv9HA2CMnszI1a+QlZj5l53O2QKMFDRdI5S2UBHZkkMCkfroLq5jgGfiXl1Xc+vCBs5k6IlSgacyibdw8nzz2srUhkcqx/udlHMeoA/38wzxMiHF/f2FDITiaF7OVBLOWM70jtyEU12AeIgz5AmtewjrnsPdkE5sN4Jwi0WMZX3VP73b48kfKvjEk= 2021-11-29T04:05:30.910 INFO:teuthology.kill:2021-11-29 04:05:30,909.909 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-29T04:05:30.913 INFO:teuthology.kill:2021-11-29 04:05:30,913.913 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-29T04:05:30.988 INFO:teuthology.kill:2021-11-29 04:05:30,987.987 INFO:teuthology.orchestra.console:Power off smithi134 2021-11-29T04:05:31.002 INFO:teuthology.kill:2021-11-29 04:05:31,002.002 INFO:teuthology.orchestra.console:Power off smithi109 2021-11-29T04:05:39.363 INFO:teuthology.kill:2021-11-29 04:05:39,363.363 INFO:teuthology.orchestra.console:Power off for smithi109 completed 2021-11-29T04:05:39.509 INFO:teuthology.kill:2021-11-29 04:05:39,509.509 INFO:teuthology.lock.ops:unlocked: smithi109.front.sepia.ceph.com 2021-11-29T04:05:43.472 INFO:teuthology.kill:2021-11-29 04:05:43,472.472 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-11-29T04:05:43.619 INFO:teuthology.kill:2021-11-29 04:05:43,619.619 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2021-11-29T04:07:43.860 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15