2022-04-27T07:29:52.349 INFO:root:teuthology version: 1.1.1.dev326+g135488ac 2022-04-27T07:29:52.472 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2022-04-27T07:29:52.473 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2022-04-27T07:29:52.473 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-04-27T07:29:52.491 INFO:teuthology.lock.ops:Node 'smithi111.front.sepia.ceph.com' reimaging is complete 2022-04-27T07:29:52.492 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2022-04-27T07:29:52.492 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2022-04-27T07:29:52.492 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2022-04-27T07:29:52.511 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete 2022-04-27T07:29:52.709 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 20.04 2022-04-27T07:29:52.745 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of ubuntu 20.04 2022-04-27T07:29:53.085 INFO:teuthology.orchestra.console:Power off smithi111 2022-04-27T07:29:53.141 INFO:teuthology.orchestra.console:Power off smithi167 2022-04-27T07:30:05.566 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-04-27T07:30:05.609 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2022-04-27T07:30:05.668 INFO:teuthology.orchestra.console:Power on smithi111 2022-04-27T07:30:05.732 INFO:teuthology.orchestra.console:Power on smithi167 2022-04-27T07:30:09.984 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2022-04-27T07:30:10.084 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2022-04-27T07:30:14.054 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2022-04-27T07:30:14.155 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2022-04-27T07:35:21.215 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-27T07:35:21.864 INFO:teuthology.provision.fog.smithi167:Node is ready 2022-04-27T07:35:21.872 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2022-04-27T07:35:21.924 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2022-04-27T07:35:22.102 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2022-04-27T07:35:40.319 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-27T07:35:40.787 INFO:teuthology.provision.fog.smithi111:Node is ready 2022-04-27T07:35:40.853 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2022-04-27T07:35:40.901 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2022-04-27T07:35:41.087 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2022-04-27T07:35:41.283 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2022-04-27T07:35:41.284 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-27T07:35:41.304 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2022-04-27T07:35:41.305 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-27T07:35:41.331 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2022-04-27T07:35:41.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-04-27T07:35:41.644 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2022-04-27T07:35:41.717 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2022-04-27T07:35:41.718 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-27T07:35:41.718 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2022-04-27T07:35:41.718 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2022-04-27T07:35:41.719 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-27T07:35:41.719 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="20.04" 2022-04-27T07:35:41.719 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-27T07:35:41.720 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-27T07:35:41.721 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-27T07:35:41.722 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-27T07:35:41.723 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=focal 2022-04-27T07:35:41.724 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=focal 2022-04-27T07:35:41.727 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2022-04-27T07:35:41.746 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2022-04-27T07:35:41.747 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2022-04-27T07:35:42.095 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="20.04" 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-27T07:35:42.102 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-27T07:35:42.103 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-27T07:35:42.103 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-27T07:35:42.103 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=focal 2022-04-27T07:35:42.103 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=focal 2022-04-27T07:35:42.103 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2022-04-27T07:35:42.212 INFO:teuthology.dispatcher.supervisor:Running job 6808141 2022-04-27T07:35:42.213 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-27_03:01:17-rgw-pacific-distro-default-smithi/6808141 --name yuriw-2022-04-27_03:01:17-rgw-pacific-distro-default-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/two-zonegroup tasks/test_multi valgrind} -- /home/teuthworker/archive/yuriw-2022-04-27_03:01:17-rgw-pacific-distro-default-smithi/6808141/orig.config.yaml 2022-04-27T07:35:42.217 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-27_03:01:17-rgw-pacific-distro-default-smithi/6808141 2022-04-27T07:35:42.217 INFO:teuthology.dispatcher.supervisor:Job PID: 24369 2022-04-27T07:35:42.217 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-27T14:06:11.583 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-27T14:06:11.743 INFO:teuthology.kill:Killing Pids: {24369} 2022-04-27T14:06:13.043 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2022-04-27T14:06:13.044 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2022-04-27T14:06:13.044 INFO:teuthology.misc:Compressing logs... 2022-04-27T14:06:13.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2022-04-27T14:06:13.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2022-04-27T14:06:13.724 INFO:teuthology.misc:Compressing logs... 2022-04-27T14:06:13.854 INFO:teuthology.misc:Compressing logs... 2022-04-27T14:08:13.553 INFO:teuthology.kill:No teuthology processes running 2022-04-27T14:08:14.908 INFO:teuthology.kill:Nuking machines: ['smithi111', 'smithi167'] 2022-04-27T14:08:16.186 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-04-27T14:08:16.186 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-04-27T14:08:16.186 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_135488acc76a85490d37201ec506706cc4ab2d62/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-04-27T14:08:16.187 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-04-27T14:08:16.187 INFO:teuthology.kill:2022-04-27 14:08:16,185.185 INFO:teuthology.nuke:targets: 2022-04-27T14:08:16.187 INFO:teuthology.kill: smithi111.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD4fB8Fjx6QM3kq3tr5Joy3aR5nxzPj0Bnk6LYsz/JZjHNYM6wHKzo+O2cNROKd2Kt8R01HDwcuzbYyxJrZ/niVLQwCbrMFE4KWWFvCOTf29gVF68T26TqBCge7R+272N0IOSsmvILnZlxIfZuUlsZ7SrWwO3PiEGAzZPwYSyHHliHSBKYqRRZGjmYYNboN4zGZ4dVeaNLtV9k12A6852DU476pLrEsO0ex77jo9hsLilHelzq6eFaF3TwhGDY62yGvbYh1HREW69puhXo6oW2QGwLwRLtbvWo3swJV5v9bbgWj+poS+/kuA6v9/lQpMH1TJPX9W9ZOf67S99SfyTvw6nW2PLebUQqYwQJXsCzqLgY8mWGN069fSrC59GgmLEdVEfgpv75GA2SxWI7HOBeJ9axDm3TnErvN4bAF4pdgtmUPGAzQKipl5GRFSquvrGYukkwT/3KpMjylxRbXNSDuPVAe1uHNSAUWeD0RdCbGce1GYFINRnZCfQo4q16qV0E= 2022-04-27T14:08:16.187 INFO:teuthology.kill: smithi167.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyo66jIOQvfztlD2bW5zzI1AQnRLwKblmw5yuteBFLXHDhbw7LTnVNTPLvClXTw/yo/Zddn1qpRJN7EJb5Z+3e8huyvpbBEN0A/a4rXTilQJ/w1tmamu5RkiXEOtpRbEI9FTSGjGR6BdwBm+ULkYN76Pe+8hs6+pvdJS8x0CDUie7MniB6tI5HvW8LjLfrId7x791cJEeqAOXOeNFo0cNNxPewGAfrOhX24bYaGgQ2V29K1iAaKt1b8OatsZx41Pu3dBQkGbKPYuriFhHQ/D+4WBiebzizkhvenzHbK2ygxC1ClxtVtzH8NwCWpLYlCA3I8q0PjIINWBbf3XhwdL2hnrBbQ5vgkz7BEdlAp2maBPio6CYsEX4Gi7iv3o3Rl223R8JLrMRUilgHJ0LneqH36pEMX02qddThFeQfAqM5iJ4hFYlpu2NOIrIji4MdIlysuWYUEbb0d7Il2AM3qEm2/9XorhSdqxKLrwZZWt8/Q1JdkrAVBzNZv4p1ZyqAnxE= 2022-04-27T14:08:16.217 INFO:teuthology.kill:2022-04-27 14:08:16,217.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-27T14:08:16.221 INFO:teuthology.kill:2022-04-27 14:08:16,221.221 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-27T14:08:16.287 INFO:teuthology.kill:2022-04-27 14:08:16,287.287 INFO:teuthology.orchestra.console:Power off smithi167 2022-04-27T14:08:16.299 INFO:teuthology.kill:2022-04-27 14:08:16,298.298 INFO:teuthology.orchestra.console:Power off smithi111 2022-04-27T14:08:28.759 INFO:teuthology.kill:2022-04-27 14:08:28,759.759 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2022-04-27T14:08:28.765 INFO:teuthology.kill:2022-04-27 14:08:28,764.764 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2022-04-27T14:08:28.909 INFO:teuthology.kill:2022-04-27 14:08:28,908.908 INFO:teuthology.lock.ops:unlocked: smithi111.front.sepia.ceph.com 2022-04-27T14:08:28.912 INFO:teuthology.kill:2022-04-27 14:08:28,912.912 INFO:teuthology.lock.ops:unlocked: smithi167.front.sepia.ceph.com 2022-04-27T14:10:29.252 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-27T14:10:29.346 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi111 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-27_03:06:13-rbd-pacific-distro-default-smithi/6808472 2022-04-27T14:10:29.346 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi167 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-27_03:06:13-rbd-pacific-distro-default-smithi/6808472