2021-11-07T12:06:07.404 INFO:root:teuthology version: 1.1.0-27954452 2021-11-07T12:06:07.530 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging 2021-11-07T12:06:07.531 INFO:teuthology.lock.ops:Updating [ubuntu@smithi063.front.sepia.ceph.com]: reset os type and version on server 2021-11-07T12:06:07.531 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2021-11-07T12:06:07.550 INFO:teuthology.lock.ops:Node 'ubuntu@smithi063.front.sepia.ceph.com' reimaging is complete 2021-11-07T12:06:07.550 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging 2021-11-07T12:06:07.550 INFO:teuthology.lock.ops:Updating [ubuntu@smithi114.front.sepia.ceph.com]: reset os type and version on server 2021-11-07T12:06:07.551 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2021-11-07T12:06:07.572 INFO:teuthology.lock.ops:Node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging is complete 2021-11-07T12:06:07.807 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of centos 8.stream 2021-11-07T12:06:07.810 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.stream 2021-11-07T12:06:08.249 INFO:teuthology.orchestra.console:Power off smithi063 2021-11-07T12:06:08.266 INFO:teuthology.orchestra.console:Power off smithi114 2021-11-07T12:06:20.739 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2021-11-07T12:06:20.744 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2021-11-07T12:06:20.841 INFO:teuthology.orchestra.console:Power on smithi063 2021-11-07T12:06:20.849 INFO:teuthology.orchestra.console:Power on smithi114 2021-11-07T12:06:25.102 INFO:teuthology.orchestra.console:Power on for smithi063 completed 2021-11-07T12:06:25.204 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2021-11-07T12:06:29.228 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2021-11-07T12:06:29.329 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2021-11-07T12:11:19.271 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-07T12:11:19.577 INFO:teuthology.provision.fog.smithi114:Node is ready 2021-11-07T12:11:19.594 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2021-11-07T12:11:19.652 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2021-11-07T12:11:19.990 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2021-11-07T12:11:30.022 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-07T12:11:30.353 INFO:teuthology.provision.fog.smithi063:Node is ready 2021-11-07T12:11:30.371 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063.front.sepia.ceph.com 2021-11-07T12:11:30.428 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2021-11-07T12:11:30.906 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2021-11-07T12:11:31.049 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2021-11-07T12:11:31.050 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-07T12:11:31.069 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2021-11-07T12:11:31.069 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-07T12:11:31.086 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2021-11-07T12:11:31.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2021-11-07T12:11:31.274 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2021-11-07T12:11:31.330 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2021-11-07T12:11:31.330 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2021-11-07T12:11:31.330 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2021-11-07T12:11:31.331 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2021-11-07T12:11:31.331 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2021-11-07T12:11:31.331 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2021-11-07T12:11:31.331 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2021-11-07T12:11:31.332 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2021-11-07T12:11:31.332 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-07T12:11:31.332 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2021-11-07T12:11:31.332 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-07T12:11:31.332 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-07T12:11:31.333 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-11-07T12:11:31.334 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2021-11-07T12:11:31.354 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2021-11-07T12:11:31.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2021-11-07T12:11:31.590 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2021-11-07T12:11:31.646 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2021-11-07T12:11:31.647 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2021-11-07T12:11:31.647 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2021-11-07T12:11:31.647 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2021-11-07T12:11:31.647 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2021-11-07T12:11:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2021-11-07T12:11:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2021-11-07T12:11:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2021-11-07T12:11:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-07T12:11:31.648 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2021-11-07T12:11:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-07T12:11:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-07T12:11:31.649 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-11-07T12:11:31.650 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2021-11-07T12:11:31.735 INFO:teuthology.dispatcher.supervisor:Running job 6489967 2021-11-07T12:11:31.736 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_27954452159076fda5642b6c0eb0c4998b99d2e4/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2021-11-07_12:02:32-rgw-wip-matanb-lua-rgw-map-2021-11-03B-distro-basic-smithi/6489967 --name matan-2021-11-07_12:02:32-rgw-wip-matanb-lua-rgw-map-2021-11-03B-distro-basic-smithi --description rgw/multisite/{clusters frontend/beast ignore-pg-availability omap_limits overrides realms/three-zone-plus-pubsub supported-random-distro$/{centos_8.stream} tasks/test_multi} -- /home/teuthworker/archive/matan-2021-11-07_12:02:32-rgw-wip-matanb-lua-rgw-map-2021-11-03B-distro-basic-smithi/6489967/orig.config.yaml 2021-11-07T12:11:31.739 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2021-11-07_12:02:32-rgw-wip-matanb-lua-rgw-map-2021-11-03B-distro-basic-smithi/6489967 2021-11-07T12:11:31.740 INFO:teuthology.dispatcher.supervisor:Job PID: 4681 2021-11-07T12:11:31.740 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-08T00:12:25.831 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-08T00:12:26.007 INFO:teuthology.kill:Killing Pids: {4681} 2021-11-08T00:12:27.219 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-11-08T00:12:27.220 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-11-08T00:12:27.220 INFO:teuthology.misc:Compressing logs... 2021-11-08T00:12:27.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2021-11-08T00:12:27.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2021-11-08T00:12:27.768 INFO:teuthology.misc:Compressing logs... 2021-11-08T00:12:27.931 INFO:teuthology.misc:Compressing logs... 2021-11-08T00:22:26.025 INFO:teuthology.kill:No teuthology processes running 2021-11-08T00:22:27.188 INFO:teuthology.kill:Nuking machines: ['smithi063', 'smithi114'] 2021-11-08T00:22:28.193 INFO:teuthology.kill:2021-11-08 00:22:28,193.193 INFO:teuthology.nuke:targets: 2021-11-08T00:22:28.195 INFO:teuthology.kill: smithi063.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYFHfaPJLXonVJH5R9Pxzl3eDwW+2nB4Us9QBD0S1D9LQEkoJHRd1M2SC+gRkldxKYJ8O67y6bzpEdOhIlimW74xTnR6miFhMYHS83d3qU2+v67SGmn7OoMRFFqfFU8ATYz8uUef4zFQbjz/pG8f3mlZxDOBAtLT2C7hXUjcqrjtz1gmTskhWx8cEhBX7lLCDcvPxwnC1iGomrqvmFLnFK09DIqMFcgQawVWGQsMsL/iuOFgB1M0quULKezW0jhTDZSb8PJKBwtvcjZCcg3qRkHNbRRwzu85QKUtQK0XlZf2epl3UzaE88x3oZoAJNDxHZVQXePBhxcLiSioS/th2v7/JoTsS2JwawcUL2LLPGFBcnn/u0LZdO5dfWqXEQrOTiNpozAj5v9X8J1aRzByr3Kt3soKcrE89DmKtytnpbgCvOVY18oFm0RRQO1aH5kkC2704dkzQFn/bhvCHNgBVOpC+cvD5jnySHRdOI93u/G4mBpn9FJ5jJ8mkCEK1MvtM= 2021-11-08T00:22:28.195 INFO:teuthology.kill: smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXzOG5U7lhlO7SVeRvFFflTm0+x9ZQz231WVAKnDRpGvMzcBiTaKB6CXoDA47f88gkif5jFy5is0/NvNSChLOOoFhsD1rJF80O4spmbyzHdakuQw7c2ugkQOSlKI9wbl3+CpGQMMZoPY6knQGCXGw26G5LcSFolfLyyN0wGTosH6hGWiTH4sEADggjQd8AlpXBWGOeIeo2qLR1W3Sjkn8PTaKDNV/j9AILqG2d4ujm1RPTB8rlbLb2hHK7WDaeyy6a9pC9M7ILowMkRWwLvFvqPflSP9BKV0hqS5u2R1tUr/i/CnAMH34yopeNtqnfAgpEBhb8LLtCC2kjDSLVpfZN/SO3IDTgcekxc77nop7vCxt0uVLKsfJVIOIfdD22uXch6h6Uz+7QMuohN5FRxieQYGYFkZEex3Q9oGUmHVrK3oaFZThz9F+6RUlPu8lEsmmFyXpPZ5uq1zTyGXt+YdomFWvT7NbKe7GCyp8uBqz5UOAWOsuqtRMQHlj7DFHBPrE= 2021-11-08T00:22:28.219 INFO:teuthology.kill:2021-11-08 00:22:28,219.219 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-08T00:22:28.223 INFO:teuthology.kill:2021-11-08 00:22:28,222.222 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-08T00:22:28.305 INFO:teuthology.kill:2021-11-08 00:22:28,304.304 INFO:teuthology.orchestra.console:Power off smithi063 2021-11-08T00:22:28.318 INFO:teuthology.kill:2021-11-08 00:22:28,317.317 INFO:teuthology.orchestra.console:Power off smithi114 2021-11-08T00:22:40.794 INFO:teuthology.kill:2021-11-08 00:22:40,793.793 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2021-11-08T00:22:40.798 INFO:teuthology.kill:2021-11-08 00:22:40,798.798 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2021-11-08T00:22:40.953 INFO:teuthology.kill:2021-11-08 00:22:40,952.952 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2021-11-08T00:22:40.957 INFO:teuthology.kill:2021-11-08 00:22:40,957.957 INFO:teuthology.lock.ops:unlocked: smithi063.front.sepia.ceph.com 2021-11-08T00:24:41.262 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-08T00:24:41.359 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi063 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-05_18:36:21-rados-wip-yuri2-testing-2021-11-05-0903-pacific-distro-basic-smithi/6487652 2021-11-08T00:24:41.360 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi114 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-05_18:36:21-rados-wip-yuri2-testing-2021-11-05-0903-pacific-distro-basic-smithi/6487652