2022-04-11T14:08:21.397 INFO:root:teuthology version: 1.1.0-a347b2ac 2022-04-11T14:08:21.520 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging 2022-04-11T14:08:21.521 INFO:teuthology.lock.ops:Updating [ubuntu@smithi170.front.sepia.ceph.com]: reset os type and version on server 2022-04-11T14:08:21.522 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-04-11T14:08:21.539 INFO:teuthology.lock.ops:Node 'ubuntu@smithi170.front.sepia.ceph.com' reimaging is complete 2022-04-11T14:08:21.540 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging 2022-04-11T14:08:21.540 INFO:teuthology.lock.ops:Updating [ubuntu@smithi189.front.sepia.ceph.com]: reset os type and version on server 2022-04-11T14:08:21.540 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2022-04-11T14:08:21.558 INFO:teuthology.lock.ops:Node 'ubuntu@smithi189.front.sepia.ceph.com' reimaging is complete 2022-04-11T14:08:21.747 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of centos 8.stream 2022-04-11T14:08:21.761 INFO:teuthology.provision.fog.smithi189:Scheduling deploy of centos 8.stream 2022-04-11T14:08:22.122 INFO:teuthology.orchestra.console:Power off smithi170 2022-04-11T14:08:22.167 INFO:teuthology.orchestra.console:Power off smithi189 2022-04-11T14:08:30.500 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-04-11T14:08:30.602 INFO:teuthology.orchestra.console:Power on smithi170 2022-04-11T14:08:34.649 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2022-04-11T14:08:34.751 INFO:teuthology.orchestra.console:Power on smithi189 2022-04-11T14:08:39.061 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2022-04-11T14:08:39.162 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2022-04-11T14:08:43.113 INFO:teuthology.orchestra.console:Power on for smithi189 completed 2022-04-11T14:08:43.214 INFO:teuthology.provision.fog.smithi189:Waiting for deploy to finish 2022-04-11T14:13:08.301 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-11T14:13:08.592 INFO:teuthology.provision.fog.smithi170:Node is ready 2022-04-11T14:13:08.648 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2022-04-11T14:13:08.705 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2022-04-11T14:13:09.036 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2022-04-11T14:13:36.540 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-11T14:13:36.842 INFO:teuthology.provision.fog.smithi189:Node is ready 2022-04-11T14:13:36.860 INFO:teuthology.orchestra.run.smithi189.stdout:smithi189.front.sepia.ceph.com 2022-04-11T14:13:36.919 INFO:teuthology.orchestra.run.smithi189.stdout:172.21.15.189 smithi189.front.sepia.ceph.com smithi189 2022-04-11T14:13:37.272 INFO:teuthology.provision.fog.smithi189:Deploy complete! 2022-04-11T14:13:37.455 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2022-04-11T14:13:37.456 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-11T14:13:37.480 INFO:teuthology.lock.ops:Checking smithi189.front.sepia.ceph.com 2022-04-11T14:13:37.481 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-11T14:13:37.498 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2022-04-11T14:13:37.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-04-11T14:13:37.759 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2022-04-11T14:13:37.817 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2022-04-11T14:13:37.817 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8" 2022-04-11T14:13:37.817 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2022-04-11T14:13:37.818 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2022-04-11T14:13:37.818 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8" 2022-04-11T14:13:37.818 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2022-04-11T14:13:37.818 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-11T14:13:37.818 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2022-04-11T14:13:37.819 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-11T14:13:37.819 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2022-04-11T14:13:37.819 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-11T14:13:37.820 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-11T14:13:37.820 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-11T14:13:37.821 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-04-11T14:13:37.839 INFO:teuthology.lock.ops:Updating [smithi189.front.sepia.ceph.com]: set os type and version on server 2022-04-11T14:13:37.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2022-04-11T14:13:38.031 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2022-04-11T14:13:38.089 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="CentOS Stream" 2022-04-11T14:13:38.089 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="8" 2022-04-11T14:13:38.089 INFO:teuthology.orchestra.run.smithi189.stdout:ID="centos" 2022-04-11T14:13:38.090 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE="rhel fedora" 2022-04-11T14:13:38.090 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="8" 2022-04-11T14:13:38.090 INFO:teuthology.orchestra.run.smithi189.stdout:PLATFORM_ID="platform:el8" 2022-04-11T14:13:38.090 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-11T14:13:38.091 INFO:teuthology.orchestra.run.smithi189.stdout:ANSI_COLOR="0;31" 2022-04-11T14:13:38.091 INFO:teuthology.orchestra.run.smithi189.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-11T14:13:38.091 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://centos.org/" 2022-04-11T14:13:38.091 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-11T14:13:38.091 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-11T14:13:38.092 INFO:teuthology.orchestra.run.smithi189.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-11T14:13:38.092 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2022-04-11T14:13:38.180 INFO:teuthology.dispatcher.supervisor:Running job 6786675 2022-04-11T14:13:38.180 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a347b2ac5400a43ba76a678399b1deda7dae1a6c/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2022-04-11_14:07:33-rgw:notifications-wip-yuval-sync-notifications-distro-basic-smithi/6786675 --name yuvalif-2022-04-11_14:07:33-rgw:notifications-wip-yuval-sync-notifications-distro-basic-smithi --description rgw:notifications/{beast bluestore-bitmap fixed-2 overrides supported-all-distro$/{centos_8} tasks/{0-install test_amqp test_kafka test_others}} -- /home/teuthworker/archive/yuvalif-2022-04-11_14:07:33-rgw:notifications-wip-yuval-sync-notifications-distro-basic-smithi/6786675/orig.config.yaml 2022-04-11T14:13:38.183 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2022-04-11_14:07:33-rgw:notifications-wip-yuval-sync-notifications-distro-basic-smithi/6786675 2022-04-11T14:13:38.184 INFO:teuthology.dispatcher.supervisor:Job PID: 8682 2022-04-11T14:13:38.185 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-11T20:44:06.647 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-11T20:44:06.790 INFO:teuthology.kill:Killing Pids: {8682} 2022-04-11T20:44:07.916 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-04-11T20:44:07.917 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-11T20:44:07.918 INFO:teuthology.misc:Compressing logs... 2022-04-11T20:44:07.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-04-11T20:44:08.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2022-04-11T20:44:08.620 INFO:teuthology.misc:Compressing logs... 2022-04-11T20:44:08.762 INFO:teuthology.misc:Compressing logs... 2022-04-11T20:54:10.117 INFO:teuthology.kill:No teuthology processes running 2022-04-11T20:54:11.302 INFO:teuthology.kill:Nuking machines: ['smithi170', 'smithi189'] 2022-04-11T20:54:12.250 INFO:teuthology.kill:2022-04-11 20:54:12,250.250 INFO:teuthology.nuke:targets: 2022-04-11T20:54:12.251 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCxfX01l7ARyWzefuP8DWzdgIfv/JoYJQ4chKzhlfRqKAdnQ14/kf8hGuDiAxNSbOs6n161dQ3jhANMkNAQZmJP45Xt22+b5Ocjd7GMMTxzJk+YI4463SMHJ2O2oUq0TVXJnftJfLKaMpn5kYu1G/9z26KjRKQ8IPtPwu0LG5Q7B5cQug8ExivCdgRo0I8PQ7XxY9b3fopsP9p8f7X1EodGRhHMf0dowXstB1kXm5HZce0xkV8AwtriyMv8py4EYYSS9RrbAMYJyuOFb9PjIgmb4enJnTaG7BKUZNgdn/+HkJMG8QNMf5ftwDrXhQk7odxNnc03n/FOv3+Be6sqm9rGdG3YNeCyEcdpanJGexErx/xx6+OUIV4RDpqcA7wRKMR24Lo6/LUTqPT+SWwKgCsZ6VdLrH0zDutT+HnEP/o0crzmbfmkCVExl+e9iGXdZS5EHpkt8k8Idh2VBR8ikd9K5YIHed/FU6snTr6Tizjf1Pfhs34CQY3ON/lCbhKbddU= 2022-04-11T20:54:12.251 INFO:teuthology.kill: smithi189.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAf3qGJj59TvNxbr1VUQ338HHjgQJacuX7pUNBU4D4LB6mzntD7xtEynSTKr8ywqxPm4BmaARqpsySUc1/DbxUEkCRX5hJEEfRzCKRCM3lssPlewPU7ZIar9Au+gA7JhRW0xYoYL8NXtQ5ScDIV9pXukMUZxoMXBvm40J+MzJZkDHvQirSeXjz5kYk78vaaYZ69q6XsicFDTUeFmyOncniA2DOW/n88UwF8NXxNsPZZpt67lU1WtVN9PMigDqc8qCbuF/e2SNIaMkGPjltveR727XB0RgqL4h3eO1svcGarPrXPspOmYgnKTYRPxQZDtCVg8YcbhinxwJ7Cc/v1gk5uzSmIRsSNodoZMmo9B2yALiVOr9cpBWSKom3cpAz9GeYyrHQWovuhUtcymPMTEqi09G+JUtbbckAYoSZgUjX8Jx6C7nIy3w3rM0tVcYGVQ6sdLj7Q1t1Ue3tRHrpwTvL+VXXSfDFs3u0tf1xuzrkS31ghrdpWDnNN0zXU4jSgms= 2022-04-11T20:54:12.277 INFO:teuthology.kill:2022-04-11 20:54:12,277.277 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-11T20:54:12.280 INFO:teuthology.kill:2022-04-11 20:54:12,280.280 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-11T20:54:12.353 INFO:teuthology.kill:2022-04-11 20:54:12,353.353 INFO:teuthology.orchestra.console:Power off smithi170 2022-04-11T20:54:12.365 INFO:teuthology.kill:2022-04-11 20:54:12,365.365 INFO:teuthology.orchestra.console:Power off smithi189 2022-04-11T20:54:20.731 INFO:teuthology.kill:2022-04-11 20:54:20,730.730 INFO:teuthology.orchestra.console:Power off for smithi189 completed 2022-04-11T20:54:20.879 INFO:teuthology.kill:2022-04-11 20:54:20,878.878 INFO:teuthology.lock.ops:unlocked: smithi189.front.sepia.ceph.com 2022-04-11T20:54:24.839 INFO:teuthology.kill:2022-04-11 20:54:24,838.838 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-04-11T20:54:24.984 INFO:teuthology.kill:2022-04-11 20:54:24,984.984 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2022-04-11T20:56:25.294 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-11T20:56:25.386 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/dis-2022-04-11_19:09:08-rbd-wip-dis-testing-1-distro-default-smithi/6787513