2021-11-12T19:24:54.939 INFO:root:teuthology version: 1.1.0-db255b74 2021-11-12T19:24:55.068 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging 2021-11-12T19:24:55.070 INFO:teuthology.lock.ops:Updating [ubuntu@smithi050.front.sepia.ceph.com]: reset os type and version on server 2021-11-12T19:24:55.070 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2021-11-12T19:24:55.092 INFO:teuthology.lock.ops:Node 'ubuntu@smithi050.front.sepia.ceph.com' reimaging is complete 2021-11-12T19:24:55.093 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging 2021-11-12T19:24:55.093 INFO:teuthology.lock.ops:Updating [ubuntu@smithi071.front.sepia.ceph.com]: reset os type and version on server 2021-11-12T19:24:55.094 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-11-12T19:24:55.116 INFO:teuthology.lock.ops:Node 'ubuntu@smithi071.front.sepia.ceph.com' reimaging is complete 2021-11-12T19:24:55.323 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2021-11-12T19:24:55.329 INFO:teuthology.provision.fog.smithi071:Scheduling deploy of centos 8.stream 2021-11-12T19:24:55.681 INFO:teuthology.orchestra.console:Power off smithi050 2021-11-12T19:24:55.728 INFO:teuthology.orchestra.console:Power off smithi071 2021-11-12T19:24:55.838 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2021-11-12T19:24:55.871 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-11-12T19:24:55.940 INFO:teuthology.orchestra.console:Power on smithi050 2021-11-12T19:24:55.972 INFO:teuthology.orchestra.console:Power on smithi071 2021-11-12T19:25:04.315 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2021-11-12T19:25:04.396 INFO:teuthology.orchestra.console:Power on for smithi071 completed 2021-11-12T19:25:04.416 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2021-11-12T19:25:04.497 INFO:teuthology.provision.fog.smithi071:Waiting for deploy to finish 2021-11-12T19:28:47.661 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-12T19:29:02.553 INFO:teuthology.provision.fog.smithi050:Node is ready 2021-11-12T19:29:02.574 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2021-11-12T19:29:02.634 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2021-11-12T19:29:03.018 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2021-11-12T19:29:54.660 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-12T19:29:54.933 INFO:teuthology.provision.fog.smithi071:Node is ready 2021-11-12T19:29:54.950 INFO:teuthology.orchestra.run.smithi071.stdout:smithi071.front.sepia.ceph.com 2021-11-12T19:29:55.007 INFO:teuthology.orchestra.run.smithi071.stdout:172.21.15.71 smithi071.front.sepia.ceph.com smithi071 2021-11-12T19:29:55.358 INFO:teuthology.provision.fog.smithi071:Deploy complete! 2021-11-12T19:29:55.552 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2021-11-12T19:29:55.553 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-12T19:29:55.572 INFO:teuthology.lock.ops:Checking smithi071.front.sepia.ceph.com 2021-11-12T19:29:55.573 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-12T19:29:55.592 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2021-11-12T19:29:55.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2021-11-12T19:29:55.845 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2021-11-12T19:29:55.902 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2021-11-12T19:29:55.902 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2021-11-12T19:29:55.903 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2021-11-12T19:29:55.903 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2021-11-12T19:29:55.903 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2021-11-12T19:29:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2021-11-12T19:29:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2021-11-12T19:29:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2021-11-12T19:29:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-12T19:29:55.904 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2021-11-12T19:29:55.905 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-12T19:29:55.905 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-12T19:29:55.905 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-11-12T19:29:55.907 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2021-11-12T19:29:55.925 INFO:teuthology.lock.ops:Updating [smithi071.front.sepia.ceph.com]: set os type and version on server 2021-11-12T19:29:55.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-11-12T19:29:56.113 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2021-11-12T19:29:56.169 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="CentOS Stream" 2021-11-12T19:29:56.169 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="8" 2021-11-12T19:29:56.169 INFO:teuthology.orchestra.run.smithi071.stdout:ID="centos" 2021-11-12T19:29:56.170 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE="rhel fedora" 2021-11-12T19:29:56.170 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="8" 2021-11-12T19:29:56.170 INFO:teuthology.orchestra.run.smithi071.stdout:PLATFORM_ID="platform:el8" 2021-11-12T19:29:56.170 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="CentOS Stream 8" 2021-11-12T19:29:56.171 INFO:teuthology.orchestra.run.smithi071.stdout:ANSI_COLOR="0;31" 2021-11-12T19:29:56.171 INFO:teuthology.orchestra.run.smithi071.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-12T19:29:56.171 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://centos.org/" 2021-11-12T19:29:56.172 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-11-12T19:29:56.172 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2021-11-12T19:29:56.172 INFO:teuthology.orchestra.run.smithi071.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2021-11-12T19:29:56.173 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2021-11-12T19:29:56.264 INFO:teuthology.dispatcher.supervisor:Running job 6500100 2021-11-12T19:29:56.264 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_db255b74c5deab9a7aa978613a12ae592712614e/virtualenv/bin/teuthology -v --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2021-11-12_17:44:21-orch:cephadm-wip-sage2-testing-2021-11-10-1508-distro-basic-smithi/6500100 --name sage-2021-11-12_17:44:21-orch:cephadm-wip-sage2-testing-2021-11-10-1508-distro-basic-smithi --description orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} -- /home/teuthworker/archive/sage-2021-11-12_17:44:21-orch:cephadm-wip-sage2-testing-2021-11-10-1508-distro-basic-smithi/6500100/orig.config.yaml 2021-11-12T19:29:56.268 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sage-2021-11-12_17:44:21-orch:cephadm-wip-sage2-testing-2021-11-10-1508-distro-basic-smithi/6500100 2021-11-12T19:29:56.269 INFO:teuthology.dispatcher.supervisor:Job PID: 9833 2021-11-12T19:29:56.269 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-13T07:30:50.728 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-13T07:30:50.907 INFO:teuthology.kill:Killing Pids: {9833} 2021-11-13T07:30:52.115 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2021-11-13T07:30:52.116 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-11-13T07:30:52.116 INFO:teuthology.misc:Compressing logs... 2021-11-13T07:30:52.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2021-11-13T07:30:52.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2021-11-13T07:30:52.624 INFO:teuthology.misc:Compressing logs... 2021-11-13T07:30:52.863 INFO:teuthology.misc:Compressing logs... 2021-11-13T07:30:55.619 INFO:teuthology.orchestra.run.smithi071.stderr:gzip: /var/log/ceph/af1aa0d2-43f0-11ec-8c2c-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2021-11-13T07:30:55.767 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/af1aa0d2-43f0-11ec-8c2c-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2021-11-13T07:30:56.970 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/af1aa0d2-43f0-11ec-8c2c-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2021-11-13T07:30:57.393 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/af1aa0d2-43f0-11ec-8c2c-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2021-11-13T07:31:04.526 INFO:teuthology.orchestra.run.smithi050.stderr:gzip: /var/log/ceph/af1aa0d2-43f0-11ec-8c2c-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2021-11-13T07:31:13.421 INFO:teuthology.kill:No teuthology processes running 2021-11-13T07:31:14.592 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi071'] 2021-11-13T07:31:15.562 INFO:teuthology.kill:2021-11-13 07:31:15,561.561 INFO:teuthology.nuke:targets: 2021-11-13T07:31:15.563 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmc5ldJ0Ax6jW1YcVEpwXKwICWTm43hleSjUARn0x0wWj8zAZhpjeGbVLOUlSf9+WAQ+BEb/jDbbEA1Kb8VYRY0UM9MYG0YNDGy01QSDzKaKwTHFXki0qYaKQjb9eDmYBIvjiHc7Zqy58xF/GiSI8pBjno6+IjOdgDkp6iMmKHk28Q0jzLBe3bVRTq3Szg3fYCBPPH+P3HNyy2sKkZlMBt/XzyNIX+RXxZZ9faNdjEilgGqrpRBEMQkrkQ4IZci8kywolf2AeHROeHx6o+jabjhA2jGiLjiH21nmoKquvU7w5J29yrZbdGgz3gqZvUYL9Kgzc4pgDvAZkFRxvUmn+M17lSoCHIoFfzmwwo6C3RDVhTBFYPRutmyq4Mnvc2mY3k3mz6G2NgFZu5puSDnHUMADCFJM5ywijCBzQ1yIDrY1Rg84wWgshJ3Qek7yOTotkdD6gN61JLc8g4u4Cip/u9qV+7af3Gn4vGt3ChuJMwmLnZm7kJbtQgC6N24ShDCrk= 2021-11-13T07:31:15.563 INFO:teuthology.kill: smithi071.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLfX/8QUkKBSNsr7rc5CbKGjKhE2agxIzerO4VtcWSDpv79GpHEsqBi6Y4TwboDMuLmw+TxGkjVE+u8F6mZi/lRXgMPiyUj27ET4azlCGxrL9nOHL52R8x+Vqv/o1Zkq17jHwQpiSZqEvKyNK6Kcq4KhFOwfYO3NgJ8o6vw2ohJGhOf50bZNHumV34KtPmO3wwvvE65vKJ02Y3XSmJ4Ujz6W6V1Ixkat55+jj3aeJ1UNxX6iE5Lmx9Mvdw14ii1tPywtGsV1Svt24uUu/dk/X3vYjFVHeGZpFw74rU6Bxk+MNWnxJiYPtULHVx1F+gW+bOZ0jsgWLJF7f9kdNLXxbfOIiyns3aoBgjkrR6V3wHYxP7FYeZkWrNBqFdLoE891MogIa6qkGxrA0cANRc+QmX1XtpIPCtzVMD1a8KU0pBRSoYCQV97ntzfNKOAwAaS4hFpiUNQGSmQDkqSTA4xWhmcSZ+Idk1NjsbPshmygWO36mxuuk1U0uU7Q1AHs0H8Ns= 2021-11-13T07:31:15.593 INFO:teuthology.kill:2021-11-13 07:31:15,593.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-13T07:31:15.597 INFO:teuthology.kill:2021-11-13 07:31:15,597.597 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-13T07:31:15.681 INFO:teuthology.kill:2021-11-13 07:31:15,680.680 INFO:teuthology.orchestra.console:Power off smithi071 2021-11-13T07:31:15.695 INFO:teuthology.kill:2021-11-13 07:31:15,695.695 INFO:teuthology.orchestra.console:Power off smithi050 2021-11-13T07:31:24.066 INFO:teuthology.kill:2021-11-13 07:31:24,066.066 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2021-11-13T07:31:24.214 INFO:teuthology.kill:2021-11-13 07:31:24,213.213 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2021-11-13T07:31:28.185 INFO:teuthology.kill:2021-11-13 07:31:28,184.184 INFO:teuthology.orchestra.console:Power off for smithi071 completed 2021-11-13T07:31:28.330 INFO:teuthology.kill:2021-11-13 07:31:28,329.329 INFO:teuthology.lock.ops:unlocked: smithi071.front.sepia.ceph.com 2021-11-13T07:33:28.554 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-13T07:33:28.643 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-12_14:45:22-rados-wip-yuri-testing-2021-11-11-1631-pacific-distro-basic-smithi/6499879 2021-11-13T07:33:28.643 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi071 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-12_14:45:22-rados-wip-yuri-testing-2021-11-11-1631-pacific-distro-basic-smithi/6499879