2022-04-05T14:37:17.352 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-05T14:37:17.531 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging 2022-04-05T14:37:17.532 INFO:teuthology.lock.ops:Updating [ubuntu@smithi081.front.sepia.ceph.com]: reset os type and version on server 2022-04-05T14:37:17.533 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2022-04-05T14:37:17.552 INFO:teuthology.lock.ops:Node 'ubuntu@smithi081.front.sepia.ceph.com' reimaging is complete 2022-04-05T14:37:17.552 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-04-05T14:37:17.552 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-04-05T14:37:17.553 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-05T14:37:17.577 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-04-05T14:37:17.764 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream 2022-04-05T14:37:17.807 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2022-04-05T14:37:18.132 INFO:teuthology.orchestra.console:Power off smithi081 2022-04-05T14:37:18.175 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-05T14:37:18.283 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2022-04-05T14:37:18.313 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-05T14:37:18.385 INFO:teuthology.orchestra.console:Power on smithi081 2022-04-05T14:37:18.415 INFO:teuthology.orchestra.console:Power on smithi163 2022-04-05T14:37:26.754 INFO:teuthology.orchestra.console:Power on for smithi081 completed 2022-04-05T14:37:26.773 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-04-05T14:37:26.856 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish 2022-04-05T14:37:26.874 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-04-05T14:41:58.773 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-05T14:41:59.021 INFO:teuthology.provision.fog.smithi081:Node is ready 2022-04-05T14:41:59.044 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com 2022-04-05T14:41:59.104 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081 2022-04-05T14:41:59.458 INFO:teuthology.provision.fog.smithi081:Deploy complete! 2022-04-05T14:42:12.534 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-05T14:42:37.807 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-04-05T14:42:37.825 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-04-05T14:42:37.882 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-04-05T14:42:38.311 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-04-05T14:42:38.466 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com 2022-04-05T14:42:38.467 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-05T14:42:38.493 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-04-05T14:42:38.493 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-05T14:42:38.511 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server 2022-04-05T14:42:38.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2022-04-05T14:42:38.753 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2022-04-05T14:42:38.809 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2022-04-05T14:42:38.810 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8" 2022-04-05T14:42:38.810 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2022-04-05T14:42:38.810 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2022-04-05T14:42:38.811 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8" 2022-04-05T14:42:38.811 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2022-04-05T14:42:38.811 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-05T14:42:38.811 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2022-04-05T14:42:38.811 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-05T14:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2022-04-05T14:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-05T14:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-05T14:42:38.812 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-05T14:42:38.814 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2022-04-05T14:42:38.832 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-04-05T14:42:38.832 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-05T14:42:39.019 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-04-05T14:42:39.076 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2022-04-05T14:42:39.077 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-04-05T14:42:39.077 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-04-05T14:42:39.077 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-04-05T14:42:39.078 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-04-05T14:42:39.078 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-04-05T14:42:39.078 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-05T14:42:39.078 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-04-05T14:42:39.078 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-05T14:42:39.079 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-04-05T14:42:39.079 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-05T14:42:39.079 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-05T14:42:39.079 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-05T14:42:39.080 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-05T14:42:39.176 INFO:teuthology.dispatcher.supervisor:Running job 6777883 2022-04-05T14:42:39.176 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-05_14:13:24-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777883 --name yuriw-2022-04-05_14:13:24-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi --description orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2022-04-05_14:13:24-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777883/orig.config.yaml 2022-04-05T14:42:39.179 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-05_14:13:24-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6777883 2022-04-05T14:42:39.180 INFO:teuthology.dispatcher.supervisor:Job PID: 2478 2022-04-05T14:42:39.180 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-05T21:13:07.360 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-05T21:13:07.541 INFO:teuthology.kill:Killing Pids: {2478} 2022-04-05T21:13:08.694 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-04-05T21:13:08.695 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-04-05T21:13:08.695 INFO:teuthology.misc:Compressing logs... 2022-04-05T21:13:08.696 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2022-04-05T21:13:08.919 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-05T21:13:09.328 INFO:teuthology.misc:Compressing logs... 2022-04-05T21:13:09.527 INFO:teuthology.misc:Compressing logs... 2022-04-05T21:13:20.149 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-04-05T21:13:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-04-05T21:13:31.718 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-04-05T21:13:34.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-04-05T21:13:43.845 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-04-05T21:13:49.665 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-04-05T21:13:53.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-04-05T21:13:53.728 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-04-05T21:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-04-05T21:13:56.632 INFO:teuthology.orchestra.run.smithi163.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-04-05T21:14:04.993 INFO:teuthology.orchestra.run.smithi081.stderr:gzip: /var/log/ceph/75086ada-b4ef-11ec-8c36-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-04-05T21:14:26.068 INFO:teuthology.kill:No teuthology processes running 2022-04-05T21:14:27.258 INFO:teuthology.kill:Nuking machines: ['smithi081', 'smithi163'] 2022-04-05T21:14:28.276 INFO:teuthology.kill:2022-04-05 21:14:28,275.275 INFO:teuthology.nuke:targets: 2022-04-05T21:14:28.277 INFO:teuthology.kill: smithi081.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD0A03hWVPBp8zjm+WOx6t0PLGAglbWLc0zOwNkxKTFa0k/QZNn7o16jwEoJPwEBXIZld4aQugbNmq+fUubxPlITakh3p29J9ESyJXIviY7SjEaXIwbYaHxdeZcgJ533v4TeaEb7BoGohHi72AYaFprnSRFRharF45aRUC0V/eQgYgpKmr3mj94tatVH/GQeY3289U5Z3go4f4hRsTsIBIZPjSBI3JY9bxZ6x1c98KNw5fTJibyfqUNm71fN09swxIf63bsX7HeDqJB7gKbe8svBL8H1kqu5rEfGdMF9C3jl3tQbeqT6Wy7nnRtz/IhYQMQbaMcDLKDBf3zKZPRDOQBfK9G4Tb62pxLLBCEOnTHwZ1xliJFipN/j/p+tnEakzFGMPe0j07hx44qOF+agCEN/hPFDPZlQkQbnrWBreEC5uAvkK2a5UgGwWLjSqjmi1QE8truXsYXrM+CfK2ptsx/Ues4HNLVDY8fZUFm4TXJUH2ypFxJ2L8WrE5sCT+Ylo8= 2022-04-05T21:14:28.277 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6Av+kUuWjumY99q61whW5y4XXVzdafBb82F0NmvdSL+JUGyuB8NBsu3RkEUgqZr+sJ+vZkAXQQcOFuCcgf4IqknL7Txif3iLZOXSXdz5Oucr1bSyZ1/DZVGfe/pww9xdwMnTSo8+sLFYRBN1KsuGP8KRshQHhAtGs+168vGN+27dhRcUc5sjwNfWg9ejfRgzMLce4V+RGE+LN+H5bOaFmf3r0exU9/UdH56KSLW0XKmJN0/y5FK+WLG8wevWzyb1531QbjSEIX0SCtf5C95BcskH7faHO2DoECF/Y9ogIW7/86ExAtFb8CH8DH21KsCE5fQKhMbfnK0u/Yx66Ae4FWUn7AiEIaQJo9DUQjp2hq+8Qqj1laPiwSA2LGTJcBJx0Ub8x+FQeiGrriAPrhUuCIa3EuNODE88d2EeX1Cu9dA99OFhtOhW4P8IyExubRXQfcMUEbcIcS1i03cDxu29fxCK83bTsSt1/CjOYRh8LDkkBFZuw8nzGwVnF6ar6IaU= 2022-04-05T21:14:28.303 INFO:teuthology.kill:2022-04-05 21:14:28,302.302 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T21:14:28.306 INFO:teuthology.kill:2022-04-05 21:14:28,306.306 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T21:14:28.385 INFO:teuthology.kill:2022-04-05 21:14:28,384.384 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-05T21:14:28.400 INFO:teuthology.kill:2022-04-05 21:14:28,400.400 INFO:teuthology.orchestra.console:Power off smithi081 2022-04-05T21:14:40.873 INFO:teuthology.kill:2022-04-05 21:14:40,872.872 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-05T21:14:40.884 INFO:teuthology.kill:2022-04-05 21:14:40,884.884 INFO:teuthology.orchestra.console:Power off for smithi081 completed 2022-04-05T21:14:41.022 INFO:teuthology.kill:2022-04-05 21:14:41,021.021 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-04-05T21:14:41.025 INFO:teuthology.kill:2022-04-05 21:14:41,025.025 INFO:teuthology.lock.ops:unlocked: smithi081.front.sepia.ceph.com 2022-04-05T21:16:41.339 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-05T21:16:41.427 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi081 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-05_05:15:02-krbd-octopus-testing-default-smithi/6777791 2022-04-05T21:16:41.428 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-04-05_05:15:02-krbd-octopus-testing-default-smithi/6777792