2022-04-04T22:57:58.448 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-04T22:57:58.573 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi097.front.sepia.ceph.com' reimaging 2022-04-04T22:57:58.574 INFO:teuthology.lock.ops:Updating [ubuntu@smithi097.front.sepia.ceph.com]: reset os type and version on server 2022-04-04T22:57:58.575 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2022-04-04T22:57:58.593 INFO:teuthology.lock.ops:Node 'ubuntu@smithi097.front.sepia.ceph.com' reimaging is complete 2022-04-04T22:57:58.593 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging 2022-04-04T22:57:58.594 INFO:teuthology.lock.ops:Updating [ubuntu@smithi183.front.sepia.ceph.com]: reset os type and version on server 2022-04-04T22:57:58.594 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-04-04T22:57:58.612 INFO:teuthology.lock.ops:Node 'ubuntu@smithi183.front.sepia.ceph.com' reimaging is complete 2022-04-04T22:57:58.807 INFO:teuthology.provision.fog.smithi097:Scheduling deploy of ubuntu 18.04 2022-04-04T22:57:58.841 INFO:teuthology.provision.fog.smithi183:Scheduling deploy of ubuntu 18.04 2022-04-04T22:57:59.190 INFO:teuthology.orchestra.console:Power off smithi097 2022-04-04T22:57:59.239 INFO:teuthology.orchestra.console:Power off smithi183 2022-04-04T22:58:11.689 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2022-04-04T22:58:11.716 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-04-04T22:58:11.792 INFO:teuthology.orchestra.console:Power on smithi097 2022-04-04T22:58:11.821 INFO:teuthology.orchestra.console:Power on smithi183 2022-04-04T22:58:20.161 INFO:teuthology.orchestra.console:Power on for smithi097 completed 2022-04-04T22:58:20.180 INFO:teuthology.orchestra.console:Power on for smithi183 completed 2022-04-04T22:58:20.263 INFO:teuthology.provision.fog.smithi097:Waiting for deploy to finish 2022-04-04T22:58:20.281 INFO:teuthology.provision.fog.smithi183:Waiting for deploy to finish 2022-04-04T23:03:13.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-04T23:03:13.444 INFO:teuthology.provision.fog.smithi183:Node is ready 2022-04-04T23:03:13.492 INFO:teuthology.orchestra.run.smithi183.stdout:smithi183.front.sepia.ceph.com 2022-04-04T23:03:13.541 INFO:teuthology.orchestra.run.smithi183.stdout:172.21.15.183 smithi183.front.sepia.ceph.com smithi183 2022-04-04T23:03:13.862 INFO:teuthology.provision.fog.smithi183:Deploy complete! 2022-04-04T23:03:19.255 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-04T23:03:19.491 INFO:teuthology.provision.fog.smithi097:Node is ready 2022-04-04T23:03:19.542 INFO:teuthology.orchestra.run.smithi097.stdout:smithi097.front.sepia.ceph.com 2022-04-04T23:03:19.590 INFO:teuthology.orchestra.run.smithi097.stdout:172.21.15.97 smithi097.front.sepia.ceph.com smithi097 2022-04-04T23:03:19.893 INFO:teuthology.provision.fog.smithi097:Deploy complete! 2022-04-04T23:03:20.062 INFO:teuthology.lock.ops:Checking smithi097.front.sepia.ceph.com 2022-04-04T23:03:20.063 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-04T23:03:20.084 INFO:teuthology.lock.ops:Checking smithi183.front.sepia.ceph.com 2022-04-04T23:03:20.085 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-04T23:03:20.104 INFO:teuthology.lock.ops:Updating [smithi097.front.sepia.ceph.com]: set os type and version on server 2022-04-04T23:03:20.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2022-04-04T23:03:20.338 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2022-04-04T23:03:20.384 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2022-04-04T23:03:20.385 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-04-04T23:03:20.385 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2022-04-04T23:03:20.385 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2022-04-04T23:03:20.386 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-04-04T23:03:20.386 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="18.04" 2022-04-04T23:03:20.386 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-04T23:03:20.386 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-04T23:03:20.386 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-04T23:03:20.387 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-04T23:03:20.387 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=bionic 2022-04-04T23:03:20.387 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=bionic 2022-04-04T23:03:20.388 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2022-04-04T23:03:20.407 INFO:teuthology.lock.ops:Updating [smithi183.front.sepia.ceph.com]: set os type and version on server 2022-04-04T23:03:20.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-04-04T23:03:20.692 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2022-04-04T23:03:20.740 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="Ubuntu" 2022-04-04T23:03:20.741 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="18.04.6 LTS (Bionic Beaver)" 2022-04-04T23:03:20.741 INFO:teuthology.orchestra.run.smithi183.stdout:ID=ubuntu 2022-04-04T23:03:20.741 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE=debian 2022-04-04T23:03:20.741 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="Ubuntu 18.04.6 LTS" 2022-04-04T23:03:20.742 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="18.04" 2022-04-04T23:03:20.742 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://www.ubuntu.com/" 2022-04-04T23:03:20.742 INFO:teuthology.orchestra.run.smithi183.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-04-04T23:03:20.742 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-04-04T23:03:20.742 INFO:teuthology.orchestra.run.smithi183.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-04-04T23:03:20.743 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_CODENAME=bionic 2022-04-04T23:03:20.743 INFO:teuthology.orchestra.run.smithi183.stdout:UBUNTU_CODENAME=bionic 2022-04-04T23:03:20.743 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2022-04-04T23:03:20.830 INFO:teuthology.dispatcher.supervisor:Running job 6776696 2022-04-04T23:03:20.830 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6776696 --name yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi --description orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} -- /home/teuthworker/archive/yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6776696/orig.config.yaml 2022-04-04T23:03:20.834 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6776696 2022-04-04T23:03:20.834 INFO:teuthology.dispatcher.supervisor:Job PID: 20543 2022-04-04T23:03:20.835 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-05T05:33:48.361 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-05T05:33:48.527 INFO:teuthology.kill:Killing Pids: {20543} 2022-04-05T05:33:49.688 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-04-05T05:33:49.689 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-04-05T05:33:49.690 INFO:teuthology.misc:Compressing logs... 2022-04-05T05:33:49.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2022-04-05T05:33:49.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2022-04-05T05:33:50.294 INFO:teuthology.misc:Compressing logs... 2022-04-05T05:33:50.507 INFO:teuthology.misc:Compressing logs... 2022-04-05T05:33:52.724 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-04-05T05:33:56.436 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-04-05T05:33:59.613 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-04-05T05:34:07.872 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-04-05T05:34:11.846 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-04-05T05:34:13.134 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-04-05T05:34:18.557 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-04-05T05:34:18.745 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2022-04-05T05:34:25.627 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-04-05T05:34:31.730 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-04-05T05:34:35.655 INFO:teuthology.orchestra.run.smithi183.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-04-05T05:34:39.917 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/f8ff4a0e-b46b-11ec-8c36-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-04-05T05:34:58.154 INFO:teuthology.kill:No teuthology processes running 2022-04-05T05:34:59.262 INFO:teuthology.kill:Nuking machines: ['smithi097', 'smithi183'] 2022-04-05T05:35:00.201 INFO:teuthology.kill:2022-04-05 05:35:00,200.200 INFO:teuthology.nuke:targets: 2022-04-05T05:35:00.202 INFO:teuthology.kill: smithi097.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeGprDt83Tq4Yj0NLCc6W984dw7v5XYTd+T1/VrOw/GaV0e/3TTZ//BJw6HR91Vhk4x1rkGr+shUdsIQ7AcnaB+DcD9Yv8gI9w1+4MkQ3oxVsf8q79ZwWZjSK7K+GBHOiSyRozX7zZ2WZOdGaRGT7u6ufCQAySrdnSZW3xV5i37ey2qAWolZoAXExU8VdHQR5Ry2W+HmRXkvVq079cJHrg1y6yNpTti65UPaI18Knx74d4RZ/PEsLrcp6B/j+KuES2S2e93vzXlwhyyuHCJ7XxehdQS8Q3TxHjxqToKSpmdA3bUIt6e9v5P9OrsuvwLijz83zQqst+QpNUsO3ZDkJ1 2022-04-05T05:35:00.203 INFO:teuthology.kill: smithi183.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC7E3z6QENTrJu5pSB+lYI8Jd1nb/6syunubttaCqzEP5Q5X2bY52mLQ8DSX5opHn+2/Sv9SrjgjaeJ4tKtffxAeOIpEeAknfCGfp7CtW6NVAsIolfSDBpZMKNJ3LhT0t9ehNNuUmRuGJEGFTvFjSfsLEwcJ+TBUQUrtmO8Rxp3lOyr5hHRvXFAieptFWisECvrO5cE7MGUC1Af9mCX9ogrrD0Um+W8nLm8A11qyBRlnWI9f/imOjMfF0CX90kYRZwmmAvQPZ8XKKZ7iIXNiOYiUqhM+jK9vgyJ4GChnde7g28/lYTJV9jWBkmliRReh4UjJlDVVSIR5MtgYyogml2Z 2022-04-05T05:35:00.227 INFO:teuthology.kill:2022-04-05 05:35:00,226.226 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T05:35:00.230 INFO:teuthology.kill:2022-04-05 05:35:00,229.229 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-05T05:35:00.308 INFO:teuthology.kill:2022-04-05 05:35:00,308.308 INFO:teuthology.orchestra.console:Power off smithi097 2022-04-05T05:35:00.322 INFO:teuthology.kill:2022-04-05 05:35:00,322.322 INFO:teuthology.orchestra.console:Power off smithi183 2022-04-05T05:35:08.678 INFO:teuthology.kill:2022-04-05 05:35:08,677.677 INFO:teuthology.orchestra.console:Power off for smithi097 completed 2022-04-05T05:35:08.827 INFO:teuthology.kill:2022-04-05 05:35:08,826.826 INFO:teuthology.lock.ops:unlocked: smithi097.front.sepia.ceph.com 2022-04-05T05:35:12.797 INFO:teuthology.kill:2022-04-05 05:35:12,796.796 INFO:teuthology.orchestra.console:Power off for smithi183 completed 2022-04-05T05:35:12.941 INFO:teuthology.kill:2022-04-05 05:35:12,941.941 INFO:teuthology.lock.ops:unlocked: smithi183.front.sepia.ceph.com 2022-04-05T05:37:13.254 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-05T05:37:13.337 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi097 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-04-05_05:02:31-rados:thrash-wip-rf-42977pl-pacific-distro-basic-smithi/6777548 2022-04-05T05:37:13.337 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi183 but it was locked by another job: /home/teuthworker/archive/rfriedma-2022-04-05_05:02:31-rados:thrash-wip-rf-42977pl-pacific-distro-basic-smithi/6777548