2021-10-28T21:34:10.626 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-28T21:34:10.754 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging 2021-10-28T21:34:10.755 INFO:teuthology.lock.ops:Updating [ubuntu@smithi017.front.sepia.ceph.com]: reset os type and version on server 2021-10-28T21:34:10.755 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-10-28T21:34:10.773 INFO:teuthology.lock.ops:Node 'ubuntu@smithi017.front.sepia.ceph.com' reimaging is complete 2021-10-28T21:34:10.773 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi194.front.sepia.ceph.com' reimaging 2021-10-28T21:34:10.774 INFO:teuthology.lock.ops:Updating [ubuntu@smithi194.front.sepia.ceph.com]: reset os type and version on server 2021-10-28T21:34:10.774 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2021-10-28T21:34:10.793 INFO:teuthology.lock.ops:Node 'ubuntu@smithi194.front.sepia.ceph.com' reimaging is complete 2021-10-28T21:34:10.995 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of ubuntu 20.04 2021-10-28T21:34:10.999 INFO:teuthology.provision.fog.smithi194:Scheduling deploy of ubuntu 20.04 2021-10-28T21:34:11.465 INFO:teuthology.orchestra.console:Power off smithi017 2021-10-28T21:34:11.504 INFO:teuthology.orchestra.console:Power off smithi194 2021-10-28T21:34:11.617 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-10-28T21:34:11.652 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2021-10-28T21:34:11.719 INFO:teuthology.orchestra.console:Power on smithi017 2021-10-28T21:34:11.753 INFO:teuthology.orchestra.console:Power on smithi194 2021-10-28T21:34:20.086 INFO:teuthology.orchestra.console:Power on for smithi017 completed 2021-10-28T21:34:20.112 INFO:teuthology.orchestra.console:Power on for smithi194 completed 2021-10-28T21:34:20.187 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2021-10-28T21:34:20.213 INFO:teuthology.provision.fog.smithi194:Waiting for deploy to finish 2021-10-28T21:39:42.086 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-28T21:39:42.627 INFO:teuthology.provision.fog.smithi017:Node is ready 2021-10-28T21:39:42.633 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2021-10-28T21:39:42.641 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2021-10-28T21:39:42.828 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2021-10-28T21:40:27.684 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-10-28T21:40:28.309 INFO:teuthology.provision.fog.smithi194:Node is ready 2021-10-28T21:40:28.362 INFO:teuthology.orchestra.run.smithi194.stdout:smithi194.front.sepia.ceph.com 2021-10-28T21:40:28.368 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194 smithi194.front.sepia.ceph.com smithi194 2021-10-28T21:40:28.585 INFO:teuthology.provision.fog.smithi194:Deploy complete! 2021-10-28T21:40:28.767 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2021-10-28T21:40:28.768 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-28T21:40:28.787 INFO:teuthology.lock.ops:Checking smithi194.front.sepia.ceph.com 2021-10-28T21:40:28.788 INFO:teuthology.lock.ops:New key found. Updating... 2021-10-28T21:40:28.807 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2021-10-28T21:40:28.808 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2021-10-28T21:40:28.990 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2021-10-28T21:40:28.997 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2021-10-28T21:40:28.998 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-28T21:40:28.998 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2021-10-28T21:40:28.998 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2021-10-28T21:40:28.998 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-28T21:40:28.999 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="20.04" 2021-10-28T21:40:28.999 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-28T21:40:28.999 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-28T21:40:28.999 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-28T21:40:28.999 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-28T21:40:29.000 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=focal 2021-10-28T21:40:29.000 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=focal 2021-10-28T21:40:29.001 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2021-10-28T21:40:29.020 INFO:teuthology.lock.ops:Updating [smithi194.front.sepia.ceph.com]: set os type and version on server 2021-10-28T21:40:29.020 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-10-28T21:40:29.195 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2021-10-28T21:40:29.201 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="Ubuntu" 2021-10-28T21:40:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-10-28T21:40:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:ID=ubuntu 2021-10-28T21:40:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE=debian 2021-10-28T21:40:29.202 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-10-28T21:40:29.203 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="20.04" 2021-10-28T21:40:29.203 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://www.ubuntu.com/" 2021-10-28T21:40:29.203 INFO:teuthology.orchestra.run.smithi194.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-10-28T21:40:29.203 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-10-28T21:40:29.204 INFO:teuthology.orchestra.run.smithi194.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-10-28T21:40:29.204 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_CODENAME=focal 2021-10-28T21:40:29.204 INFO:teuthology.orchestra.run.smithi194.stdout:UBUNTU_CODENAME=focal 2021-10-28T21:40:29.204 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2021-10-28T21:40:29.313 INFO:teuthology.dispatcher.supervisor:Running job 6465402 2021-10-28T21:40:29.314 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_c56135d151713269e811ede3163c9743c2e269de/virtualenv/bin/teuthology -v --owner scheduled_nojha@teuthology --archive /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465402 --name nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi --description rados/upgrade/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} -- /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465402/orig.config.yaml 2021-10-28T21:40:29.317 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nojha-2021-10-28_21:32:34-rados-wip-43687-distro-basic-smithi/6465402 2021-10-28T21:40:29.317 INFO:teuthology.dispatcher.supervisor:Job PID: 21038 2021-10-28T21:40:29.317 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-10-29T09:41:23.327 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-10-29T09:41:23.533 INFO:teuthology.kill:Killing Pids: {21038} 2021-10-29T09:41:24.811 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-10-29T09:41:24.812 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-10-29T09:41:24.813 INFO:teuthology.misc:Compressing logs... 2021-10-29T09:41:24.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2021-10-29T09:41:24.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2021-10-29T09:41:25.320 INFO:teuthology.misc:Compressing logs... 2021-10-29T09:41:27.098 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-29T09:41:27.779 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-10-29T09:41:28.762 INFO:teuthology.misc:Compressing logs... 2021-10-29T09:41:36.052 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2021-10-29T09:41:36.832 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2021-10-29T09:41:47.700 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2021-10-29T09:41:56.396 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-mgr.y.log: file size changed while zipping 2021-10-29T09:41:58.890 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2021-10-29T09:42:08.088 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2021-10-29T09:42:09.062 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2021-10-29T09:42:16.975 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2021-10-29T09:42:31.865 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2021-10-29T09:43:14.217 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/28227c84-3839-11ec-8c28-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2021-10-29T09:43:52.408 INFO:teuthology.kill:No teuthology processes running 2021-10-29T09:43:53.502 INFO:teuthology.kill:Nuking machines: ['smithi017', 'smithi194'] 2021-10-29T09:43:54.430 INFO:teuthology.kill:2021-10-29 09:43:54,430.430 INFO:teuthology.nuke:targets: 2021-10-29T09:43:54.431 INFO:teuthology.kill: smithi017.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPB2Y7/k50w83Z/Tva9K2E0MRwSpHhpJgK2AHIVC5W/tyEU5mugZ+oT0vpA1crztVm/iIJ+kd7VvpeSDQor3jkPhYbpXDXAo6WYmtmFZ6sYXp3lpFKmludpJRFw1R7cbedEusgTaMMEnRn9VtB5+P0hX9yNNxH2VAhftnR2fK/nmIikBzve1ozmETJwj9JHkJfDRnNvWu/pVEyDnGM+pZUI69yI1pAIfehgG8QKdyaO3YPLKByn+oKocSYB892Z3LZoAtMJSGrWZ2IHVRfjArvq9TRAYc0c89rzy3hTrTtnNV0zuiECVfcmrcgdQIxF3Ww4EPQGCI/1z2rV7qol2mOHbMK6OLDtiyV+cUxJKzcaiwhhkb4z3aMoBKM/15DFzd+k9cXTvCGyAOIUWvP/LUbkX1FvbIHVsPuOiY+5RV7hsfkq5UkWd69kNg82GBAAHMLwpZBtgKe2ShWO/PGqAKtOqgeHVaUSjjA2os7vehqa541Ujl+kilDEfhP0aA7fNE= 2021-10-29T09:43:54.431 INFO:teuthology.kill: smithi194.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDpynaGi7LRAI9GkCo3nYAIzwNxBeFbZPohCjtvLA99tc6fUHx8kB7PO99+L8N/AwmfPpeXij6XEYYAqKsJE8aEwHNCX6bPcy9SsD7oPfzBuQ4YstcSslDXL/8kTpCUffPyP6YJWZRqa6uheHc4ffUPnOgF9kW9Z/1orttt9Oo5luV7a1nCrngJAkqnMtE5kTm7NcE+SKEhfX3yYaoM+0HuPjQ/nAUP2qdT6pD4aDX6Jj9zEy+0nqHaCWNEVbdnetDvVI3OfwURcOm2y5hTxaJVMxxxTGEibHhdItGSNmJkwyj03etouzFsr28AaURIdACvlYyrDFrkKjOPgM1zFUfWJjMbZJtFBPXOGuOpG+7qjupQPPw92n0O1KZAYcyG07jJetZbTZFziIue+T1ikLUkutfh70GKig29G9Qevh4D8tHg4AeZ+tMMwq4D/HhXr5EaSMf12usWGl12LX3RkuGK5bHeBpxaskQ2VC/X8wWOzAI2U0AqgX2mgxc/eWJIGD8= 2021-10-29T09:43:54.458 INFO:teuthology.kill:2021-10-29 09:43:54,458.458 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-29T09:43:54.460 INFO:teuthology.kill:2021-10-29 09:43:54,459.459 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-10-29T09:43:54.543 INFO:teuthology.kill:2021-10-29 09:43:54,542.542 INFO:teuthology.orchestra.console:Power off smithi017 2021-10-29T09:43:54.556 INFO:teuthology.kill:2021-10-29 09:43:54,556.556 INFO:teuthology.orchestra.console:Power off smithi194 2021-10-29T09:44:02.913 INFO:teuthology.kill:2021-10-29 09:44:02,912.912 INFO:teuthology.orchestra.console:Power off for smithi017 completed 2021-10-29T09:44:02.928 INFO:teuthology.kill:2021-10-29 09:44:02,928.928 INFO:teuthology.orchestra.console:Power off for smithi194 completed 2021-10-29T09:44:03.057 INFO:teuthology.kill:2021-10-29 09:44:03,056.056 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2021-10-29T09:44:03.070 INFO:teuthology.kill:2021-10-29 09:44:03,070.070 INFO:teuthology.lock.ops:unlocked: smithi194.front.sepia.ceph.com 2021-10-29T09:46:03.371 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-10-29T09:46:03.472 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi017 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6466071 2021-10-29T09:46:03.472 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi194 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-10-28_23:09:03-rados-wip-yuri2-testing-2021-10-28-1343-distro-basic-smithi/6466071