2021-12-09T05:48:50.331 INFO:root:teuthology version: 1.1.0-95a7d479 2021-12-09T05:48:50.462 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging 2021-12-09T05:48:50.465 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server 2021-12-09T05:48:50.465 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2021-12-09T05:48:50.486 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete 2021-12-09T05:48:50.486 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging 2021-12-09T05:48:50.486 INFO:teuthology.lock.ops:Updating [ubuntu@smithi190.front.sepia.ceph.com]: reset os type and version on server 2021-12-09T05:48:50.487 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2021-12-09T05:48:50.506 INFO:teuthology.lock.ops:Node 'ubuntu@smithi190.front.sepia.ceph.com' reimaging is complete 2021-12-09T05:48:50.700 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 20.04 2021-12-09T05:48:50.711 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of ubuntu 20.04 2021-12-09T05:48:51.053 INFO:teuthology.orchestra.console:Power off smithi190 2021-12-09T05:48:51.068 INFO:teuthology.orchestra.console:Power off smithi153 2021-12-09T05:48:59.428 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2021-12-09T05:48:59.529 INFO:teuthology.orchestra.console:Power on smithi190 2021-12-09T05:49:03.548 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2021-12-09T05:49:03.649 INFO:teuthology.orchestra.console:Power on smithi153 2021-12-09T05:49:07.894 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2021-12-09T05:49:07.996 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2021-12-09T05:49:12.014 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2021-12-09T05:49:12.115 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2021-12-09T05:54:27.986 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-09T05:54:28.480 INFO:teuthology.provision.fog.smithi190:Node is ready 2021-12-09T05:54:28.530 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2021-12-09T05:54:28.537 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2021-12-09T05:54:28.728 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2021-12-09T05:54:47.044 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-12-09T05:54:47.605 INFO:teuthology.provision.fog.smithi153:Node is ready 2021-12-09T05:54:47.611 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2021-12-09T05:54:47.619 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2021-12-09T05:54:47.858 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2021-12-09T05:54:48.043 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2021-12-09T05:54:48.044 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-09T05:54:48.062 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2021-12-09T05:54:48.063 INFO:teuthology.lock.ops:New key found. Updating... 2021-12-09T05:54:48.081 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2021-12-09T05:54:48.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2021-12-09T05:54:48.267 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2021-12-09T05:54:48.273 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2021-12-09T05:54:48.274 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-09T05:54:48.274 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2021-12-09T05:54:48.274 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2021-12-09T05:54:48.274 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-09T05:54:48.275 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2021-12-09T05:54:48.275 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-09T05:54:48.275 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-09T05:54:48.275 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-09T05:54:48.276 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-09T05:54:48.276 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2021-12-09T05:54:48.276 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2021-12-09T05:54:48.277 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2021-12-09T05:54:48.295 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2021-12-09T05:54:48.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2021-12-09T05:54:48.555 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2021-12-09T05:54:48.605 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2021-12-09T05:54:48.606 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2021-12-09T05:54:48.606 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2021-12-09T05:54:48.606 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2021-12-09T05:54:48.607 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2021-12-09T05:54:48.607 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="20.04" 2021-12-09T05:54:48.607 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2021-12-09T05:54:48.607 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-12-09T05:54:48.608 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-12-09T05:54:48.608 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-12-09T05:54:48.608 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=focal 2021-12-09T05:54:48.608 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=focal 2021-12-09T05:54:48.609 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2021-12-09T05:54:48.708 INFO:teuthology.dispatcher.supervisor:Running job 6553176 2021-12-09T05:54:48.708 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553176 --name benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} -- /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553176/orig.config.yaml 2021-12-09T05:54:48.712 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2021-12-08_20:57:58-rados-WIP_GBH_safe_fast_shutdown_6-distro-basic-smithi/6553176 2021-12-09T05:54:48.713 INFO:teuthology.dispatcher.supervisor:Job PID: 2190 2021-12-09T05:54:48.713 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-12-09T17:55:43.748 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-12-09T17:55:43.970 INFO:teuthology.kill:Killing Pids: {2190} 2021-12-09T17:55:45.155 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-12-09T17:55:45.156 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-12-09T17:55:45.156 INFO:teuthology.misc:Compressing logs... 2021-12-09T17:55:45.157 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2021-12-09T17:55:45.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2021-12-09T17:55:45.571 INFO:teuthology.misc:Compressing logs... 2021-12-09T17:55:46.874 INFO:teuthology.misc:Compressing logs... 2021-12-09T17:55:55.257 INFO:teuthology.kill:No teuthology processes running 2021-12-09T17:55:56.391 INFO:teuthology.kill:Nuking machines: ['smithi153', 'smithi190'] 2021-12-09T17:55:57.384 INFO:teuthology.kill:2021-12-09 17:55:57,384.384 INFO:teuthology.nuke:targets: 2021-12-09T17:55:57.385 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXL+2N1RuaTzVJhCyXU8EAXrYnhwqt3BusGSF9di3B1mc/LNb8TibeFLAPNX+NmhEcH0D4EjUYvPQewb9MPd1WvLvRFcHLPCk89wEc3AGxV1CsgBr73oafLI3JlGd4v35B0KGBrtCWdWiAgc76H8KsOWDYBaL6l0caUxTEVfH8WGliiWEvNMET/QJjKmMXdxaysg4Mbs1OeEG+8aDNmuELPIvh1gD7sUUcYAAHaoHmKrff8sXNa1v8TlnRmeB/BSmGfa8HGwty2suuDLwkpLWrBSnVYBYf9JoH9Jd+z8qWdHseyRB4VH7Da1SUFONtVwa5ONntPI73GO+gG2JWPP3CEQpgKtJcUAiEpfk7Dt7b2++iC7Bp3YoUxVqHvW5KEUF6/Fk2poZKLDtiuflYQSFknz/HdXDW9SiupdaRIcVGbWUfjW6+3u6cqwlexSWff/e1GIsZtOAPzmkhmS/D4SgomsqJ2qf+WONfVtan5e+serYsvKe9LlFc9KgMyV/WjPE= 2021-12-09T17:55:57.386 INFO:teuthology.kill: smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDjuJd2JwCazCRTTc+1SK5m5xOdKFYsbxElUdVsRtjtyEx7MmzznMnps4lTF6yL2wtr5whgt/KlXGAVL6EVaMPiryseMHAJtSS9tLOGcrY+I3HEnv33S4/IgDBZ+r+lUwblsQipwfi219D9ulHbuCGctamzjo+xCHTW7G8zL6RCymcQSYiqs5KdSAeaB/YAjjptgvaB57oGKLuO24++MhIUl7LTQk/qY4PCNrnGb5e3nt5NGAy1hvhsL4y5PxXt4Pc2F1FbEwGswVxwTgAqklGL11GdbT30iJT8w1B7DRVl6LIJXD4t4F9QpZn7FalhAMa2ryoNK1kiYfmw9FS8SBjH+J9R0a8NgGh87eYtQEjaj6F7lIiswx7Pcoif7XWm/ln4WOb7dwxA6Ddfo0by6My97w+aGmg1zpeQTGYPGGR77q0NqIvPIH7rCWsSNMQR0yUB+Ac+H3byi0XemAunjM6SbXA+v/Ox9UR/cLKpqx9wtfCDpVHBUlFRO4kwMkLKPU= 2021-12-09T17:55:57.412 INFO:teuthology.kill:2021-12-09 17:55:57,412.412 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-09T17:55:57.415 INFO:teuthology.kill:2021-12-09 17:55:57,415.415 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-12-09T17:55:57.493 INFO:teuthology.kill:2021-12-09 17:55:57,493.493 INFO:teuthology.orchestra.console:Power off smithi190 2021-12-09T17:55:57.507 INFO:teuthology.kill:2021-12-09 17:55:57,507.507 INFO:teuthology.orchestra.console:Power off smithi153 2021-12-09T17:56:05.870 INFO:teuthology.kill:2021-12-09 17:56:05,869.869 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2021-12-09T17:56:06.017 INFO:teuthology.kill:2021-12-09 17:56:06,016.016 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2021-12-09T17:56:09.984 INFO:teuthology.kill:2021-12-09 17:56:09,984.984 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2021-12-09T17:56:10.128 INFO:teuthology.kill:2021-12-09 17:56:10,128.128 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2021-12-09T17:58:10.450 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-12-09T17:58:10.556 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-09_11:27:25-rbd-wip-deepika2-testing-pacific-distro-default-smithi/6554836 2021-12-09T17:58:10.556 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-09_11:27:25-rbd-wip-deepika2-testing-pacific-distro-default-smithi/6554835