2022-01-20T12:55:33.083 INFO:root:teuthology version: 1.1.0-3ff86a5d 2022-01-20T12:55:33.212 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging 2022-01-20T12:55:33.213 INFO:teuthology.lock.ops:Updating [ubuntu@smithi153.front.sepia.ceph.com]: reset os type and version on server 2022-01-20T12:55:33.214 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-01-20T12:55:33.239 INFO:teuthology.lock.ops:Node 'ubuntu@smithi153.front.sepia.ceph.com' reimaging is complete 2022-01-20T12:55:33.240 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging 2022-01-20T12:55:33.240 INFO:teuthology.lock.ops:Updating [ubuntu@smithi185.front.sepia.ceph.com]: reset os type and version on server 2022-01-20T12:55:33.240 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-01-20T12:55:33.262 INFO:teuthology.lock.ops:Node 'ubuntu@smithi185.front.sepia.ceph.com' reimaging is complete 2022-01-20T12:55:33.466 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of ubuntu 20.04 2022-01-20T12:55:33.470 INFO:teuthology.provision.fog.smithi185:Scheduling deploy of ubuntu 20.04 2022-01-20T12:55:33.812 INFO:teuthology.orchestra.console:Power off smithi153 2022-01-20T12:55:33.827 INFO:teuthology.orchestra.console:Power off smithi185 2022-01-20T12:55:42.191 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-01-20T12:55:42.293 INFO:teuthology.orchestra.console:Power on smithi185 2022-01-20T12:55:46.295 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-01-20T12:55:46.397 INFO:teuthology.orchestra.console:Power on smithi153 2022-01-20T12:55:50.653 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2022-01-20T12:55:50.668 INFO:teuthology.orchestra.console:Power on for smithi185 completed 2022-01-20T12:55:50.755 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2022-01-20T12:55:50.769 INFO:teuthology.provision.fog.smithi185:Waiting for deploy to finish 2022-01-20T13:01:04.796 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-20T13:01:05.320 INFO:teuthology.provision.fog.smithi185:Node is ready 2022-01-20T13:01:05.369 INFO:teuthology.orchestra.run.smithi185.stdout:smithi185.front.sepia.ceph.com 2022-01-20T13:01:05.376 INFO:teuthology.orchestra.run.smithi185.stdout:172.21.15.185 smithi185.front.sepia.ceph.com smithi185 2022-01-20T13:01:05.556 INFO:teuthology.provision.fog.smithi185:Deploy complete! 2022-01-20T13:01:12.642 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-20T13:01:13.219 INFO:teuthology.provision.fog.smithi153:Node is ready 2022-01-20T13:01:13.226 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2022-01-20T13:01:13.275 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2022-01-20T13:01:13.477 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2022-01-20T13:01:13.676 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2022-01-20T13:01:13.677 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-20T13:01:13.699 INFO:teuthology.lock.ops:Checking smithi185.front.sepia.ceph.com 2022-01-20T13:01:13.700 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-20T13:01:13.719 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2022-01-20T13:01:13.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-01-20T13:01:13.899 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2022-01-20T13:01:13.946 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2022-01-20T13:01:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-20T13:01:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2022-01-20T13:01:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2022-01-20T13:01:13.947 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-20T13:01:13.948 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2022-01-20T13:01:13.948 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-20T13:01:13.948 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-20T13:01:13.948 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-20T13:01:13.949 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-20T13:01:13.949 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2022-01-20T13:01:13.949 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2022-01-20T13:01:13.950 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-01-20T13:01:13.969 INFO:teuthology.lock.ops:Updating [smithi185.front.sepia.ceph.com]: set os type and version on server 2022-01-20T13:01:13.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-01-20T13:01:14.147 INFO:teuthology.orchestra.run.smithi185.stdout:x86_64 2022-01-20T13:01:14.197 INFO:teuthology.orchestra.run.smithi185.stdout:NAME="Ubuntu" 2022-01-20T13:01:14.198 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION="20.04.3 LTS (Focal Fossa)" 2022-01-20T13:01:14.198 INFO:teuthology.orchestra.run.smithi185.stdout:ID=ubuntu 2022-01-20T13:01:14.198 INFO:teuthology.orchestra.run.smithi185.stdout:ID_LIKE=debian 2022-01-20T13:01:14.198 INFO:teuthology.orchestra.run.smithi185.stdout:PRETTY_NAME="Ubuntu 20.04.3 LTS" 2022-01-20T13:01:14.199 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_ID="20.04" 2022-01-20T13:01:14.199 INFO:teuthology.orchestra.run.smithi185.stdout:HOME_URL="https://www.ubuntu.com/" 2022-01-20T13:01:14.199 INFO:teuthology.orchestra.run.smithi185.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-01-20T13:01:14.199 INFO:teuthology.orchestra.run.smithi185.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-01-20T13:01:14.200 INFO:teuthology.orchestra.run.smithi185.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-01-20T13:01:14.200 INFO:teuthology.orchestra.run.smithi185.stdout:VERSION_CODENAME=focal 2022-01-20T13:01:14.200 INFO:teuthology.orchestra.run.smithi185.stdout:UBUNTU_CODENAME=focal 2022-01-20T13:01:14.201 INFO:teuthology.lock.ops:Updating smithi185.front.sepia.ceph.com on lock server 2022-01-20T13:01:14.291 INFO:teuthology.dispatcher.supervisor:Running job 6623976 2022-01-20T13:01:14.292 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_3ff86a5dbaafecdb6414fa2fea970bb44e836829/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623976 --name ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi --description rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} -- /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623976/orig.config.yaml 2022-01-20T13:01:14.295 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2022-01-18_11:04:04-rados-wip-ifed-faster-rm-p2-distro-default-smithi/6623976 2022-01-20T13:01:14.296 INFO:teuthology.dispatcher.supervisor:Job PID: 5892 2022-01-20T13:01:14.296 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-20T19:31:43.872 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-01-20T19:31:44.045 INFO:teuthology.kill:Killing Pids: {5892} 2022-01-20T19:31:45.230 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['host.a', 'client.0'] 2022-01-20T19:31:45.231 INFO:teuthology.task.internal:roles: ubuntu@smithi185.front.sepia.ceph.com - ['host.b', 'client.1'] 2022-01-20T19:31:45.232 INFO:teuthology.misc:Compressing logs... 2022-01-20T19:31:45.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-01-20T19:31:45.406 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi185.front.sepia.ceph.com' 2022-01-20T19:31:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-20T19:31:45.589 INFO:teuthology.orchestra.run.smithi185.stderr:find: '/var/lib/ceph/crash': No such file or directory 2022-01-20T19:31:45.613 INFO:teuthology.orchestra.run.smithi153.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-20T19:31:45.613 INFO:teuthology.orchestra.run.smithi153.stderr:tar: Error is not recoverable: exiting now 2022-01-20T19:31:45.631 INFO:teuthology.orchestra.run.smithi185.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-01-20T19:31:45.632 INFO:teuthology.orchestra.run.smithi185.stderr:tar: Error is not recoverable: exiting now 2022-01-20T19:31:45.634 INFO:teuthology.misc:Compressing logs... 2022-01-20T19:31:45.865 INFO:teuthology.misc:Compressing logs... 2022-01-20T19:31:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-mon.smithi153.log: file size changed while zipping 2022-01-20T19:32:00.689 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.6.log: file size changed while zipping 2022-01-20T19:32:09.861 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.5.log: file size changed while zipping 2022-01-20T19:32:10.908 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-01-20T19:32:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.7.log: file size changed while zipping 2022-01-20T19:32:26.976 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-mgr.smithi153.iabvgt.log: file size changed while zipping 2022-01-20T19:32:30.537 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-01-20T19:32:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.3.log: file size changed while zipping 2022-01-20T19:32:49.669 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.4.log: file size changed while zipping 2022-01-20T19:32:52.801 INFO:teuthology.orchestra.run.smithi185.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-mon.smithi185.log: file size changed while zipping 2022-01-20T19:33:01.664 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/0207f254-79f2-11ec-8c35-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-01-20T19:33:37.550 INFO:teuthology.kill:No teuthology processes running 2022-01-20T19:33:38.701 INFO:teuthology.kill:Nuking machines: ['smithi153', 'smithi185'] 2022-01-20T19:33:39.709 INFO:teuthology.kill:2022-01-20 19:33:39,708.708 INFO:teuthology.nuke:targets: 2022-01-20T19:33:39.710 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFJyl/Zioa91W+cdcZih6ursio5h9VSlP/7wtouzML+ECshzyjUxrw0G+b5r+I9Ri84bp+w2aBZaxtN+eUWd1O+FvHOioIpA5GFV9ix8EnhmfAyT+mTSM5q/WBOl1REyncTx2cXwX7kp86q0CfgIBcvvQkPne2g6noICDbn9sPZYeoDXgv3OhWTvnlwmkyTQQ5D/UonLawALDT7ToOSbYjsL1J2Cccl+9E3GVRfCDcCj1F+8C7pbUrQjMxDmHJ9P374FysagchNWAXgxwPGmW25mHIhoKiPeng2GmohYNCl+5VJGFS/McJKT0psg65zTwpNjvZoO4SnShmAIIjCAyvoetOOzXohvEIqUVjzZ/FbBSkOFWL6zxlc+omLqv6Qi/Q0Cav1oPVGO7Q+dKvgActYascoHYYIX8+HKVgXWdq5L3eQZt/TIYxO3zICJ6Z7I7Cumk8ut2XtRq2KemQPSBRo7KY9qGP2hEe/Uuu3FfeLFKfL54048mcQUKlGE2hHC8= 2022-01-20T19:33:39.710 INFO:teuthology.kill: smithi185.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjW20IEq5MATE0ZnSUr9TWB2MDJaGqLwdk2ZvVWjqi1cpFFn+E7yyGFTMVy5A4maK6y8W0E4F1c3n3g0c53vUkqTqjsVeu2u6Ob3CicEw16i7ExKtgVa1zrA8ux8UZA10LiV98sB6KqJciPPwCMHQMl5B9Ob7L/kOoD8kVQJu+Doz66Ex8QONkDldXvyOyLxtPZdQphnY+2Z1wp4PlDAqHuwrDcwNv3gqF68oOPirXoLsY4OJVtQ7Kw97bazXRDPfgM63QFTlGTL/1EX4A21oBT9tJWQDM97/bkMtcaRSRV/iWW70otZCeHUEe9Q962AKKIlkaCRK9HaPLl1NQE7qxRYgNZdDFErs0TAWsLd9qNQ/DJiGeGF/G+wCJSHN5YT8yl1dYmHv5OYO5BxeD80+t16l/xWvvhZbJRiblThLhnvPArX97SBWdsmFFFPxHYiCdFZ0Mrhi9deNu6+cI0Pr25LTCzIVzFpvrNW/6i/4YHTrdG21WbdthZaZ2Nxyu8Pc= 2022-01-20T19:33:39.736 INFO:teuthology.kill:2022-01-20 19:33:39,736.736 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-20T19:33:39.739 INFO:teuthology.kill:2022-01-20 19:33:39,739.739 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-20T19:33:39.813 INFO:teuthology.kill:2022-01-20 19:33:39,813.813 INFO:teuthology.orchestra.console:Power off smithi153 2022-01-20T19:33:39.828 INFO:teuthology.kill:2022-01-20 19:33:39,827.827 INFO:teuthology.orchestra.console:Power off smithi185 2022-01-20T19:33:48.195 INFO:teuthology.kill:2022-01-20 19:33:48,195.195 INFO:teuthology.orchestra.console:Power off for smithi185 completed 2022-01-20T19:33:48.352 INFO:teuthology.kill:2022-01-20 19:33:48,351.351 INFO:teuthology.lock.ops:unlocked: smithi185.front.sepia.ceph.com 2022-01-20T19:33:52.301 INFO:teuthology.kill:2022-01-20 19:33:52,300.300 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-01-20T19:33:52.471 INFO:teuthology.kill:2022-01-20 19:33:52,471.471 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2022-01-20T19:35:52.840 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-20T19:35:52.931 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629395 2022-01-20T19:35:52.932 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi185 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-20_17:34:11-fs-wip-yuri5-testing-2022-01-20-0652-pacific-distro-default-smithi/6629392