2021-12-04T06:35:33.211 INFO:root:teuthology version: 1.1.0-844d1377
2021-12-04T06:35:33.335 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging
2021-12-04T06:35:33.336 INFO:teuthology.lock.ops:Updating [ubuntu@smithi029.front.sepia.ceph.com]: reset os type and version on server
2021-12-04T06:35:33.337 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-12-04T06:35:33.356 INFO:teuthology.lock.ops:Node 'ubuntu@smithi029.front.sepia.ceph.com' reimaging is complete
2021-12-04T06:35:33.356 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging
2021-12-04T06:35:33.357 INFO:teuthology.lock.ops:Updating [ubuntu@smithi192.front.sepia.ceph.com]: reset os type and version on server
2021-12-04T06:35:33.357 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2021-12-04T06:35:33.377 INFO:teuthology.lock.ops:Node 'ubuntu@smithi192.front.sepia.ceph.com' reimaging is complete
2021-12-04T06:35:33.585 INFO:teuthology.provision.fog.smithi029:Scheduling deploy of centos 8.stream
2021-12-04T06:35:33.588 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 8.stream
2021-12-04T06:35:33.921 INFO:teuthology.orchestra.console:Power off smithi029
2021-12-04T06:35:33.937 INFO:teuthology.orchestra.console:Power off smithi192
2021-12-04T06:35:34.084 INFO:teuthology.orchestra.console:Power off for smithi192 completed
2021-12-04T06:35:34.185 INFO:teuthology.orchestra.console:Power on smithi192
2021-12-04T06:35:38.448 INFO:teuthology.orchestra.console:Power on for smithi192 completed
2021-12-04T06:35:38.549 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish
2021-12-04T06:35:42.291 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2021-12-04T06:35:42.396 INFO:teuthology.orchestra.console:Power on smithi029
2021-12-04T06:35:50.768 INFO:teuthology.orchestra.console:Power on for smithi029 completed
2021-12-04T06:35:50.870 INFO:teuthology.provision.fog.smithi029:Waiting for deploy to finish
2021-12-04T06:40:43.295 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-04T06:40:43.593 INFO:teuthology.provision.fog.smithi192:Node is ready
2021-12-04T06:40:43.611 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com
2021-12-04T06:40:43.668 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192
2021-12-04T06:40:43.998 INFO:teuthology.provision.fog.smithi192:Deploy complete!
2021-12-04T06:40:55.569 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-04T06:40:55.914 INFO:teuthology.provision.fog.smithi029:Node is ready
2021-12-04T06:40:55.932 INFO:teuthology.orchestra.run.smithi029.stdout:smithi029.front.sepia.ceph.com
2021-12-04T06:40:55.990 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.15.29 smithi029.front.sepia.ceph.com smithi029
2021-12-04T06:40:56.343 INFO:teuthology.provision.fog.smithi029:Deploy complete!
2021-12-04T06:40:56.503 INFO:teuthology.lock.ops:Checking smithi029.front.sepia.ceph.com
2021-12-04T06:40:56.505 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-04T06:40:56.529 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com
2021-12-04T06:40:56.529 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-04T06:40:56.551 INFO:teuthology.lock.ops:Updating [smithi029.front.sepia.ceph.com]: set os type and version on server
2021-12-04T06:40:56.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2021-12-04T06:40:56.746 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64
2021-12-04T06:40:56.802 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="CentOS Stream"
2021-12-04T06:40:56.802 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8"
2021-12-04T06:40:56.803 INFO:teuthology.orchestra.run.smithi029.stdout:ID="centos"
2021-12-04T06:40:56.803 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="rhel fedora"
2021-12-04T06:40:56.803 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8"
2021-12-04T06:40:56.803 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8"
2021-12-04T06:40:56.804 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-04T06:40:56.804 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31"
2021-12-04T06:40:56.804 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-04T06:40:56.804 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://centos.org/"
2021-12-04T06:40:56.804 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-04T06:40:56.805 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-04T06:40:56.805 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-04T06:40:56.806 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server
2021-12-04T06:40:56.824 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server
2021-12-04T06:40:56.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2021-12-04T06:40:57.063 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64
2021-12-04T06:40:57.118 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream"
2021-12-04T06:40:57.119 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="8"
2021-12-04T06:40:57.119 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos"
2021-12-04T06:40:57.119 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora"
2021-12-04T06:40:57.120 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="8"
2021-12-04T06:40:57.120 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el8"
2021-12-04T06:40:57.120 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-04T06:40:57.120 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31"
2021-12-04T06:40:57.121 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-04T06:40:57.121 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/"
2021-12-04T06:40:57.121 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-04T06:40:57.121 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-04T06:40:57.122 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-04T06:40:57.122 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server
2021-12-04T06:40:57.242 INFO:teuthology.dispatcher.supervisor:Running job 6543204
2021-12-04T06:40:57.243 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_844d13778e221f3c1f3cb6626445c4bc2f71766d/virtualenv/bin/teuthology -v --owner scheduled_ifed01@teuthology --archive /home/teuthworker/archive/ifed01-2021-12-03_17:11:15-rados-wip-ifed-faster-rm-revert-distro-default-smithi/6543204 --name ifed01-2021-12-03_17:11:15-rados-wip-ifed-faster-rm-revert-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/ifed01-2021-12-03_17:11:15-rados-wip-ifed-faster-rm-revert-distro-default-smithi/6543204/orig.config.yaml
2021-12-04T06:40:57.246 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ifed01-2021-12-03_17:11:15-rados-wip-ifed-faster-rm-revert-distro-default-smithi/6543204
2021-12-04T06:40:57.247 INFO:teuthology.dispatcher.supervisor:Job PID: 13611
2021-12-04T06:40:57.248 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-04T18:41:17.288 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-04T18:41:17.460 INFO:teuthology.kill:Killing Pids: {13611}
2021-12-04T18:41:18.621 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-04T18:41:18.622 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-04T18:41:18.622 INFO:teuthology.misc:Compressing logs...
2021-12-04T18:41:18.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com'
2021-12-04T18:41:18.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com'
2021-12-04T18:41:18.863 INFO:teuthology.orchestra.run.smithi029.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-04T18:41:19.049 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-04T18:41:19.091 INFO:teuthology.orchestra.run.smithi029.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-04T18:41:19.092 INFO:teuthology.orchestra.run.smithi029.stderr:tar: Error is not recoverable: exiting now
2021-12-04T18:41:19.149 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-04T18:41:19.149 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now
2021-12-04T18:41:19.150 INFO:teuthology.misc:Compressing logs...
2021-12-04T18:41:19.546 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-04T18:41:19.745 INFO:teuthology.misc:Compressing logs...
2021-12-04T18:41:27.500 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-mgr.smithi192.voawqg.log: file size changed while zipping
2021-12-04T18:41:48.180 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-04T18:41:57.003 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-04T18:42:14.550 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-04T18:42:14.815 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-mgr.smithi029.aowkxv.log: file size changed while zipping
2021-12-04T18:42:21.167 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-04T18:42:31.081 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-mon.smithi192.log: file size changed while zipping
2021-12-04T18:42:33.054 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-04T18:42:54.200 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-mon.smithi029.log: file size changed while zipping
2021-12-04T18:42:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-04T18:43:17.366 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-04T18:43:21.675 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/96e54f10-54cd-11ec-8c2e-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-04T18:44:11.071 INFO:teuthology.kill:No teuthology processes running
2021-12-04T18:44:12.166 INFO:teuthology.kill:Nuking machines: ['smithi029', 'smithi192']
2021-12-04T18:44:13.079 INFO:teuthology.kill:2021-12-04 18:44:13,079.079 INFO:teuthology.nuke:targets:
2021-12-04T18:44:13.080 INFO:teuthology.kill:  smithi029.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDF7ZcP8GQmLDHC0xMYGSL9SYau5CxpsgWLLtkhls1VniVpqadvKvYlTHopEsFIC0z/MMwQWUG++fRwoE40ZqfvZ1tdRfJpF/gwnetPdzz7et61ZWs3yJIfrY/UGvABciRjvWxGP+cUMY1c9ZJhjBEvbbaJB7UFDtt9LqPyjPKtweu2cWj2iYidCcMXPZvYWfiYc1+5uQrHxigH7nry7aENy2hb8cOlzz5TmgRvTXo8bR6UH2SdbTApr3YmEsUe9Sh+eADGnWpmWrWhpF5xULp1V60f2yP6migMNc5DPo/563Op8BvB6zxXHzJf+E9RGpL/oI7fSLB35gE3BZI+tTrVWE0yVq8lQhXIwCLeGpMNdDNZN8dPEjTub640S6zrb2cNI4zYVnO1p6kI31uj702P5t/eNOgT5juZ212K3F/ZEcOeMtuFKwJb5nJeoEp+n5tnw3dJL+omBEuIRt08SlVLa8wlx28RL/7GPLokP7rqtdTxjqd6UsRtf/JEfj/GRnE=
2021-12-04T18:44:13.080 INFO:teuthology.kill:  smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDeBiaT4JO8LYeaGjnO0i8r4/Rc0xRi+ta3sVdLTtToR5F32yYieKTu5D7EqlQJnG/YttI/1S2v4Wp0xQnWr1oE4ZAwo3LpP8BjnMnm9Mwce0P0CgxySlh6NdPdynONcxwx0EYA0hW1VHr5RCuZGkjZ5j2chQr/j5QYfYoF1QNX8fdZfbPSomeQLMNvEekeHo2aSN8lWvRV5QDjnIkS7lh5N9iESN6+75+Knx+7sYTxE4/4jnuciY6FOWSg2RiLvEHx+w4atisgD764muFCc2ViN22+tAODSrON64jr8oPcH0SGPQiHqEGUVUUU7HCrPOALPq5A9JnHOzk79kxKGGqfD2AYcOKa6t91YRi1rVHmI5CWdj8gOAOhFJ67O1l9gYm5tOfEwBpXL47m1ByhfZX1VHb+geEKUWuGcuL1cAZWFfRwiF1p5NfQQw2VosE9TMfNH9wGsO0+oC1Gf7Ep3lERdvOkkkclfZK625q1EBLpN6o12gsl5WcKj1zsq+j7ehk=
2021-12-04T18:44:13.104 INFO:teuthology.kill:2021-12-04 18:44:13,104.104 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-04T18:44:13.108 INFO:teuthology.kill:2021-12-04 18:44:13,108.108 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-04T18:44:13.179 INFO:teuthology.kill:2021-12-04 18:44:13,179.179 INFO:teuthology.orchestra.console:Power off smithi192
2021-12-04T18:44:13.193 INFO:teuthology.kill:2021-12-04 18:44:13,193.193 INFO:teuthology.orchestra.console:Power off smithi029
2021-12-04T18:44:21.554 INFO:teuthology.kill:2021-12-04 18:44:21,554.554 INFO:teuthology.orchestra.console:Power off for smithi029 completed
2021-12-04T18:44:21.699 INFO:teuthology.kill:2021-12-04 18:44:21,698.698 INFO:teuthology.lock.ops:unlocked: smithi029.front.sepia.ceph.com
2021-12-04T18:44:25.659 INFO:teuthology.kill:2021-12-04 18:44:25,659.659 INFO:teuthology.orchestra.console:Power off for smithi192 completed
2021-12-04T18:44:25.804 INFO:teuthology.kill:2021-12-04 18:44:25,804.804 INFO:teuthology.lock.ops:unlocked: smithi192.front.sepia.ceph.com
2021-12-04T18:46:26.109 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-04T18:46:26.204 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi029 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-04_18:18:15-rbd-wip-pwl-backports-december-pacific-distro-default-smithi/6544691
2021-12-04T18:46:26.205 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi192 but it was locked by another job: /home/teuthworker/archive/ideepika-2021-12-04_18:18:15-rbd-wip-pwl-backports-december-pacific-distro-default-smithi/6544691