2021-12-01T18:04:15.003 INFO:root:teuthology version: 1.1.0-a0bc3188
2021-12-01T18:04:15.127 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba001.front.sepia.ceph.com' reimaging
2021-12-01T18:04:15.128 INFO:teuthology.lock.ops:Updating [ubuntu@gibba001.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T18:04:15.129 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server
2021-12-01T18:04:15.148 INFO:teuthology.lock.ops:Node 'ubuntu@gibba001.front.sepia.ceph.com' reimaging is complete
2021-12-01T18:04:15.148 INFO:teuthology.lock.ops:Start node 'ubuntu@gibba004.front.sepia.ceph.com' reimaging
2021-12-01T18:04:15.148 INFO:teuthology.lock.ops:Updating [ubuntu@gibba004.front.sepia.ceph.com]: reset os type and version on server
2021-12-01T18:04:15.149 INFO:teuthology.lock.ops:Updating gibba004.front.sepia.ceph.com on lock server
2021-12-01T18:04:15.167 INFO:teuthology.lock.ops:Node 'ubuntu@gibba004.front.sepia.ceph.com' reimaging is complete
2021-12-01T18:04:15.393 INFO:teuthology.provision.fog.gibba001:Scheduling deploy of centos 8.stream
2021-12-01T18:04:15.408 INFO:teuthology.provision.fog.gibba004:Scheduling deploy of centos 8.stream
2021-12-01T18:04:15.940 INFO:teuthology.orchestra.console:Power off gibba001
2021-12-01T18:04:16.024 INFO:teuthology.orchestra.console:Power off gibba004
2021-12-01T18:04:24.410 INFO:teuthology.orchestra.console:Power off for gibba001 completed
2021-12-01T18:04:24.512 INFO:teuthology.orchestra.console:Power on gibba001
2021-12-01T18:04:28.600 INFO:teuthology.orchestra.console:Power off for gibba004 completed
2021-12-01T18:04:28.702 INFO:teuthology.orchestra.console:Power on gibba004
2021-12-01T18:04:32.893 INFO:teuthology.orchestra.console:Power on for gibba001 completed
2021-12-01T18:04:32.994 INFO:teuthology.provision.fog.gibba001:Waiting for deploy to finish
2021-12-01T18:04:37.074 INFO:teuthology.orchestra.console:Power on for gibba004 completed
2021-12-01T18:04:37.175 INFO:teuthology.provision.fog.gibba004:Waiting for deploy to finish
2021-12-01T18:09:05.048 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T18:09:05.278 INFO:teuthology.provision.fog.gibba001:Node is ready
2021-12-01T18:09:05.291 INFO:teuthology.orchestra.run.gibba001.stdout:gibba001.front.sepia.ceph.com
2021-12-01T18:09:05.345 INFO:teuthology.orchestra.run.gibba001.stdout:172.21.2.101 gibba001.front.sepia.ceph.com gibba001
2021-12-01T18:09:05.638 INFO:teuthology.provision.fog.gibba001:Deploy complete!
2021-12-01T18:09:09.048 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-01T18:09:09.293 INFO:teuthology.provision.fog.gibba004:Node is ready
2021-12-01T18:09:09.345 INFO:teuthology.orchestra.run.gibba004.stdout:gibba004.front.sepia.ceph.com
2021-12-01T18:09:09.398 INFO:teuthology.orchestra.run.gibba004.stdout:172.21.2.104 gibba004.front.sepia.ceph.com gibba004
2021-12-01T18:09:09.692 INFO:teuthology.provision.fog.gibba004:Deploy complete!
2021-12-01T18:09:09.847 INFO:teuthology.lock.ops:Checking gibba001.front.sepia.ceph.com
2021-12-01T18:09:09.848 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T18:09:09.867 INFO:teuthology.lock.ops:Checking gibba004.front.sepia.ceph.com
2021-12-01T18:09:09.868 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-01T18:09:09.887 INFO:teuthology.lock.ops:Updating [gibba001.front.sepia.ceph.com]: set os type and version on server
2021-12-01T18:09:09.887 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com'
2021-12-01T18:09:10.095 INFO:teuthology.orchestra.run.gibba001.stdout:x86_64
2021-12-01T18:09:10.148 INFO:teuthology.orchestra.run.gibba001.stdout:NAME="CentOS Stream"
2021-12-01T18:09:10.149 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION="8"
2021-12-01T18:09:10.149 INFO:teuthology.orchestra.run.gibba001.stdout:ID="centos"
2021-12-01T18:09:10.149 INFO:teuthology.orchestra.run.gibba001.stdout:ID_LIKE="rhel fedora"
2021-12-01T18:09:10.149 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION_ID="8"
2021-12-01T18:09:10.150 INFO:teuthology.orchestra.run.gibba001.stdout:PLATFORM_ID="platform:el8"
2021-12-01T18:09:10.150 INFO:teuthology.orchestra.run.gibba001.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T18:09:10.150 INFO:teuthology.orchestra.run.gibba001.stdout:ANSI_COLOR="0;31"
2021-12-01T18:09:10.150 INFO:teuthology.orchestra.run.gibba001.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T18:09:10.151 INFO:teuthology.orchestra.run.gibba001.stdout:HOME_URL="https://centos.org/"
2021-12-01T18:09:10.151 INFO:teuthology.orchestra.run.gibba001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T18:09:10.151 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T18:09:10.151 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T18:09:10.153 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server
2021-12-01T18:09:10.177 INFO:teuthology.lock.ops:Updating [gibba004.front.sepia.ceph.com]: set os type and version on server
2021-12-01T18:09:10.178 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba004.front.sepia.ceph.com'
2021-12-01T18:09:10.384 INFO:teuthology.orchestra.run.gibba004.stdout:x86_64
2021-12-01T18:09:10.438 INFO:teuthology.orchestra.run.gibba004.stdout:NAME="CentOS Stream"
2021-12-01T18:09:10.438 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION="8"
2021-12-01T18:09:10.438 INFO:teuthology.orchestra.run.gibba004.stdout:ID="centos"
2021-12-01T18:09:10.439 INFO:teuthology.orchestra.run.gibba004.stdout:ID_LIKE="rhel fedora"
2021-12-01T18:09:10.439 INFO:teuthology.orchestra.run.gibba004.stdout:VERSION_ID="8"
2021-12-01T18:09:10.439 INFO:teuthology.orchestra.run.gibba004.stdout:PLATFORM_ID="platform:el8"
2021-12-01T18:09:10.439 INFO:teuthology.orchestra.run.gibba004.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-01T18:09:10.439 INFO:teuthology.orchestra.run.gibba004.stdout:ANSI_COLOR="0;31"
2021-12-01T18:09:10.440 INFO:teuthology.orchestra.run.gibba004.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-01T18:09:10.440 INFO:teuthology.orchestra.run.gibba004.stdout:HOME_URL="https://centos.org/"
2021-12-01T18:09:10.440 INFO:teuthology.orchestra.run.gibba004.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-01T18:09:10.440 INFO:teuthology.orchestra.run.gibba004.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-01T18:09:10.440 INFO:teuthology.orchestra.run.gibba004.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-01T18:09:10.441 INFO:teuthology.lock.ops:Updating gibba004.front.sepia.ceph.com on lock server
2021-12-01T18:09:10.541 INFO:teuthology.dispatcher.supervisor:Running job 6531265
2021-12-01T18:09:10.541 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a0bc318848afe71da1fbf34e1e1b44738d8e3d6d/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2021-11-28_07:01:03-rados-master-distro-default-gibba/6531265 --name teuthology-2021-11-28_07:01:03-rados-master-distro-default-gibba --description rados/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/teuthology-2021-11-28_07:01:03-rados-master-distro-default-gibba/6531265/orig.config.yaml
2021-12-01T18:09:10.545 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2021-11-28_07:01:03-rados-master-distro-default-gibba/6531265
2021-12-01T18:09:10.545 INFO:teuthology.dispatcher.supervisor:Job PID: 18034
2021-12-01T18:09:10.546 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-02T06:10:01.821 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-02T06:10:02.871 INFO:teuthology.kill:Killing Pids: {18034}
2021-12-02T06:10:04.263 INFO:teuthology.task.internal:roles: ubuntu@gibba001.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-02T06:10:04.265 INFO:teuthology.task.internal:roles: ubuntu@gibba004.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-02T06:10:04.270 INFO:teuthology.misc:Compressing logs...
2021-12-02T06:10:04.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba001.front.sepia.ceph.com'
2021-12-02T06:10:04.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba004.front.sepia.ceph.com'
2021-12-02T06:10:05.013 INFO:teuthology.orchestra.run.gibba001.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-02T06:10:05.190 INFO:teuthology.orchestra.run.gibba004.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-02T06:10:05.226 INFO:teuthology.orchestra.run.gibba001.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-02T06:10:05.227 INFO:teuthology.orchestra.run.gibba001.stderr:tar: Error is not recoverable: exiting now
2021-12-02T06:10:05.277 INFO:teuthology.orchestra.run.gibba004.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-02T06:10:05.277 INFO:teuthology.orchestra.run.gibba004.stderr:tar: Error is not recoverable: exiting now
2021-12-02T06:10:05.278 INFO:teuthology.misc:Compressing logs...
2021-12-02T06:10:05.830 INFO:teuthology.misc:Compressing logs...
2021-12-02T06:10:08.163 INFO:teuthology.orchestra.run.gibba001.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-02T06:10:08.517 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-02T06:10:11.287 INFO:teuthology.orchestra.run.gibba001.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-02T06:10:11.332 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-02T06:10:14.531 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-02T06:10:14.659 INFO:teuthology.orchestra.run.gibba001.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-02T06:10:16.098 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-mon.gibba004.log: file size changed while zipping
2021-12-02T06:10:18.090 INFO:teuthology.orchestra.run.gibba001.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-02T06:10:19.329 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-02T06:10:20.543 INFO:teuthology.orchestra.run.gibba004.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-mgr.gibba004.dhwuug.log: file size changed while zipping
2021-12-02T06:10:21.388 INFO:teuthology.orchestra.run.gibba001.stderr:gzip: /var/log/ceph/06c9f576-52d3-11ec-8c2d-001a4aab830c/ceph-mon.gibba001.log: file size changed while zipping
2021-12-02T06:11:06.098 INFO:teuthology.kill:No teuthology processes running
2021-12-02T06:11:07.304 INFO:teuthology.kill:Nuking machines: ['gibba001', 'gibba004']
2021-12-02T06:11:08.198 INFO:teuthology.kill:2021-12-02 06:11:08,198.198 INFO:teuthology.nuke:targets:
2021-12-02T06:11:08.199 INFO:teuthology.kill:  gibba001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6OeU+YijjQ+uNMI/5ZgqeHT6pJLIfyZwfw0PxPpClntOxZhPBQgNK2qm+BiXURukL03VxWCywxxX6ln8OuSBlrV9oYr0yOVmTIkvMSofLyfxSTiaP0PopSVnQuBVKmB9XEs8isH6NHFplgnEFSJg/Jmw9Kw8+zOLhFtHuk5OPNWf78AjR9gXClSSKEEvYs4GOYzQEXffbQZls1zhArJFTsL9JYs69nGcsvO8jIQG+wht2hErG3HVdwZu4K6j2yMTpJlUNPJ93hG0dLSpie2UPsxMCKGt+ijR8g1se/T2ZdpPUAZ21/ZObr4R4YrKQZqSnQ7/aDAk7jBOC7vPuGtttFYnj9uUKk9EDPHaHnlzmJzuuClnuxe9WTVXnTodcr/eCjtx21ZOST66czeiO1UfRoWVxql7qrbzvZCERwUkosaiKZrhCpDlE+1DnBefbhuafaXppr/S8pFj6HkDfAT45NQO5jFqzLOuPsULpvZ1zzz5ByHUx31uCejbZvT0KaDE=
2021-12-02T06:11:08.200 INFO:teuthology.kill:  gibba004.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZQG6m720yUw0VE39EUul1U4W+4nWZDheH+xp0kKaxSHVYLvHSwLVNnbqxV12NCUUdboi4RbLqZwie7Cvav8e/kEyGHWN9uqyj/c9ICfn1SEe1/VgMvLJqWL9dRcSaVcSXGNrvhnvf5MQNaGOAcunD/vTxTcDNxMPh6zamtW/4bprHXp9Rt66OJLnjjF2l53SGwsfBYp6TGqOj7m8AOQXgpb8CfxzlLaMradoRd7pwAZjk1svagpI9cwlDpkZqbhSxVJ51whxCI1OJQD2mxa1Wsgp1V412bwh1QYCCw1hjwIz0wX299pSnCzlhv7zLLr9dGwcgTnkBReliYOip9Gylvs6BCQoyQiTBN/haETQur7kHC47lwRHPSQ5JDJgLtAeWVQp8aa8J42e5E/xJlKniks+rh+XuTbSmq8uHe1sIuUJwqfF1/xIuwMILxrSPDKtggsveVm0F4+xyTG/We65srkOrvABBnDRVAdQb84cNoJgJ6t++jsP2Q9godmrGiBk=
2021-12-02T06:11:08.224 INFO:teuthology.kill:2021-12-02 06:11:08,224.224 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-02T06:11:08.227 INFO:teuthology.kill:2021-12-02 06:11:08,227.227 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-02T06:11:08.301 INFO:teuthology.kill:2021-12-02 06:11:08,301.301 INFO:teuthology.orchestra.console:Power off gibba004
2021-12-02T06:11:08.313 INFO:teuthology.kill:2021-12-02 06:11:08,313.313 INFO:teuthology.orchestra.console:Power off gibba001
2021-12-02T06:11:16.691 INFO:teuthology.kill:2021-12-02 06:11:16,691.691 INFO:teuthology.orchestra.console:Power off for gibba001 completed
2021-12-02T06:11:16.838 INFO:teuthology.kill:2021-12-02 06:11:16,837.837 INFO:teuthology.lock.ops:unlocked: gibba001.front.sepia.ceph.com
2021-12-02T06:11:20.808 INFO:teuthology.kill:2021-12-02 06:11:20,807.807 INFO:teuthology.orchestra.console:Power off for gibba004 completed
2021-12-02T06:11:20.952 INFO:teuthology.kill:2021-12-02 06:11:20,952.952 INFO:teuthology.lock.ops:unlocked: gibba004.front.sepia.ceph.com
2021-12-02T06:13:21.282 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15