2021-12-15T15:18:51.463 INFO:root:teuthology version: 1.1.0-95a7d479
2021-12-15T15:18:51.585 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging
2021-12-15T15:18:51.586 INFO:teuthology.lock.ops:Updating [ubuntu@smithi018.front.sepia.ceph.com]: reset os type and version on server
2021-12-15T15:18:51.586 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2021-12-15T15:18:51.604 INFO:teuthology.lock.ops:Node 'ubuntu@smithi018.front.sepia.ceph.com' reimaging is complete
2021-12-15T15:18:51.605 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi032.front.sepia.ceph.com' reimaging
2021-12-15T15:18:51.605 INFO:teuthology.lock.ops:Updating [ubuntu@smithi032.front.sepia.ceph.com]: reset os type and version on server
2021-12-15T15:18:51.605 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2021-12-15T15:18:51.624 INFO:teuthology.lock.ops:Node 'ubuntu@smithi032.front.sepia.ceph.com' reimaging is complete
2021-12-15T15:18:51.826 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 8.stream
2021-12-15T15:18:51.843 INFO:teuthology.provision.fog.smithi018:Scheduling deploy of centos 8.stream
2021-12-15T15:18:52.200 INFO:teuthology.orchestra.console:Power off smithi018
2021-12-15T15:18:52.214 INFO:teuthology.orchestra.console:Power off smithi032
2021-12-15T15:19:00.573 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2021-12-15T15:19:00.580 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2021-12-15T15:19:00.675 INFO:teuthology.orchestra.console:Power on smithi018
2021-12-15T15:19:00.684 INFO:teuthology.orchestra.console:Power on smithi032
2021-12-15T15:19:09.045 INFO:teuthology.orchestra.console:Power on for smithi018 completed
2021-12-15T15:19:09.050 INFO:teuthology.orchestra.console:Power on for smithi032 completed
2021-12-15T15:19:09.147 INFO:teuthology.provision.fog.smithi018:Waiting for deploy to finish
2021-12-15T15:19:09.151 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish
2021-12-15T15:23:43.920 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-15T15:23:43.981 INFO:teuthology.orchestra.run:Running command with timeout 600
2021-12-15T15:23:44.218 INFO:teuthology.provision.fog.smithi018:Node is ready
2021-12-15T15:23:44.236 INFO:teuthology.orchestra.run.smithi018.stdout:smithi018.front.sepia.ceph.com
2021-12-15T15:23:44.263 INFO:teuthology.provision.fog.smithi032:Node is ready
2021-12-15T15:23:44.280 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com
2021-12-15T15:23:44.295 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18 smithi018.front.sepia.ceph.com smithi018
2021-12-15T15:23:44.338 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032
2021-12-15T15:23:44.638 INFO:teuthology.provision.fog.smithi018:Deploy complete!
2021-12-15T15:23:44.676 INFO:teuthology.provision.fog.smithi032:Deploy complete!
2021-12-15T15:23:44.827 INFO:teuthology.lock.ops:Checking smithi018.front.sepia.ceph.com
2021-12-15T15:23:44.828 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-15T15:23:44.848 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com
2021-12-15T15:23:44.848 INFO:teuthology.lock.ops:New key found. Updating...
2021-12-15T15:23:44.869 INFO:teuthology.lock.ops:Updating [smithi018.front.sepia.ceph.com]: set os type and version on server
2021-12-15T15:23:44.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2021-12-15T15:23:45.061 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64
2021-12-15T15:23:45.118 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream"
2021-12-15T15:23:45.119 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="8"
2021-12-15T15:23:45.119 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos"
2021-12-15T15:23:45.119 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora"
2021-12-15T15:23:45.119 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="8"
2021-12-15T15:23:45.120 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el8"
2021-12-15T15:23:45.120 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-15T15:23:45.120 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31"
2021-12-15T15:23:45.120 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-15T15:23:45.121 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/"
2021-12-15T15:23:45.122 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-15T15:23:45.122 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-15T15:23:45.123 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-15T15:23:45.124 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server
2021-12-15T15:23:45.142 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server
2021-12-15T15:23:45.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2021-12-15T15:23:45.333 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64
2021-12-15T15:23:45.390 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream"
2021-12-15T15:23:45.390 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8"
2021-12-15T15:23:45.390 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos"
2021-12-15T15:23:45.391 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora"
2021-12-15T15:23:45.391 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8"
2021-12-15T15:23:45.391 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8"
2021-12-15T15:23:45.391 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8"
2021-12-15T15:23:45.392 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31"
2021-12-15T15:23:45.392 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2021-12-15T15:23:45.392 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/"
2021-12-15T15:23:45.392 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2021-12-15T15:23:45.393 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2021-12-15T15:23:45.393 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2021-12-15T15:23:45.393 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server
2021-12-15T15:23:45.497 INFO:teuthology.dispatcher.supervisor:Running job 6564144
2021-12-15T15:23:45.498 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_swagner@teuthology --archive /home/teuthworker/archive/swagner-2021-12-15_14:51:15-orch:cephadm-wip-swagner-testing-2021-12-15-1026-distro-default-smithi/6564144 --name swagner-2021-12-15_14:51:15-orch:cephadm-wip-swagner-testing-2021-12-15-1026-distro-default-smithi --description orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} -- /home/teuthworker/archive/swagner-2021-12-15_14:51:15-orch:cephadm-wip-swagner-testing-2021-12-15-1026-distro-default-smithi/6564144/orig.config.yaml
2021-12-15T15:23:45.501 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/swagner-2021-12-15_14:51:15-orch:cephadm-wip-swagner-testing-2021-12-15-1026-distro-default-smithi/6564144
2021-12-15T15:23:45.502 INFO:teuthology.dispatcher.supervisor:Job PID: 9663
2021-12-15T15:23:45.502 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2021-12-16T03:24:40.412 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2021-12-16T03:24:40.604 INFO:teuthology.kill:Killing Pids: {9663}
2021-12-16T03:24:41.837 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2021-12-16T03:24:41.838 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2021-12-16T03:24:41.838 INFO:teuthology.misc:Compressing logs...
2021-12-16T03:24:41.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com'
2021-12-16T03:24:42.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com'
2021-12-16T03:24:42.083 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-16T03:24:42.276 INFO:teuthology.orchestra.run.smithi032.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2021-12-16T03:24:42.322 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-16T03:24:42.322 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now
2021-12-16T03:24:42.362 INFO:teuthology.orchestra.run.smithi032.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2021-12-16T03:24:42.363 INFO:teuthology.orchestra.run.smithi032.stderr:tar: Error is not recoverable: exiting now
2021-12-16T03:24:42.365 INFO:teuthology.misc:Compressing logs...
2021-12-16T03:24:42.683 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-16T03:24:42.764 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2021-12-16T03:24:42.968 INFO:teuthology.misc:Compressing logs...
2021-12-16T03:24:43.451 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.3.log: file size changed while zipping
2021-12-16T03:24:43.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2021-12-16T03:24:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.2.log: file size changed while zipping
2021-12-16T03:24:44.662 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-mon.smithi018.log: file size changed while zipping
2021-12-16T03:24:45.125 INFO:teuthology.orchestra.run.smithi018.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2021-12-16T03:25:17.099 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.7.log: file size changed while zipping
2021-12-16T03:25:45.640 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.5.log: file size changed while zipping
2021-12-16T03:26:13.972 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.4.log: file size changed while zipping
2021-12-16T03:26:39.163 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-osd.6.log: file size changed while zipping
2021-12-16T03:26:49.895 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-mon.smithi032.log: file size changed while zipping
2021-12-16T03:26:54.439 INFO:teuthology.orchestra.run.smithi032.stderr:gzip: /var/log/ceph/bcd458d2-5dbb-11ec-8c31-001a4aab830c/ceph-mgr.smithi032.qcvpsj.log: file size changed while zipping
2021-12-16T03:27:46.344 INFO:teuthology.kill:No teuthology processes running
2021-12-16T03:27:47.455 INFO:teuthology.kill:Nuking machines: ['smithi018', 'smithi032']
2021-12-16T03:27:48.408 INFO:teuthology.kill:2021-12-16 03:27:48,408.408 INFO:teuthology.nuke:targets:
2021-12-16T03:27:48.410 INFO:teuthology.kill:  smithi018.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDn4xAXTOm0CY4qMpLDhYW2sBWWyfWaItzNforx2NQPMKrtOv8DJKmrQ5VBceym9Fn9l2+EvCGZUT7k42ReYqzl68JYqNJHPOfBlPskCO5LQa2GO3RjP2npp8sL6aK6YIaaIdiEEgQfH4Zed+ld6eXmv6Exxm5pxzL6eupzB1d97W1Kq6i3Cfngj6XaA6z5X0XJg+enYpRzkJFJJkIAImT74ZZUrcqRlcX0lnEj72TAktDOSRHAV2FdPtY8OEcz9/CGs2fedKow0CD7kxTt/mmU5nh1UPud9JH1DmBbMkTXo5rPnD6wSepQNm2cQf62f4wNgWW4NNd83QzLQNEY7jRM9Ljwc6nsttfe1PhQn9tAgGt0i1LSJ8FzbtGy8bR+s07ey59Ffd6JddmVymeVp5WcFN1y2cV0J+WngxEa7fvCm7vj4BSrakAr76sNypiXYfEnjCCrS3rJNjF6qtbvxoQzCFwhpksadRWDFTm6QzFzJldH01gf1QLoFT3ny8g4esk=
2021-12-16T03:27:48.410 INFO:teuthology.kill:  smithi032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbCA8WUJk3MKKUH6evZ7WUTSnTFV0tBXmOC7c7qYc7zNzNGKPKRIFPtRftUQGu53pIl94urgb49RSB0BC3HvDlbZnmkVoVnYE4gzVT8uRzgROXaTWhEtSGptPucIoI32DjciUo4cB9XEcJ55E+Wjnp4Wxuh8ujCsrPczMCB57trXdP8pvkzy95emgXYb3pyq9whEpG//n8BbmujdiusmtgRHKZRdfiGN7yREV0/HZcD4g4jNhMHKvA/gPYX6zGvZ4g49dY9m2J3riOJRxjzGus2fjD0mYtjZ0ntsUBfCbmcXn0soI38rYNYHAfa6mA//Z52M7e6C5yG6XIzVD5boO6K/oHd3huBxrB6pdtAdi0OjNDjpdc5vnfvP4kLWhGQy6sScJkzTPKh45oDfqUTz0riFKYzgqv0GViNOU/JMJ/UhvLKko4x+42yEB4ktQSI+kj08XHLy9ttin5xiKFm9O638ZXS2ADRry2V1ChD3nvu/3KRJR181uVaRDsRTxQfKk=
2021-12-16T03:27:48.435 INFO:teuthology.kill:2021-12-16 03:27:48,435.435 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-16T03:27:48.439 INFO:teuthology.kill:2021-12-16 03:27:48,439.439 INFO:teuthology.task.internal.check_lock:Checking locks...
2021-12-16T03:27:48.513 INFO:teuthology.kill:2021-12-16 03:27:48,512.512 INFO:teuthology.orchestra.console:Power off smithi032
2021-12-16T03:27:48.528 INFO:teuthology.kill:2021-12-16 03:27:48,527.527 INFO:teuthology.orchestra.console:Power off smithi018
2021-12-16T03:28:00.996 INFO:teuthology.kill:2021-12-16 03:28:00,996.996 INFO:teuthology.orchestra.console:Power off for smithi032 completed
2021-12-16T03:28:01.003 INFO:teuthology.kill:2021-12-16 03:28:01,002.002 INFO:teuthology.orchestra.console:Power off for smithi018 completed
2021-12-16T03:28:01.145 INFO:teuthology.kill:2021-12-16 03:28:01,144.144 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com
2021-12-16T03:28:01.147 INFO:teuthology.kill:2021-12-16 03:28:01,147.147 INFO:teuthology.lock.ops:unlocked: smithi018.front.sepia.ceph.com
2021-12-16T03:30:01.478 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2021-12-16T03:30:01.591 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi018 but it was locked by another job: /home/teuthworker/archive/akupczyk-2021-12-15_18:10:21-rados-wip-bluefs-fine-grain-locking-4-rebase-distro-default-smithi/6565138
2021-12-16T03:30:01.592 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/akupczyk-2021-12-15_18:10:21-rados-wip-bluefs-fine-grain-locking-4-rebase-distro-default-smithi/6565140