2022-03-21T09:48:58.338 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-21T09:48:58.460 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging 2022-03-21T09:48:58.461 INFO:teuthology.lock.ops:Updating [ubuntu@smithi152.front.sepia.ceph.com]: reset os type and version on server 2022-03-21T09:48:58.461 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-03-21T09:48:58.480 INFO:teuthology.lock.ops:Node 'ubuntu@smithi152.front.sepia.ceph.com' reimaging is complete 2022-03-21T09:48:58.481 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging 2022-03-21T09:48:58.481 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server 2022-03-21T09:48:58.481 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-03-21T09:48:58.501 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete 2022-03-21T09:48:58.699 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2022-03-21T09:48:58.707 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.stream 2022-03-21T09:48:59.006 INFO:teuthology.orchestra.console:Power off smithi155 2022-03-21T09:48:59.020 INFO:teuthology.orchestra.console:Power off smithi152 2022-03-21T09:48:59.148 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-03-21T09:48:59.161 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-03-21T09:48:59.251 INFO:teuthology.orchestra.console:Power on smithi155 2022-03-21T09:48:59.262 INFO:teuthology.orchestra.console:Power on smithi152 2022-03-21T09:49:03.511 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2022-03-21T09:49:03.612 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2022-03-21T09:49:07.728 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2022-03-21T09:49:07.829 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2022-03-21T09:54:08.304 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-21T09:54:08.552 INFO:teuthology.provision.fog.smithi152:Node is ready 2022-03-21T09:54:08.570 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2022-03-21T09:54:08.628 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2022-03-21T09:54:08.968 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2022-03-21T09:54:12.565 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-21T09:54:12.818 INFO:teuthology.provision.fog.smithi155:Node is ready 2022-03-21T09:54:12.875 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2022-03-21T09:54:12.933 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2022-03-21T09:54:13.277 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2022-03-21T09:54:13.428 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2022-03-21T09:54:13.429 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-21T09:54:13.448 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2022-03-21T09:54:13.449 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-21T09:54:13.466 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2022-03-21T09:54:13.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-03-21T09:54:13.664 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2022-03-21T09:54:13.722 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2022-03-21T09:54:13.723 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2022-03-21T09:54:13.723 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2022-03-21T09:54:13.723 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2022-03-21T09:54:13.723 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2022-03-21T09:54:13.723 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2022-03-21T09:54:13.724 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-21T09:54:13.724 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2022-03-21T09:54:13.724 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-21T09:54:13.724 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2022-03-21T09:54:13.725 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-21T09:54:13.725 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-21T09:54:13.725 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-21T09:54:13.726 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-03-21T09:54:13.745 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2022-03-21T09:54:13.746 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-03-21T09:54:13.932 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2022-03-21T09:54:13.988 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2022-03-21T09:54:13.989 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2022-03-21T09:54:13.989 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2022-03-21T09:54:13.989 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2022-03-21T09:54:13.989 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2022-03-21T09:54:13.990 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2022-03-21T09:54:13.990 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-21T09:54:13.990 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2022-03-21T09:54:13.990 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-21T09:54:13.990 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2022-03-21T09:54:13.991 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-21T09:54:13.991 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-21T09:54:13.991 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-21T09:54:13.992 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2022-03-21T09:54:14.085 INFO:teuthology.dispatcher.supervisor:Running job 6749859 2022-03-21T09:54:14.085 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_a4e18662e5de936eb0ac089e531b933ecbcadb0a/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749859 --name vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{k-testing mount ms-die-on-skipped} objectstore-ec/bluestore-bitmap overrides/{mon-debug session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/fsstress validater/lockdep} -- /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749859/orig.config.yaml 2022-03-21T09:54:14.089 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-21_06:07:09-fs-wip-vshankar-testing-20220319-163539-testing-default-smithi/6749859 2022-03-21T09:54:14.090 INFO:teuthology.dispatcher.supervisor:Job PID: 6412 2022-03-21T09:54:14.091 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-21T16:24:42.452 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-21T16:24:42.769 INFO:teuthology.kill:Killing Pids: {6412} 2022-03-21T16:24:44.023 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-03-21T16:24:44.024 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-21T16:24:44.024 INFO:teuthology.misc:Compressing logs... 2022-03-21T16:24:44.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-03-21T16:24:44.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2022-03-21T16:24:44.660 INFO:teuthology.misc:Compressing logs... 2022-03-21T16:24:44.927 INFO:teuthology.misc:Compressing logs... 2022-03-21T16:33:52.218 INFO:teuthology.kill:No teuthology processes running 2022-03-21T16:33:53.408 INFO:teuthology.kill:Nuking machines: ['smithi152', 'smithi155'] 2022-03-21T16:33:54.366 INFO:teuthology.kill:2022-03-21 16:33:54,366.366 INFO:teuthology.nuke:targets: 2022-03-21T16:33:54.367 INFO:teuthology.kill: smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8CQ562Kw8t5hfkGG6a9Dy8e+8CQUan/8ZcmszmIeyeLnT/WcuynQeAjip9RQj8/u6e1rKtekSI090BMyL70IUuqCWCYKo+ToJVmD7fQ4PGcqiKXLvesmFW05j4JKfrmHCTj3XuGdOcFNcQAsiA/v/9Lc6WK8L1qPSGGYtnRFmJn3sOdVIbIaSPbmYZR6eGiL361ZQRWYlML+gcnFPanKwvEfW4G5bWxT4PcSgGwIo+VQK2NZLY5wnN0diEr8t6PGNMw/iou2sUyiZwv0e28Kjva/9SNUSQaQ0zZsgiMtX9BxjL+PluOnElbUgadYeZctYBj+5eNrmK8jajOT811NFxlkdVH0rHNCZkevyoVHNj0NRakE+iuSanZTVNgOk3fcbM/PmkZfxh383PyfEMhTCjAHu4aDndJSfLLxucDhogAhFzireL432mwLy5ovmmm3QLfB6E7iy+B/0yIYcnBSqQWQGigGnCm0EFvg4b9qMj5SIz5wVwzoJudAov/w1DGM= 2022-03-21T16:33:54.368 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDG6YGz1fmxWz61/r1k0R5jEu5xHqkoMnpL9lCaedJlDksia4M98J5bJclj1fbzV6ZcptsEPGGx5rvqZ/0yeIbLC6a6upzYJwpoGlLp4m+lxqvtamDIJNIX3h0/NMxa6u6XDler3LNJafGESnQnRnkN7wxaLWvrSPdKqCuBDkt846izr1mtXPk8Hp0zlDJWhND/m9/oE5TAnEJDJTtSt9Ed+qtYwSGaKp3KRExJvWr0DPLqZzOpyTjxXPq3oy/QCeBOwKFAg42QsXKjCEOIUVuSx/DqlJbd6QY03tWbhLE4UUA6vM9qQytidjkQwjD8KZGMP7grPrwpFzEfvdsgOodEPeXkYZx5j4VDknYbPJG5HovNJaZ8h6DiATfAaaMPr8mAj6jbfwFXq4N0sYZo2lBM7Cc9XTjGFzjfas4h57uB5AzSjM634xalGCJeJs8jNzwwzt2bTTBRXwvoayMVnYjUgmyvdIZlT3Kf8R2X5xiAEV3RtrKkJNK/OTCWgYfS1nM= 2022-03-21T16:33:54.392 INFO:teuthology.kill:2022-03-21 16:33:54,392.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-21T16:33:54.395 INFO:teuthology.kill:2022-03-21 16:33:54,395.395 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-21T16:33:54.476 INFO:teuthology.kill:2022-03-21 16:33:54,475.475 INFO:teuthology.orchestra.console:Power off smithi152 2022-03-21T16:33:54.490 INFO:teuthology.kill:2022-03-21 16:33:54,490.490 INFO:teuthology.orchestra.console:Power off smithi155 2022-03-21T16:34:06.961 INFO:teuthology.kill:2022-03-21 16:34:06,961.961 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-03-21T16:34:06.966 INFO:teuthology.kill:2022-03-21 16:34:06,966.966 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2022-03-21T16:34:07.112 INFO:teuthology.kill:2022-03-21 16:34:07,111.111 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2022-03-21T16:34:07.116 INFO:teuthology.kill:2022-03-21 16:34:07,116.116 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2022-03-21T16:36:07.408 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-21T16:36:07.515 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_13:12:20-fs-master-testing-default-smithi/6750227 2022-03-21T16:36:07.515 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/vshankar-2022-03-21_13:12:20-fs-master-testing-default-smithi/6750227