2022-03-14T15:20:05.090 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-14T15:20:05.210 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging 2022-03-14T15:20:05.212 INFO:teuthology.lock.ops:Updating [ubuntu@smithi057.front.sepia.ceph.com]: reset os type and version on server 2022-03-14T15:20:05.212 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2022-03-14T15:20:05.230 INFO:teuthology.lock.ops:Node 'ubuntu@smithi057.front.sepia.ceph.com' reimaging is complete 2022-03-14T15:20:05.230 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging 2022-03-14T15:20:05.231 INFO:teuthology.lock.ops:Updating [ubuntu@smithi089.front.sepia.ceph.com]: reset os type and version on server 2022-03-14T15:20:05.231 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2022-03-14T15:20:05.250 INFO:teuthology.lock.ops:Node 'ubuntu@smithi089.front.sepia.ceph.com' reimaging is complete 2022-03-14T15:20:05.435 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 8.stream 2022-03-14T15:20:05.452 INFO:teuthology.provision.fog.smithi089:Scheduling deploy of centos 8.stream 2022-03-14T15:20:05.763 INFO:teuthology.orchestra.console:Power off smithi057 2022-03-14T15:20:05.776 INFO:teuthology.orchestra.console:Power off smithi089 2022-03-14T15:20:18.246 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2022-03-14T15:20:18.251 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2022-03-14T15:20:18.348 INFO:teuthology.orchestra.console:Power on smithi057 2022-03-14T15:20:18.355 INFO:teuthology.orchestra.console:Power on smithi089 2022-03-14T15:20:22.604 INFO:teuthology.orchestra.console:Power on for smithi089 completed 2022-03-14T15:20:22.705 INFO:teuthology.provision.fog.smithi089:Waiting for deploy to finish 2022-03-14T15:20:26.711 INFO:teuthology.orchestra.console:Power on for smithi057 completed 2022-03-14T15:20:26.812 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish 2022-03-14T15:24:54.313 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-14T15:24:54.547 INFO:teuthology.provision.fog.smithi089:Node is ready 2022-03-14T15:24:54.604 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089.front.sepia.ceph.com 2022-03-14T15:24:54.661 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89 smithi089.front.sepia.ceph.com smithi089 2022-03-14T15:24:54.986 INFO:teuthology.provision.fog.smithi089:Deploy complete! 2022-03-14T15:24:58.294 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-14T15:24:58.556 INFO:teuthology.provision.fog.smithi057:Node is ready 2022-03-14T15:24:58.574 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com 2022-03-14T15:24:58.633 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057 2022-03-14T15:24:58.989 INFO:teuthology.provision.fog.smithi057:Deploy complete! 2022-03-14T15:24:59.165 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com 2022-03-14T15:24:59.166 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-14T15:24:59.185 INFO:teuthology.lock.ops:Checking smithi089.front.sepia.ceph.com 2022-03-14T15:24:59.185 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-14T15:24:59.203 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server 2022-03-14T15:24:59.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2022-03-14T15:24:59.396 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2022-03-14T15:24:59.453 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2022-03-14T15:24:59.454 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2022-03-14T15:24:59.454 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2022-03-14T15:24:59.454 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2022-03-14T15:24:59.454 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2022-03-14T15:24:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2022-03-14T15:24:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-14T15:24:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2022-03-14T15:24:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-14T15:24:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2022-03-14T15:24:59.456 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-14T15:24:59.456 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-14T15:24:59.456 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-14T15:24:59.457 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2022-03-14T15:24:59.475 INFO:teuthology.lock.ops:Updating [smithi089.front.sepia.ceph.com]: set os type and version on server 2022-03-14T15:24:59.475 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2022-03-14T15:24:59.672 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2022-03-14T15:24:59.731 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2022-03-14T15:24:59.731 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="8" 2022-03-14T15:24:59.731 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2022-03-14T15:24:59.732 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2022-03-14T15:24:59.732 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="8" 2022-03-14T15:24:59.732 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el8" 2022-03-14T15:24:59.732 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-14T15:24:59.732 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2022-03-14T15:24:59.733 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-14T15:24:59.733 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2022-03-14T15:24:59.733 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-14T15:24:59.733 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-14T15:24:59.734 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-14T15:24:59.734 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2022-03-14T15:24:59.829 INFO:teuthology.dispatcher.supervisor:Running job 6735900 2022-03-14T15:24:59.829 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6735900 --name vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/snapshots} -- /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6735900/orig.config.yaml 2022-03-14T15:24:59.833 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6735900 2022-03-14T15:24:59.834 INFO:teuthology.dispatcher.supervisor:Job PID: 27992 2022-03-14T15:24:59.835 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-14T21:55:29.006 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-14T21:55:29.225 INFO:teuthology.kill:Killing Pids: {27992} 2022-03-14T21:55:30.398 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-03-14T21:55:30.399 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-03-14T21:55:30.399 INFO:teuthology.misc:Compressing logs... 2022-03-14T21:55:30.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2022-03-14T21:55:30.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2022-03-14T21:55:31.075 INFO:teuthology.misc:Compressing logs... 2022-03-14T21:55:31.367 INFO:teuthology.misc:Compressing logs... 2022-03-14T21:56:37.636 INFO:teuthology.kill:No teuthology processes running 2022-03-14T21:56:38.779 INFO:teuthology.kill:Nuking machines: ['smithi057', 'smithi089'] 2022-03-14T21:56:39.802 INFO:teuthology.kill:2022-03-14 21:56:39,802.802 INFO:teuthology.nuke:targets: 2022-03-14T21:56:39.803 INFO:teuthology.kill: smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDebXeMoi3AXRaOOyHjxpNfXkU0xQX/ZMTNv79Shl/oTva51aw60430yK6EPesmc+wiMwSBsIRN8vY73JP6oyXYUhloZOC+AVFn6n7ZC3v1xBfQXtCzENwf/vFBjuY4p/x+kku/MCP/ed6UBbaR4KzjoSPT01u4q7aOwgex89ev74pcAzhAvytLIOi1mIoF16ZpX1O8zPMg0O9FY9nheDSJjx2fVz/Jr5JJnJCxKqZG2cAicGPcfJORfBg3oI/SbnbF/fepEBG4zJtb38+gow9mJBmmy8nRrGBTWtBtGBBujxycTPy/J2csUiQjea92AJbjutzAkeDumj3NP582zqTZyHeyPNsfu2h7oYb5ZWmVb23Kzj4BoJipYnI3YUK7yT1cn0o86bFl2qdZtJO3ZCPmyNLKnu9tsTht+ovZ7k/kxEVYLBiZeXozZtKcjLWD0O6qKbuOfRtNdSlMANOXKDaw0NNG93A0gReE2BpLB4b8sMqJ4kCNK9dgPqAewgPwWJU= 2022-03-14T21:56:39.804 INFO:teuthology.kill: smithi089.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsfZIpJG300hhtiIOIBWktToVYBIHUIH2B+9PI2U8CliQV8PbvlrHg2ApBRU8tm0V2RwHmE6jBJHXDZ2+uwORY0Rdo+i3Rdli6p04xKcdtMH/xIc40WcCdrd2vjsXdheFZkjUMjCogQx66KsKiQUZ9D6H0FX5NmwuGelNIvhleqSwQ7s/MRzXpL985m0PJqjS9peCTB/mrGpaGJz/hIBas+kP4LKhS8ro6mtzxzEHYaZDFEA1U3qbDk6ISkziHaEHG+wAJtg/J7MxRbWHJ8CyioP2CXy9VyYu93DRgxgpRffw+WpX5zxms3ToYv5ZqDRknpgptscczwlwXaIsiNSQ0N6JEFeWNUdsvidNjrWxCRc/uJdQO36Ls57K3Raz31xzI09SXL5yy3GG37ct3ke1NuQLxPRyaN6coq7104DE+k6JGPJIeBm8TuxmRbWIoYENCEmU21mETysf11CDXf2SZutZskkTdIJmRJrI9/6HcTltiqs2kJQLv5pVXDNWIG8c= 2022-03-14T21:56:39.829 INFO:teuthology.kill:2022-03-14 21:56:39,828.828 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-14T21:56:39.832 INFO:teuthology.kill:2022-03-14 21:56:39,832.832 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-14T21:56:39.909 INFO:teuthology.kill:2022-03-14 21:56:39,909.909 INFO:teuthology.orchestra.console:Power off smithi057 2022-03-14T21:56:39.923 INFO:teuthology.kill:2022-03-14 21:56:39,922.922 INFO:teuthology.orchestra.console:Power off smithi089 2022-03-14T21:56:52.387 INFO:teuthology.kill:2022-03-14 21:56:52,386.386 INFO:teuthology.orchestra.console:Power off for smithi057 completed 2022-03-14T21:56:52.395 INFO:teuthology.kill:2022-03-14 21:56:52,395.395 INFO:teuthology.orchestra.console:Power off for smithi089 completed 2022-03-14T21:56:52.537 INFO:teuthology.kill:2022-03-14 21:56:52,536.536 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com 2022-03-14T21:56:52.546 INFO:teuthology.kill:2022-03-14 21:56:52,546.546 INFO:teuthology.lock.ops:unlocked: smithi089.front.sepia.ceph.com 2022-03-14T21:58:52.830 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-14T21:58:52.935 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi057 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-14_18:47:44-rados-wip-yuri3-testing-2022-03-14-0946-distro-default-smithi/6736563 2022-03-14T21:58:52.936 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi089 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-03-14_18:47:44-rados-wip-yuri3-testing-2022-03-14-0946-distro-default-smithi/6736559