2021-09-23T03:49:51.846 INFO:root:teuthology version: 1.1.0-d3a488f5 2021-09-23T03:49:51.974 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging 2021-09-23T03:49:51.975 INFO:teuthology.lock.ops:Updating [ubuntu@smithi155.front.sepia.ceph.com]: reset os type and version on server 2021-09-23T03:49:51.976 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-09-23T03:49:51.992 INFO:teuthology.lock.ops:Node 'ubuntu@smithi155.front.sepia.ceph.com' reimaging is complete 2021-09-23T03:49:51.992 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging 2021-09-23T03:49:51.992 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server 2021-09-23T03:49:51.993 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2021-09-23T03:49:52.010 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete 2021-09-23T03:49:52.010 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging 2021-09-23T03:49:52.011 INFO:teuthology.lock.ops:Updating [ubuntu@smithi197.front.sepia.ceph.com]: reset os type and version on server 2021-09-23T03:49:52.011 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2021-09-23T03:49:52.028 INFO:teuthology.lock.ops:Node 'ubuntu@smithi197.front.sepia.ceph.com' reimaging is complete 2021-09-23T03:49:52.203 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of centos 8.3 2021-09-23T03:49:52.224 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.3 2021-09-23T03:49:52.229 INFO:teuthology.provision.fog.smithi197:Scheduling deploy of centos 8.3 2021-09-23T03:49:52.570 INFO:teuthology.orchestra.console:Power off smithi155 2021-09-23T03:49:52.586 INFO:teuthology.orchestra.console:Power off smithi162 2021-09-23T03:49:52.623 INFO:teuthology.orchestra.console:Power off smithi197 2021-09-23T03:50:00.956 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2021-09-23T03:50:01.059 INFO:teuthology.orchestra.console:Power on smithi162 2021-09-23T03:50:05.076 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-09-23T03:50:05.092 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2021-09-23T03:50:05.178 INFO:teuthology.orchestra.console:Power on smithi155 2021-09-23T03:50:05.193 INFO:teuthology.orchestra.console:Power on smithi197 2021-09-23T03:50:09.433 INFO:teuthology.orchestra.console:Power on for smithi155 completed 2021-09-23T03:50:09.446 INFO:teuthology.orchestra.console:Power on for smithi197 completed 2021-09-23T03:50:09.489 INFO:teuthology.orchestra.console:Power on for smithi162 completed 2021-09-23T03:50:09.534 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish 2021-09-23T03:50:09.548 INFO:teuthology.provision.fog.smithi197:Waiting for deploy to finish 2021-09-23T03:50:09.590 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2021-09-23T03:54:41.355 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-23T03:54:41.669 INFO:teuthology.provision.fog.smithi197:Node is ready 2021-09-23T03:54:41.684 INFO:teuthology.orchestra.run.smithi197.stdout:smithi197.front.sepia.ceph.com 2021-09-23T03:54:41.740 INFO:teuthology.orchestra.run.smithi197.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197 2021-09-23T03:54:42.072 INFO:teuthology.provision.fog.smithi197:Deploy complete! 2021-09-23T03:54:56.410 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-23T03:54:56.612 INFO:teuthology.provision.fog.smithi155:Node is ready 2021-09-23T03:54:56.627 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com 2021-09-23T03:54:56.682 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155 2021-09-23T03:54:57.007 INFO:teuthology.provision.fog.smithi155:Deploy complete! 2021-09-23T03:55:05.521 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-09-23T03:55:05.810 INFO:teuthology.provision.fog.smithi162:Node is ready 2021-09-23T03:55:05.825 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2021-09-23T03:55:05.880 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2021-09-23T03:55:06.197 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2021-09-23T03:55:06.343 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com 2021-09-23T03:55:06.344 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-23T03:55:06.363 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2021-09-23T03:55:06.363 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-23T03:55:06.377 INFO:teuthology.lock.ops:Checking smithi197.front.sepia.ceph.com 2021-09-23T03:55:06.378 INFO:teuthology.lock.ops:New key found. Updating... 2021-09-23T03:55:06.393 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server 2021-09-23T03:55:06.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2021-09-23T03:55:06.591 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2021-09-23T03:55:06.645 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Linux" 2021-09-23T03:55:06.646 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8" 2021-09-23T03:55:06.646 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2021-09-23T03:55:06.646 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2021-09-23T03:55:06.646 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8" 2021-09-23T03:55:06.647 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8" 2021-09-23T03:55:06.647 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Linux 8" 2021-09-23T03:55:06.647 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2021-09-23T03:55:06.647 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-23T03:55:06.647 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2021-09-23T03:55:06.648 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-09-23T03:55:06.648 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-09-23T03:55:06.648 INFO:teuthology.orchestra.run.smithi155.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-09-23T03:55:06.649 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2021-09-23T03:55:06.666 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2021-09-23T03:55:06.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2021-09-23T03:55:06.871 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2021-09-23T03:55:06.926 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Linux" 2021-09-23T03:55:06.926 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2021-09-23T03:55:06.927 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2021-09-23T03:55:06.927 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2021-09-23T03:55:06.927 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2021-09-23T03:55:06.927 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2021-09-23T03:55:06.928 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Linux 8" 2021-09-23T03:55:06.928 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2021-09-23T03:55:06.928 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-23T03:55:06.928 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2021-09-23T03:55:06.928 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-09-23T03:55:06.929 INFO:teuthology.orchestra.run.smithi162.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-09-23T03:55:06.929 INFO:teuthology.orchestra.run.smithi162.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-09-23T03:55:06.930 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2021-09-23T03:55:06.947 INFO:teuthology.lock.ops:Updating [smithi197.front.sepia.ceph.com]: set os type and version on server 2021-09-23T03:55:06.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2021-09-23T03:55:07.215 INFO:teuthology.orchestra.run.smithi197.stdout:x86_64 2021-09-23T03:55:07.269 INFO:teuthology.orchestra.run.smithi197.stdout:NAME="CentOS Linux" 2021-09-23T03:55:07.269 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION="8" 2021-09-23T03:55:07.270 INFO:teuthology.orchestra.run.smithi197.stdout:ID="centos" 2021-09-23T03:55:07.270 INFO:teuthology.orchestra.run.smithi197.stdout:ID_LIKE="rhel fedora" 2021-09-23T03:55:07.270 INFO:teuthology.orchestra.run.smithi197.stdout:VERSION_ID="8" 2021-09-23T03:55:07.270 INFO:teuthology.orchestra.run.smithi197.stdout:PLATFORM_ID="platform:el8" 2021-09-23T03:55:07.271 INFO:teuthology.orchestra.run.smithi197.stdout:PRETTY_NAME="CentOS Linux 8" 2021-09-23T03:55:07.271 INFO:teuthology.orchestra.run.smithi197.stdout:ANSI_COLOR="0;31" 2021-09-23T03:55:07.271 INFO:teuthology.orchestra.run.smithi197.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-09-23T03:55:07.271 INFO:teuthology.orchestra.run.smithi197.stdout:HOME_URL="https://centos.org/" 2021-09-23T03:55:07.271 INFO:teuthology.orchestra.run.smithi197.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-09-23T03:55:07.272 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-09-23T03:55:07.272 INFO:teuthology.orchestra.run.smithi197.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-09-23T03:55:07.272 INFO:teuthology.lock.ops:Updating smithi197.front.sepia.ceph.com on lock server 2021-09-23T03:55:07.357 INFO:teuthology.dispatcher.supervisor:Running job 6403352 2021-09-23T03:55:07.358 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d3a488f52e40d4e803797684b740cd06ea526c40/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2021-09-23_01:04:10-rados-wip-yuri6-testing-2021-09-22-1530-distro-basic-smithi/6403352 --name yuriw-2021-09-23_01:04:10-rados-wip-yuri6-testing-2021-09-22-1530-distro-basic-smithi --description rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} -- /home/teuthworker/archive/yuriw-2021-09-23_01:04:10-rados-wip-yuri6-testing-2021-09-22-1530-distro-basic-smithi/6403352/orig.config.yaml 2021-09-23T03:55:07.361 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2021-09-23_01:04:10-rados-wip-yuri6-testing-2021-09-22-1530-distro-basic-smithi/6403352 2021-09-23T03:55:07.362 INFO:teuthology.dispatcher.supervisor:Job PID: 15200 2021-09-23T03:55:07.362 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-09-23T15:55:58.103 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-09-23T15:55:58.289 INFO:teuthology.kill:Killing Pids: {15200} 2021-09-23T15:55:59.403 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'mon.a'] 2021-09-23T15:55:59.404 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['osd.4', 'osd.5', 'osd.6', 'osd.7', 'mon.b', 'mgr.x'] 2021-09-23T15:55:59.404 INFO:teuthology.task.internal:roles: ubuntu@smithi197.front.sepia.ceph.com - ['osd.8', 'osd.9', 'osd.10', 'osd.11', 'mon.c'] 2021-09-23T15:55:59.404 INFO:teuthology.misc:Compressing logs... 2021-09-23T15:55:59.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2021-09-23T15:55:59.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2021-09-23T15:55:59.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi197.front.sepia.ceph.com' 2021-09-23T15:56:00.342 INFO:teuthology.misc:Compressing logs... 2021-09-23T15:56:00.974 INFO:teuthology.orchestra.run.smithi162.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-23T15:56:01.166 INFO:teuthology.orchestra.run.smithi155.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-23T15:56:01.195 INFO:teuthology.orchestra.run.smithi197.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2021-09-23T15:56:10.202 INFO:teuthology.misc:Compressing logs... 2021-09-23T15:56:44.965 INFO:teuthology.kill:No teuthology processes running 2021-09-23T15:56:46.025 INFO:teuthology.kill:Nuking machines: ['smithi155', 'smithi162', 'smithi197'] 2021-09-23T15:56:47.012 INFO:teuthology.kill:2021-09-23 15:56:47,012.012 INFO:teuthology.nuke:targets: 2021-09-23T15:56:47.013 INFO:teuthology.kill: smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3LRm92wMxML8z/ZK8XX0P4pl5WPpATFMT49mmd4sRV2wL6NO3ri75Rn81EJC5+ny+M4MYmWYLWp34yrWvbiGtdY0ZYu7uAwlyIv8PkakgYYrsxXKiSzq5Sm53sQHcPq1h9XJ5aY4k2JUMWSguH052S2TePnkM0bTtW9q1o3l6O4Ys6KILfjOA2J4RSbmcOTebvsdX8eg3bOvdg1LanrN3wlIb38XOhS7tgpSvP14JalCKcy25cdrXjBkU6BvDJ2HZT7YqvVI/rJhduTawy7VJ4RHsYQcrf9bwRrVkGQXoCQeWTVMR+89C6y0CQy1rjA4mNHp3CsUwlj87lVd1wtonPsKGM9bSueV14WUyIjJyNsCTrNk6xhOIKXO6ByXb+JbVdxH1rifZUsfEFXE1FoI2PM2vRuiXriqhePnlRpQ0GFiSUAqhyH02ObOIHGadLGWHKkjZBhJqzZrg4PiWdvKwr6c6V5+VKOyc5yrq7b1bQQvZwGWlg7eDWIACk6dfjYU= 2021-09-23T15:56:47.014 INFO:teuthology.kill: smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoLftLkUCcyfrB+R5Z5QEYThGZJUFQqDeJ0pBO8Deejjtcl/hMlVyIrpkfapyWTjzwCBZ0/h5w/NVnxkymlp1QeI3PkMcSYYwczgsBnG7s3vT/wnb91mPqVprN0B70yVV9dHpLUjQb3v/m4cOj1FrRN7vE9Dof0YXPh0UJRs9B46LagaQe/s+YWGc/eOUxS7qc5sy+4ijoGhV2hQhLb7vQuvoNH2oiZbHAmqbz0UHCq1p485v7Av7MJfAD8maEQmQP8N6vqOSJ5RtBgb0JGAm9yZY+nqLvHeTmWVt0UZT4rCgLxrsQUUj3SLUNldRNx6dRpv4AXK6XJguJW5WpK2fERWh9j2ahYofnRXBNaHKBH56ew89oFY52EYH4MvdE7f6qnFcRyJ/j4e12atGBtzYQZqHtT4StMyXD7Ss9GJY/Vj6jW59vnSZad9kcIzBjgG6YxA29d8YhkWtFR2h6qErivR1Eq8T9CzFVFwQpPXz/qbS6bP6XHYHDI1KA4RkNWpk= 2021-09-23T15:56:47.014 INFO:teuthology.kill: smithi197.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDOKGjSSTCp6KkNYu466WbyZ6CitpcyLOUARyiUF8nj7dPAG4fwtiKuFYTFPIJdOqeRlemXCmWisaiyiP3VHhSWwZEBR+FaNS2QaqBK22iOrPfUW/fFouSD3DRuR42F21SyG6aaFM+/C6Q2ZaE+duJLzegYUlYqlOarqjxwJB27X7TEbNA+EjDn3I8ZnzwueddKEubuWUTmlhgsqD32QHTkm3BVkCWAvPujan4Egcp03VLszATepfk5/7fNk5a7t4rmfeR5AXg40jJ3fvV3bBzjtez6dGtukhJ4YtAlhra7mjArBiW4ttDE0+lFBmu+vxeED1GWZK31Zfdm0EFGrxVXVcqKMbUVkTadrREf9jGMcuRJYPRlTCInRXPUflivFbU/UJI8CNNec8ucZApgyjLvi7Ki8olus28CYKsr9OQXlElAIUg+rKTF3dLCuWap8YiWpu0PkjT5mmUaFpGsgwhGYaETqZlDh9S3ImqpMsZDxJnLjlYHO2ATTuY+nCYqYmM= 2021-09-23T15:56:47.036 INFO:teuthology.kill:2021-09-23 15:56:47,036.036 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-23T15:56:47.039 INFO:teuthology.kill:2021-09-23 15:56:47,039.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-23T15:56:47.043 INFO:teuthology.kill:2021-09-23 15:56:47,043.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-09-23T15:56:47.103 INFO:teuthology.kill:2021-09-23 15:56:47,102.102 INFO:teuthology.orchestra.console:Power off smithi155 2021-09-23T15:56:47.114 INFO:teuthology.kill:2021-09-23 15:56:47,114.114 INFO:teuthology.orchestra.console:Power off smithi197 2021-09-23T15:56:47.126 INFO:teuthology.kill:2021-09-23 15:56:47,126.126 INFO:teuthology.orchestra.console:Power off smithi162 2021-09-23T15:56:55.481 INFO:teuthology.kill:2021-09-23 15:56:55,480.480 INFO:teuthology.orchestra.console:Power off for smithi155 completed 2021-09-23T15:56:55.486 INFO:teuthology.kill:2021-09-23 15:56:55,486.486 INFO:teuthology.orchestra.console:Power off for smithi197 completed 2021-09-23T15:56:55.492 INFO:teuthology.kill:2021-09-23 15:56:55,492.492 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2021-09-23T15:56:55.649 INFO:teuthology.kill:2021-09-23 15:56:55,648.648 INFO:teuthology.lock.ops:unlocked: smithi197.front.sepia.ceph.com 2021-09-23T15:56:55.655 INFO:teuthology.kill:2021-09-23 15:56:55,655.655 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com 2021-09-23T15:56:56.676 INFO:teuthology.kill:2021-09-23 15:56:56,676.676 INFO:teuthology.lock.ops:unlocked: smithi162.front.sepia.ceph.com 2021-09-23T15:58:56.936 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15