2022-01-06T15:23:43.331 INFO:root:teuthology version: 1.1.0-95a7d479 2022-01-06T15:23:43.458 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging 2022-01-06T15:23:43.459 INFO:teuthology.lock.ops:Updating [ubuntu@smithi146.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T15:23:43.459 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-01-06T15:23:43.478 INFO:teuthology.lock.ops:Node 'ubuntu@smithi146.front.sepia.ceph.com' reimaging is complete 2022-01-06T15:23:43.478 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi187.front.sepia.ceph.com' reimaging 2022-01-06T15:23:43.478 INFO:teuthology.lock.ops:Updating [ubuntu@smithi187.front.sepia.ceph.com]: reset os type and version on server 2022-01-06T15:23:43.479 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-01-06T15:23:43.497 INFO:teuthology.lock.ops:Node 'ubuntu@smithi187.front.sepia.ceph.com' reimaging is complete 2022-01-06T15:23:43.683 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of centos 8.3 2022-01-06T15:23:43.696 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.3 2022-01-06T15:23:44.016 INFO:teuthology.orchestra.console:Power off smithi146 2022-01-06T15:23:44.030 INFO:teuthology.orchestra.console:Power off smithi187 2022-01-06T15:23:52.384 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-01-06T15:23:52.485 INFO:teuthology.orchestra.console:Power on smithi146 2022-01-06T15:23:56.500 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-01-06T15:23:56.602 INFO:teuthology.orchestra.console:Power on smithi187 2022-01-06T15:24:00.855 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2022-01-06T15:24:00.958 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2022-01-06T15:24:04.971 INFO:teuthology.orchestra.console:Power on for smithi187 completed 2022-01-06T15:24:05.072 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2022-01-06T15:29:10.073 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T15:29:10.370 INFO:teuthology.provision.fog.smithi187:Node is ready 2022-01-06T15:29:10.385 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2022-01-06T15:29:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2022-01-06T15:29:10.785 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2022-01-06T15:29:20.800 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-06T15:29:21.087 INFO:teuthology.provision.fog.smithi146:Node is ready 2022-01-06T15:29:21.102 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2022-01-06T15:29:21.157 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2022-01-06T15:29:21.481 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2022-01-06T15:29:21.627 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2022-01-06T15:29:21.627 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T15:29:21.647 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2022-01-06T15:29:21.647 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-06T15:29:21.664 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2022-01-06T15:29:21.665 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-01-06T15:29:21.869 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2022-01-06T15:29:21.923 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="CentOS Linux" 2022-01-06T15:29:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8" 2022-01-06T15:29:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:ID="centos" 2022-01-06T15:29:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="rhel fedora" 2022-01-06T15:29:21.926 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8" 2022-01-06T15:29:21.926 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2022-01-06T15:29:21.926 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-06T15:29:21.926 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2022-01-06T15:29:21.927 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T15:29:21.927 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://centos.org/" 2022-01-06T15:29:21.927 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T15:29:21.927 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T15:29:21.928 INFO:teuthology.orchestra.run.smithi146.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T15:29:21.930 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2022-01-06T15:29:21.953 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2022-01-06T15:29:21.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-01-06T15:29:22.228 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2022-01-06T15:29:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Linux" 2022-01-06T15:29:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2022-01-06T15:29:22.283 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2022-01-06T15:29:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2022-01-06T15:29:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2022-01-06T15:29:22.284 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2022-01-06T15:29:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Linux 8" 2022-01-06T15:29:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2022-01-06T15:29:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-01-06T15:29:22.285 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2022-01-06T15:29:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2022-01-06T15:29:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2022-01-06T15:29:22.286 INFO:teuthology.orchestra.run.smithi187.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2022-01-06T15:29:22.287 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2022-01-06T15:29:22.385 INFO:teuthology.dispatcher.supervisor:Running job 6598719 2022-01-06T15:29:22.386 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_95a7d4799b562f3bbb5ec66107094963abd62fa1/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2022-01-06_15:18:08-crimson-rados-master-distro-basic-smithi/6598719 --name matan-2022-01-06_15:18:08-crimson-rados-master-distro-basic-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} -- /home/teuthworker/archive/matan-2022-01-06_15:18:08-crimson-rados-master-distro-basic-smithi/6598719/orig.config.yaml 2022-01-06T15:29:22.389 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2022-01-06_15:18:08-crimson-rados-master-distro-basic-smithi/6598719 2022-01-06T15:29:22.390 INFO:teuthology.dispatcher.supervisor:Job PID: 30365 2022-01-06T15:29:22.390 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-07T03:30:16.427 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-01-07T03:30:16.584 INFO:teuthology.kill:Killing Pids: {30365} 2022-01-07T03:30:17.846 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2022-01-07T03:30:17.847 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-01-07T03:30:17.847 INFO:teuthology.misc:Compressing logs... 2022-01-07T03:30:17.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2022-01-07T03:30:18.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2022-01-07T03:30:18.450 INFO:teuthology.misc:Compressing logs... 2022-01-07T03:30:18.599 INFO:teuthology.misc:Compressing logs... 2022-01-07T03:30:19.823 INFO:teuthology.kill:No teuthology processes running 2022-01-07T03:30:20.971 INFO:teuthology.kill:Nuking machines: ['smithi146', 'smithi187'] 2022-01-07T03:30:21.930 INFO:teuthology.kill:2022-01-07 03:30:21,929.929 INFO:teuthology.nuke:targets: 2022-01-07T03:30:21.931 INFO:teuthology.kill: smithi146.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsqingwx5AlZZ1olGXrqJhrbAMlhpCuVYEpDa64MSCAFtI8GAKu+Rvoo0plw13UA/JpvmACfXdJfwqAU8KyY2nngtHpJvFR8czrxJ4fZheV2o6w+i0NC5aErgvvY0qdkPt5suchzCac3Oxia3yPOZi7ufeRrUAQLvrCUQyRuCK7abbhcgHJluT1LnRp8rB2iAg0XinnsDL/gMoaxovNM26++avJv9qd7Dl1JP+BvdIRxW9xDs3c8/xYpZOzrDGzTFPlVtzzcEbm7BhT0YI2m51bLssRCHLjawPyOU1cCWojD5peLdkxb+8pdeJlWCjmj1qKo906iV2SFayNNlTt3J17I3UehtN9j/mTGqwIet2dHBY73PCgbuu+FPG/v/0IWJR/0mmPyCD12BAO+Db4VBNa5dVvAk5izhAw5fjhyaNHUOdoOHug3zmtD/A48FU5EH3Zp+ziVUOpDX3/5Hrv+dnaqlFDfJB+Z5LOUMNUDEumY9g0afUG9ZneLRsUB7+FLc= 2022-01-07T03:30:21.931 INFO:teuthology.kill: smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDnpwEsulFNSpkAl7t9lNjtvkf1V28XMrG4gpOzBKyu/LBqEfv3NrYec9qruSXE495Wb/jUjlTl+6092k60lYEgMoVqfFdTF6lhadXnT5QusWYMwjz91iKItsQ+2yT0gQltBO6+aI1D0wqqbcTTfsT7+54RbkwsQ2uVNRdM+1rRe1qW6M2eEsN8taw6bcgilFTUxTH3V0/zgEGhLdrsCjN53teZSvf6m9plCDoDWwZJpJ1WbMiMpFi5g1PuI6sTrLuey76J7qYHq7uJ1oz1NoiYiNd+siArWn+1SBIU0aFOiQKWLtk6nNytEv+vIAELVM+wnjLG5/mPOgUEVRzkxKKPc8zPwwwdwV/SOqMnrNZc2iM/PPpZq/qZYl/Zd0e6HliXkP22iFjjJeruAoLM3WJUUdwQfmd48WilDZ4lrZ58S9m8Wb6Yz6PfiEMP2b0n9xIMtoU8MyrIBPAMXeYTx9fpdxJeL/daR/cpMH3VX4R8LJujNIKujnEYo5PxjclGWM= 2022-01-07T03:30:21.959 INFO:teuthology.kill:2022-01-07 03:30:21,959.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T03:30:21.967 INFO:teuthology.kill:2022-01-07 03:30:21,967.967 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-01-07T03:30:22.044 INFO:teuthology.kill:2022-01-07 03:30:22,044.044 INFO:teuthology.orchestra.console:Power off smithi187 2022-01-07T03:30:22.058 INFO:teuthology.kill:2022-01-07 03:30:22,058.058 INFO:teuthology.orchestra.console:Power off smithi146 2022-01-07T03:30:30.413 INFO:teuthology.kill:2022-01-07 03:30:30,413.413 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2022-01-07T03:30:30.560 INFO:teuthology.kill:2022-01-07 03:30:30,560.560 INFO:teuthology.lock.ops:unlocked: smithi187.front.sepia.ceph.com 2022-01-07T03:30:34.532 INFO:teuthology.kill:2022-01-07 03:30:34,532.532 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2022-01-07T03:30:34.676 INFO:teuthology.kill:2022-01-07 03:30:34,676.676 INFO:teuthology.lock.ops:unlocked: smithi146.front.sepia.ceph.com 2022-01-07T03:32:34.993 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-07T03:32:35.107 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi146 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599623 2022-01-07T03:32:35.108 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi187 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-01-06_15:57:04-rados-wip-yuri6-testing-2022-01-05-1255-distro-default-smithi/6599623