2021-11-17T16:24:31.717 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-17T16:24:31.837 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging 2021-11-17T16:24:31.839 INFO:teuthology.lock.ops:Updating [ubuntu@smithi080.front.sepia.ceph.com]: reset os type and version on server 2021-11-17T16:24:31.839 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2021-11-17T16:24:31.857 INFO:teuthology.lock.ops:Node 'ubuntu@smithi080.front.sepia.ceph.com' reimaging is complete 2021-11-17T16:24:31.857 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging 2021-11-17T16:24:31.857 INFO:teuthology.lock.ops:Updating [ubuntu@smithi114.front.sepia.ceph.com]: reset os type and version on server 2021-11-17T16:24:31.858 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2021-11-17T16:24:31.878 INFO:teuthology.lock.ops:Node 'ubuntu@smithi114.front.sepia.ceph.com' reimaging is complete 2021-11-17T16:24:32.073 INFO:teuthology.provision.fog.smithi080:Scheduling deploy of centos 8.3 2021-11-17T16:24:32.102 INFO:teuthology.provision.fog.smithi114:Scheduling deploy of centos 8.3 2021-11-17T16:24:32.396 INFO:teuthology.orchestra.console:Power off smithi080 2021-11-17T16:24:32.411 INFO:teuthology.orchestra.console:Power off smithi114 2021-11-17T16:24:40.772 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2021-11-17T16:24:40.874 INFO:teuthology.orchestra.console:Power on smithi080 2021-11-17T16:24:44.889 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2021-11-17T16:24:44.992 INFO:teuthology.orchestra.console:Power on smithi114 2021-11-17T16:24:49.244 INFO:teuthology.orchestra.console:Power on for smithi080 completed 2021-11-17T16:24:49.250 INFO:teuthology.orchestra.console:Power on for smithi114 completed 2021-11-17T16:24:49.346 INFO:teuthology.provision.fog.smithi080:Waiting for deploy to finish 2021-11-17T16:24:49.351 INFO:teuthology.provision.fog.smithi114:Waiting for deploy to finish 2021-11-17T16:29:38.994 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-17T16:29:39.046 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-11-17T16:29:39.301 INFO:teuthology.provision.fog.smithi114:Node is ready 2021-11-17T16:29:39.318 INFO:teuthology.orchestra.run.smithi114.stdout:smithi114.front.sepia.ceph.com 2021-11-17T16:29:39.343 INFO:teuthology.provision.fog.smithi080:Node is ready 2021-11-17T16:29:39.359 INFO:teuthology.orchestra.run.smithi080.stdout:smithi080.front.sepia.ceph.com 2021-11-17T16:29:39.374 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.15.114 smithi114.front.sepia.ceph.com smithi114 2021-11-17T16:29:39.414 INFO:teuthology.orchestra.run.smithi080.stdout:172.21.15.80 smithi080.front.sepia.ceph.com smithi080 2021-11-17T16:29:39.697 INFO:teuthology.provision.fog.smithi114:Deploy complete! 2021-11-17T16:29:39.733 INFO:teuthology.provision.fog.smithi080:Deploy complete! 2021-11-17T16:29:39.884 INFO:teuthology.lock.ops:Checking smithi080.front.sepia.ceph.com 2021-11-17T16:29:39.886 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-17T16:29:39.906 INFO:teuthology.lock.ops:Checking smithi114.front.sepia.ceph.com 2021-11-17T16:29:39.906 INFO:teuthology.lock.ops:New key found. Updating... 2021-11-17T16:29:39.926 INFO:teuthology.lock.ops:Updating [smithi080.front.sepia.ceph.com]: set os type and version on server 2021-11-17T16:29:39.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2021-11-17T16:29:40.182 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2021-11-17T16:29:40.236 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Linux" 2021-11-17T16:29:40.237 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2021-11-17T16:29:40.237 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2021-11-17T16:29:40.237 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2021-11-17T16:29:40.237 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2021-11-17T16:29:40.238 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2021-11-17T16:29:40.238 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-17T16:29:40.238 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2021-11-17T16:29:40.238 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-17T16:29:40.239 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2021-11-17T16:29:40.239 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-17T16:29:40.239 INFO:teuthology.orchestra.run.smithi080.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-17T16:29:40.239 INFO:teuthology.orchestra.run.smithi080.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-17T16:29:40.241 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2021-11-17T16:29:40.259 INFO:teuthology.lock.ops:Updating [smithi114.front.sepia.ceph.com]: set os type and version on server 2021-11-17T16:29:40.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2021-11-17T16:29:40.518 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2021-11-17T16:29:40.572 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Linux" 2021-11-17T16:29:40.572 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2021-11-17T16:29:40.572 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2021-11-17T16:29:40.573 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2021-11-17T16:29:40.573 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2021-11-17T16:29:40.573 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2021-11-17T16:29:40.574 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-17T16:29:40.574 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2021-11-17T16:29:40.574 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-17T16:29:40.574 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2021-11-17T16:29:40.575 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-17T16:29:40.575 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-17T16:29:40.575 INFO:teuthology.orchestra.run.smithi114.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-17T16:29:40.576 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2021-11-17T16:29:40.667 INFO:teuthology.dispatcher.supervisor:Running job 6510313 2021-11-17T16:29:40.668 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_6cfddd5e1c7d5ede1367cf3087c21af44eb88356/virtualenv/bin/teuthology -v --owner scheduled_rzarzynski@teuthology --archive /home/teuthworker/archive/rzarzynski-2021-11-17_16:07:48-rados-master-distro-basic-smithi/6510313 --name rzarzynski-2021-11-17_16:07:48-rados-master-distro-basic-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/rzarzynski-2021-11-17_16:07:48-rados-master-distro-basic-smithi/6510313/orig.config.yaml 2021-11-17T16:29:40.672 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rzarzynski-2021-11-17_16:07:48-rados-master-distro-basic-smithi/6510313 2021-11-17T16:29:40.672 INFO:teuthology.dispatcher.supervisor:Job PID: 13351 2021-11-17T16:29:40.673 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2021-11-18T04:30:35.531 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2021-11-18T04:30:35.684 INFO:teuthology.kill:Killing Pids: {13351} 2021-11-18T04:30:37.014 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2021-11-18T04:30:37.015 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2021-11-18T04:30:37.015 INFO:teuthology.misc:Compressing logs... 2021-11-18T04:30:37.016 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2021-11-18T04:30:37.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2021-11-18T04:30:37.628 INFO:teuthology.misc:Compressing logs... 2021-11-18T04:30:37.782 INFO:teuthology.misc:Compressing logs... 2021-11-18T04:30:39.589 INFO:teuthology.orchestra.run.smithi080.stderr:gzip: /var/log/ceph/ceph-client.0.39212.log: file size changed while zipping 2021-11-18T04:30:40.416 INFO:teuthology.kill:No teuthology processes running 2021-11-18T04:30:41.684 INFO:teuthology.kill:Nuking machines: ['smithi080', 'smithi114'] 2021-11-18T04:30:42.690 INFO:teuthology.kill:2021-11-18 04:30:42,689.689 INFO:teuthology.nuke:targets: 2021-11-18T04:30:42.692 INFO:teuthology.kill: smithi080.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8OsmL9htoAfoJnjW4v3YuIvODjmiMQhjosK3CM3xQWMGVfwkqC5u0VJpzlWQKp/2SDTMjTLukCGpxFD8IdDVIiPXPTDeLIIf0p8US9lZayNyQL1UlQ1AQjGsjt+kqLX2MmI7liMY7bAfj/fyFWO48z+b4MlfdBiaN5vfTmV+iRRhvYUVKinHLr+6pS54lk60mso8G+/dHy1xvVOOPNv5b6p2c8AgK8jrhSaQd/zwn0em6uO+KPz6l9l6nBYX0YXxSrOuPE8k4qhZTDaQFR1zroDUVJhq16jAhmXlB6jnl1aiZqXSnCNNFlAfU5WxLTPuzQxeVWeDT9r/Ug8KQ2TzjtmXBhsiw39Uff0DDp6tm56ncqmGOksL3p6ze1/AJ0GotXPjyjAPC2mvCYYzTIgvS5Xcy1qvkNBL4e5HVeWk4eaePoONvjrbNf9cH2NcR/C5rlOIUYHgdUscypy6U/lGfvhGLa9PQg0zRP0TWk+p1wjhNtGOz8aJEhRECzpVSF30= 2021-11-18T04:30:42.692 INFO:teuthology.kill: smithi114.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCjdARQEhJNoYr7497wvffjDOhG3cL0N6nyXI6jYyp9LA8GJ5tAjs8vUiJytD4Pl2qtXK0axh2H+wSKj5XKF785pv9cAFfg7QToTAg23OPjYZN+YmqREBwxnPpdfWWnOL/06N3J4I27ek4cnJoJi9kvVvZpWzTKcFQyhVscbuBttF+0zNlQ8RTQCtxtuC/zBlFKvtHz/wya4B4AvT9nemfgyF46BsZnTL8AUf1Cn6v4UH4xWazQN/75Fa5n7kblHSplmM8iFFropkJiXnrt69QHYX0XxgDlZbjXDt7esB9FXA+o2CCRLF43zv7fiWXN4m7iLX/q7rdp4LTm6NEYkidPpBe9h8KbAQ7dDs+a+3XMB+vj9X+4hmdpVU537LgPh3uKKrm3NyCsB6pw0e5SjjjFWFMlgefWeEobWkkZjZZEIfexB+BQ7JaZNsB9Q53kYavyj0WI2fqby7dNFebHuYU/eV3xwH3FVINYY4u0Xt6wuf8zVqzOtXVFWx7SrR4CPl0= 2021-11-18T04:30:42.716 INFO:teuthology.kill:2021-11-18 04:30:42,716.716 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-18T04:30:42.719 INFO:teuthology.kill:2021-11-18 04:30:42,719.719 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-18T04:30:42.797 INFO:teuthology.kill:2021-11-18 04:30:42,797.797 INFO:teuthology.orchestra.console:Power off smithi114 2021-11-18T04:30:42.811 INFO:teuthology.kill:2021-11-18 04:30:42,811.811 INFO:teuthology.orchestra.console:Power off smithi080 2021-11-18T04:30:51.172 INFO:teuthology.kill:2021-11-18 04:30:51,171.171 INFO:teuthology.orchestra.console:Power off for smithi114 completed 2021-11-18T04:30:51.178 INFO:teuthology.kill:2021-11-18 04:30:51,178.178 INFO:teuthology.orchestra.console:Power off for smithi080 completed 2021-11-18T04:30:51.326 INFO:teuthology.kill:2021-11-18 04:30:51,325.325 INFO:teuthology.lock.ops:unlocked: smithi080.front.sepia.ceph.com 2021-11-18T04:30:51.339 INFO:teuthology.kill:2021-11-18 04:30:51,336.336 INFO:teuthology.lock.ops:unlocked: smithi114.front.sepia.ceph.com 2021-11-18T04:32:51.689 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2021-11-18T04:32:51.799 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi080 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-18_00:45:42-rados-wip-yuri11-testing-2021-11-17-1514-pacific-distro-basic-smithi/6511045 2021-11-18T04:32:51.800 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi114 but it was locked by another job: /home/teuthworker/archive/yuriw-2021-11-18_00:45:42-rados-wip-yuri11-testing-2021-11-17-1514-pacific-distro-basic-smithi/6511045