2021-06-25T14:43:05.346 INFO:root:teuthology version: 1.1.0-26631ede 2021-06-25T14:43:05.348 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} --verbose --name yuriw-2021-06-24_21:15:37-rados-wip-yuri2-testing-2021-06-24-1153-pacific-distro-basic-smithi --archive /home/teuthworker/archive/yuriw-2021-06-24_21:15:37-rados-wip-yuri2-testing-2021-06-24-1153-pacific-distro-basic-smithi/6191359 -- /home/teuthworker/archive/yuriw-2021-06-24_21:15:37-rados-wip-yuri2-testing-2021-06-24-1153-pacific-distro-basic-smithi/6191359/orig.config.yaml 2021-06-25T14:43:05.392 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-06-25T14:43:05.460 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-06-24_21:15:37-rados-wip-yuri2-testing-2021-06-24-1153-pacific-distro-basic-smithi/6191359 branch: wip-yuri2-testing-2021-06-24-1153-pacific description: rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} email: ceph-qa@ceph.io first_in_suite: false job_id: '6191359' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2021-06-24_21:15:37-rados-wip-yuri2-testing-2021-06-24-1153-pacific-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri2-testing-2021-06-24-1153-pacific ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: debug ms: 1 debug osd: 20 osd debug verify cached snaps: true osd debug verify missing on start: true osd op queue: debug_random osd op queue cut off: debug_random log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - is full - overall HEALTH_ - \(POOL_FULL\) - \(POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri2-testing-2021-06-24-1153-pacific sha1: 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri2-testing-2021-06-24-1153-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb targets: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4mGFvEcLzFzFUoUblV+pnXQXjvkz/KW7OAE2aGBDsHFBKTW7Etyx/ZXPoTwlrkPJ1VL4I4zjFkJLkf7etxZbGi+hEGCmUPdqzkAOWjnG2uv79lF47ZzpqbrgPFeEDzMtfyMyK1u1pFBlTxuoC78TxLaxXie9upIaKCqBZLRqXPI1q4C1wanpqbARHs690CaDIDPbT1HYRZVq26mJxhWPnCQyFxAqz8arozNxYirWNAyc9wEvNForQT+WwO9c3ivOVjKai42JBT5chTFdOhzeyIUkCsTOWKCVCZm5XvW1J0jqub1TJ1d5uXylsWCp5bd7TyvpNJwm47Q8IgfHv4Vq2jYoXe4usjM4uIPO5cN98n44aEYKaeKrqJCnGOFvkrCzmH0Q7zGHWGu/Es2y3Pn/bSlDLt6NXGZnv0dh4rWqFy3t1RpxPCy2RyDLNrUWewbAXgeHpbViN9RbfP5u9wLyFIkJk57zqVLwRe3pnrH0ptp5HpzVXf5pI5ggsBFVu86M= tasks: - install: null - ceph: conf: global: osd max object name len: 460 osd max object namespace len: 64 pre-mgr-commands: - sudo ceph config set mgr mgr/devicehealth/enable_monitoring false --force - exec: client.0: - ceph osd pool create ec-ca 1 1 - ceph osd pool create ec 1 1 erasure default - ceph osd pool application enable ec rados - ceph osd tier add ec ec-ca - ceph osd tier cache-mode ec-ca readproxy - ceph osd tier set-overlay ec ec-ca - ceph osd pool set ec-ca hit_set_type bloom - ceph osd pool set-quota ec-ca max_bytes 20480000 - ceph osd pool set-quota ec max_bytes 20480000 - ceph osd pool set ec-ca target_max_bytes 20480000 - timeout 30 rados -p ec-ca bench 30 write || true - ceph osd pool set-quota ec-ca max_bytes 0 - ceph osd pool set-quota ec max_bytes 0 teuthology_branch: master teuthology_sha1: 26631ede9027a5643f2e47dacc5af6f1834aac45 timestamp: 2021-06-24_21:15:37 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.8274 2021-06-25T14:43:05.461 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb/qa; will attempt to use it 2021-06-25T14:43:05.461 INFO:teuthology.run:Tasks not found; will attempt to fetch 2021-06-25T14:43:05.462 INFO:teuthology.repo_utils:Cloning https://github.com/ceph/ceph-ci.git wip-yuri2-testing-2021-06-24-1153-pacific from upstream 2021-06-25T14:43:22.512 ERROR:teuthology.repo_utils:Git error encountered; retrying Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 341, in fetch_repo enforce_repo_state(url, dest_path, branch, commit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 94, in enforce_repo_state clone_repo(repo_url, dest_path, branch, shallow=commit is None) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 153, in clone_repo raise GitError("git clone failed!") teuthology.exceptions.GitError: git clone failed! 2021-06-25T14:43:32.523 INFO:teuthology.repo_utils:/home/teuthworker/src/github.com_ceph_ceph-c_1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb was just updated or references a specific commit; assuming it is current 2021-06-25T14:43:32.607 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph-c_1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb to 1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb 2021-06-25T14:43:32.637 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 297, in reset_repo cwd=dest_path, File "/usr/lib/python3.6/subprocess.py", line 356, in check_output **kwargs).stdout File "/usr/lib/python3.6/subprocess.py", line 438, in run output=stdout, stderr=stderr) subprocess.CalledProcessError: Command '('git', 'reset', '--hard', '1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb')' returned non-zero exit status 128. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run.py", line 388, in main config["suite_path"] = fetch_tasks_if_needed(config) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run.py", line 90, in fetch_tasks_if_needed fetch_qa_suite(suite_branch, commit=suite_sha1), File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 403, in fetch_qa_suite branch, commit, lock=lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 341, in fetch_repo enforce_repo_state(url, dest_path, branch, commit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 105, in enforce_repo_state reset_repo(repo_url, dest_path, branch, commit) File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/repo_utils.py", line 301, in reset_repo raise CommitNotFoundError(commit, repo_url) teuthology.exceptions.CommitNotFoundError: '1b499f3efdd5e581a3c51a1ef9ab97c3d92a4bbb' not found in repo: https://github.com/ceph/ceph-ci.git!