2022-08-05T15:03:30.019 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f 2022-08-05T15:03:30.400 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} --verbose --archive /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398 --name yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi -- /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/orig.config.yaml 2022-08-05T15:03:35.371 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-08-05T15:03:40.201 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398 branch: wip-yuri4-testing-2022-08-04-1413 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} email: ceph-qa@ceph.io first_in_suite: false job_id: '6959398' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri4-testing-2022-08-04-1413 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd inject bad map crc probability: 0.1 osd max markdown count: 1000 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - must scrub before tier agent can activate sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2022-08-04-1413 sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri4-testing-2022-08-04-1413 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d targets: smithi142.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0G51TIUs1Te9w/irRkV++8fsy+oO4Sq/MxBYMUjgVlw/k8zOFoebRUmfs18Cvg1hXm5fdG4P239ymHW9TgMxtgEHXKjJx2rfRtH7kbfl18oWXFm8rXnYpFkmV92F56oCo6O1BcEy1Bm8EU3YwXJHYZcmSfk0sHbu68GORquDIMgBuOgy96VuZtUimTWS3nq4dH+Kqq9EhBLb9PYH477ocMAvpm9o7UZ4w50pOxLJjXfGJh/xmYapt8qJoB1Yz4zeXfwQHTxIUg6rkYwyKtBeEjVK3JtdN+Jar7Gl55LIkiWGegbX+7tOGfaeorYXJ/FkCG2Ap7G/BBmQRvpH39yAufYqOBq7BTWuSVNDX1CsY9CtWG8Nzlw9eQoMtvALG89aGQ7zCfhWSY5rxYTKqUIPKDT2oMFrnWcd7lPNX7c0sKRvLU0LV9grcyepsxcjwaS7Ovns0sr3JU3J/YHb25aQPRLKpR0I093OF+yKxjTr8auZ4Q7JnIQaGb6JJ8LaxPFU= smithi191.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrx/AZ06i0m8z/Mh93OCPegr7IIVhRZm8FId+cwwnHHGJjB84Zn8z0gASxKMl4S84PiQnffagUDI4U0Xn1a5Ze2lCpOTBKDfJS8BVDljL/G7+Fherz1nOKUUWYDPLUMS7H0IFnvnZEiImq5NXxIafz/RJiSqZXIxY6tOmTNVu1kR5eW4WeSfC21G6yZSw/EwGfzgPtFtzreUtQvXa29PNzIV3IW+I7/ndsS3n6N3cLwovgbiO2uCW9tf+k3PrOjnSzQwZqCugj7079wGMM9Q2VrRM/Hd3w0jmAToRZbaZLm0h0H3u3ahtOehJoi3LivSZSWi3m4RJ8/owm4o4Z0GnYyigQBskXiiNDKXyfaqFTW7U4Gj8qodbK0ulmrTqAkiCfxThmeWoCnUeV/HazSYimmliwSsf8Tkb8AK+mtSMD9h+2fwBUeUXylGUl2+jvCNoPZKt2BPD/ERkJW5YFoMkfSGinMPebF+cy9iEGJwf0wa20EmAT6tu+LOgjzL5BIQc= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53 timestamp: 2022-08-05_14:49:51 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-08-05T15:03:40.201 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa; will attempt to use it 2022-08-05T15:03:40.796 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks 2022-08-05T15:03:40.894 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-08-05T15:03:41.153 INFO:teuthology.task.internal:Checking packages... 2022-08-05T15:03:46.035 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4a7e6c4ac29de794744a2ce76ca2b36bc637894d' 2022-08-05T15:03:46.036 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-08-05T15:03:46.037 INFO:teuthology.packaging:ref: None 2022-08-05T15:03:46.237 INFO:teuthology.packaging:tag: None 2022-08-05T15:03:46.293 INFO:teuthology.packaging:branch: wip-yuri4-testing-2022-08-04-1413 2022-08-05T15:03:46.294 INFO:teuthology.packaging:sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:03:46.294 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri4-testing-2022-08-04-1413 2022-08-05T15:03:49.029 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-14045.g4a7e6c4a 2022-08-05T15:03:49.029 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-08-05T15:03:49.071 INFO:teuthology.task.internal:no buildpackages task found 2022-08-05T15:03:49.071 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-08-05T15:03:49.178 INFO:teuthology.task.internal:Saving configuration 2022-08-05T15:03:49.681 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-08-05T15:03:49.741 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-05T15:03:49.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 14:51:57.807239', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFpG4Z0UP5TsUEGyDLzMdGnJ64qrnN8etz1ZtZ4zBBuljfos4Qc9z4YjBH53o6WI3rZ1pYtWFOtgQDL6lToRltc='} 2022-08-05T15:03:50.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 14:51:57.808752', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFbQyqHDzSmjV1VDImOBi2MWC33gFU5wyu6RKA1ljckKiHi8f5CLpUtXO7sRlAiIa2YpGzpqyFcXsCOPz/ly/4='} 2022-08-05T15:03:50.172 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-08-05T15:03:50.317 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-08-05T15:03:50.577 INFO:teuthology.task.internal:roles: ubuntu@smithi191.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-08-05T15:03:50.630 INFO:teuthology.run_tasks:Running task console_log... 2022-08-05T15:03:54.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3f8d9d6ae8>, signals=[15]) 2022-08-05T15:03:54.910 INFO:teuthology.run_tasks:Running task internal.connect... 2022-08-05T15:03:55.188 INFO:teuthology.task.internal:Opening connections... 2022-08-05T15:03:55.189 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:03:55.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:04:09.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:04:09.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:04:16.930 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-08-05T15:04:17.876 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2022-08-05T15:04:18.433 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-08-05T15:04:19.060 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2022-08-05T15:04:19.612 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="CentOS Stream" 2022-08-05T15:04:19.678 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8" 2022-08-05T15:04:19.679 INFO:teuthology.orchestra.run.smithi142.stdout:ID="centos" 2022-08-05T15:04:19.754 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="rhel fedora" 2022-08-05T15:04:19.754 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8" 2022-08-05T15:04:19.754 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2022-08-05T15:04:19.755 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-05T15:04:19.755 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2022-08-05T15:04:19.755 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-05T15:04:20.223 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://centos.org/" 2022-08-05T15:04:20.223 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-05T15:04:20.224 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-05T15:04:20.224 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-05T15:04:20.975 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-08-05T15:04:21.577 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2022-08-05T15:04:22.062 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2022-08-05T15:04:22.097 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2022-08-05T15:04:22.642 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2022-08-05T15:04:22.642 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2022-08-05T15:04:22.643 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2022-08-05T15:04:22.643 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2022-08-05T15:04:22.643 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2022-08-05T15:04:22.643 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2022-08-05T15:04:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-05T15:04:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2022-08-05T15:04:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-05T15:04:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2022-08-05T15:04:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-05T15:04:22.645 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-05T15:04:22.645 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-05T15:04:22.645 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2022-08-05T15:04:23.959 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-08-05T15:04:25.531 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-08-05T15:04:26.188 INFO:teuthology.task.internal:Checking for old test directory... 2022-08-05T15:04:26.189 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2022-08-05T15:04:27.135 DEBUG:teuthology.orchestra.run.smithi191:> test '!' -e /home/ubuntu/cephtest 2022-08-05T15:04:27.529 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-08-05T15:04:27.655 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-08-05T15:04:27.655 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2022-08-05T15:04:27.766 DEBUG:teuthology.orchestra.run.smithi191:> test -z $(ls -A /var/lib/ceph) 2022-08-05T15:04:27.897 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-08-05T15:04:28.699 INFO:teuthology.run_tasks:Running task kernel... 2022-08-05T15:04:30.659 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-08-05T15:04:30.706 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-08-05T15:04:30.707 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2022-08-05T15:04:30.820 DEBUG:teuthology.orchestra.run.smithi191:> test -f /run/.containerenv -o -f /.dockerenv 2022-08-05T15:04:31.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:04:31.626 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2022-08-05T15:04:31.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:04:32.811 DEBUG:teuthology.orchestra.run.smithi191:> uname -r 2022-08-05T15:04:33.731 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-408.el8.x86_64 2022-08-05T15:04:33.918 INFO:teuthology.task.kernel:Running kernel on smithi142: 4.18.0-408.el8.x86_64 2022-08-05T15:04:34.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum install -y kernel 2022-08-05T15:04:34.563 INFO:teuthology.orchestra.run.smithi191.stdout:4.18.0-408.el8.x86_64 2022-08-05T15:04:34.703 INFO:teuthology.task.kernel:Running kernel on smithi191: 4.18.0-408.el8.x86_64 2022-08-05T15:04:34.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum install -y kernel 2022-08-05T15:04:37.497 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - AppStream 32 MB/s | 24 MB 00:00 2022-08-05T15:04:38.045 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - AppStream 29 MB/s | 24 MB 00:00 2022-08-05T15:04:42.395 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - BaseOS 39 MB/s | 25 MB 00:00 2022-08-05T15:04:43.110 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - BaseOS 38 MB/s | 25 MB 00:00 2022-08-05T15:04:46.208 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - Extras 145 kB/s | 18 kB 00:00 2022-08-05T15:04:46.579 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - PowerTools 17 MB/s | 5.0 MB 00:00 2022-08-05T15:04:46.812 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - Extras 152 kB/s | 18 kB 00:00 2022-08-05T15:04:47.199 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - PowerTools 19 MB/s | 5.0 MB 00:00 2022-08-05T15:04:48.929 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 2.5 kB/s | 3.5 kB 00:01 2022-08-05T15:04:49.411 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 3.0 kB/s | 3.5 kB 00:01 2022-08-05T15:04:51.060 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 13 MB 00:01 2022-08-05T15:04:51.420 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 13 MB 00:02 2022-08-05T15:04:54.055 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 382 kB/s | 24 kB 00:00 2022-08-05T15:04:54.471 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 295 kB/s | 24 kB 00:00 2022-08-05T15:04:56.957 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-08-05T15:04:56.957 INFO:teuthology.orchestra.run.smithi142.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-08-05T15:04:57.119 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:04:57.119 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:04:57.120 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:04:57.121 DEBUG:teuthology.orchestra.run.smithi142:> echo no | sudo yum reinstall kernel || true 2022-08-05T15:04:57.261 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-08-05T15:04:57.261 INFO:teuthology.orchestra.run.smithi191.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-08-05T15:04:57.372 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:04:57.372 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:04:57.373 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:04:57.468 DEBUG:teuthology.orchestra.run.smithi191:> echo no | sudo yum reinstall kernel || true 2022-08-05T15:04:57.968 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:04 ago on Fri 05 Aug 2022 03:04:53 PM UTC. 2022-08-05T15:04:58.259 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:04 ago on Fri 05 Aug 2022 03:04:54 PM UTC. 2022-08-05T15:04:58.848 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:04:59.171 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:04:59.171 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2022-08-05T15:04:59.318 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:04:59.319 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalling: 2022-08-05T15:04:59.319 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-08-05T15:04:59.319 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:04:59.319 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:04:59.320 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:04:59.320 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:04:59.321 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 8.5 M 2022-08-05T15:04:59.321 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 0 2022-08-05T15:05:00.698 INFO:teuthology.orchestra.run.smithi142.stderr:Operation aborted. 2022-08-05T15:05:00.699 INFO:teuthology.orchestra.run.smithi142.stdout:Is this ok [y/N]: 2022-08-05T15:05:00.860 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum reinstall -y kernel || true 2022-08-05T15:05:01.287 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:05:01.288 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:01.288 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-08-05T15:05:01.288 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:01.289 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2022-08-05T15:05:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-08-05T15:05:01.289 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:01.306 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:05:01.306 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:01.307 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:01.307 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 8.5 M 2022-08-05T15:05:01.307 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2022-08-05T15:05:01.384 INFO:teuthology.orchestra.run.smithi191.stderr:Operation aborted. 2022-08-05T15:05:01.385 INFO:teuthology.orchestra.run.smithi191.stdout:Is this ok [y/N]: 2022-08-05T15:05:01.385 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum reinstall -y kernel || true 2022-08-05T15:05:02.514 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:08 ago on Fri 05 Aug 2022 03:04:53 PM UTC. 2022-08-05T15:05:03.117 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:08 ago on Fri 05 Aug 2022 03:04:54 PM UTC. 2022-08-05T15:05:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:05:04.451 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:05:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2022-08-05T15:05:04.495 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:05:04.495 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalling: 2022-08-05T15:05:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-08-05T15:05:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:05:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:05:05.141 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:05:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:05:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 8.5 M 2022-08-05T15:05:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 0 2022-08-05T15:05:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:05:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-408.el8.x86_64.rpm 36 MB/s | 8.5 MB 00:00 2022-08-05T15:05:05.906 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:05:05.907 INFO:teuthology.orchestra.run.smithi142.stdout:Total 35 MB/s | 8.5 MB 00:00 2022-08-05T15:05:05.908 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:05:05.908 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:05:05.908 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:05:05.909 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:05:05.909 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:05:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:05:07.407 INFO:teuthology.orchestra.run.smithi142.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-08-05T15:05:07.408 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:07.408 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-08-05T15:05:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:05:07.542 INFO:teuthology.orchestra.run.smithi142.stdout:Reinstalled: 2022-08-05T15:05:07.543 INFO:teuthology.orchestra.run.smithi142.stdout: kernel-4.18.0-408.el8.x86_64 2022-08-05T15:05:07.543 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:05:07.544 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:05:07.545 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q kernel --last | head -n 1 2022-08-05T15:05:08.381 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:05:08.381 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:08.908 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-08-05T15:05:08.908 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:08.909 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalling: 2022-08-05T15:05:08.909 INFO:teuthology.orchestra.run.smithi191.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-08-05T15:05:09.307 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:09.308 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:05:09.308 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:05:09.557 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:09.557 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 8.5 M 2022-08-05T15:05:09.557 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 0 2022-08-05T15:05:09.806 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:05:09.806 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-408.el8.x86_64.rpm 35 MB/s | 8.5 MB 00:00 2022-08-05T15:05:09.807 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:05:09.807 INFO:teuthology.orchestra.run.smithi191.stdout:Total 35 MB/s | 8.5 MB 00:00 2022-08-05T15:05:09.807 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:05:09.808 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:05:10.211 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:05:10.211 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:05:10.212 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:05:10.535 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:05:10.916 INFO:teuthology.orchestra.run.smithi191.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-08-05T15:05:10.916 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:10.916 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:10.916 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-08-05T15:05:10.917 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-08-05T15:05:10.917 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:10.917 INFO:teuthology.orchestra.run.smithi191.stdout:Reinstalled: 2022-08-05T15:05:10.917 INFO:teuthology.orchestra.run.smithi191.stdout: kernel-4.18.0-408.el8.x86_64 2022-08-05T15:05:10.918 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:05:11.334 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:05:11.335 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q kernel --last | head -n 1 2022-08-05T15:05:11.804 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-4.18.0-408.el8.x86_64 Fri 05 Aug 2022 03:05:03 PM UTC 2022-08-05T15:05:11.805 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-08-05T15:05:12.105 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-08-05T15:05:12.105 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-08-05T15:05:12.105 DEBUG:teuthology.orchestra.run.smithi142:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-08-05T15:05:12.701 INFO:teuthology.orchestra.run.smithi191.stdout:kernel-4.18.0-408.el8.x86_64 Fri 05 Aug 2022 03:05:04 PM UTC 2022-08-05T15:05:12.701 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-08-05T15:05:12.701 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-08-05T15:05:13.182 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-08-05T15:05:13.183 DEBUG:teuthology.orchestra.run.smithi191:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-08-05T15:05:14.375 INFO:teuthology.orchestra.run.smithi191.stdout:ttyS1 2022-08-05T15:05:14.376 INFO:teuthology.orchestra.run.smithi142.stdout:ttyS1 2022-08-05T15:05:14.377 DEBUG:teuthology.parallel:result is None 2022-08-05T15:05:14.585 DEBUG:teuthology.parallel:result is None 2022-08-05T15:05:14.586 INFO:teuthology.run_tasks:Running task internal.base... 2022-08-05T15:05:16.055 INFO:teuthology.task.internal:Creating test directory... 2022-08-05T15:05:16.056 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-08-05T15:05:16.689 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-08-05T15:05:16.955 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-08-05T15:05:17.565 INFO:teuthology.run_tasks:Running task internal.archive... 2022-08-05T15:05:17.931 INFO:teuthology.task.internal:Creating archive directory... 2022-08-05T15:05:18.003 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-08-05T15:05:18.353 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-08-05T15:05:21.528 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-08-05T15:05:22.428 INFO:teuthology.task.internal:Enabling coredump saving... 2022-08-05T15:05:22.428 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-08-05T15:05:23.019 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-08-05T15:05:23.273 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:05:23.332 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:05:24.604 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:05:24.604 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:05:24.605 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-08-05T15:05:26.086 INFO:teuthology.task.internal:Configuring sudo... 2022-08-05T15:05:26.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-08-05T15:05:27.116 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-08-05T15:05:28.038 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-08-05T15:05:29.004 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-08-05T15:05:29.005 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-08-05T15:05:29.850 DEBUG:teuthology.orchestra.run.smithi191:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-08-05T15:05:30.353 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-05T15:05:33.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-05T15:05:34.461 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-05T15:05:35.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-05T15:05:36.647 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:05:36.811 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-08-05T15:05:37.687 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-05T15:05:38.183 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-05T15:05:38.441 DEBUG:teuthology.orchestra.run.smithi191:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-05T15:05:40.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-05T15:05:41.480 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:05:41.480 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-08-05T15:05:42.261 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2022-08-05T15:05:42.765 DEBUG:teuthology.orchestra.run.smithi191:> sudo service rsyslog restart 2022-08-05T15:05:42.967 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-05T15:05:44.708 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-05T15:05:44.709 INFO:teuthology.run_tasks:Running task internal.timer... 2022-08-05T15:05:47.003 INFO:teuthology.task.internal:Starting timer... 2022-08-05T15:05:47.003 INFO:teuthology.run_tasks:Running task pcp... 2022-08-05T15:05:49.187 INFO:teuthology.run_tasks:Running task selinux... 2022-08-05T15:05:49.708 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-08-05T15:05:49.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2022-08-05T15:05:50.397 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2022-08-05T15:05:50.648 DEBUG:teuthology.orchestra.run.smithi191:> sudo service auditd rotate 2022-08-05T15:05:51.506 INFO:teuthology.orchestra.run.smithi191.stdout:Rotating logs: 2022-08-05T15:05:51.507 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-08-05T15:05:51.508 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2022-08-05T15:05:52.430 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2022-08-05T15:05:52.431 DEBUG:teuthology.orchestra.run.smithi191:> /usr/sbin/getenforce 2022-08-05T15:05:53.113 INFO:teuthology.orchestra.run.smithi191.stdout:Permissive 2022-08-05T15:05:53.126 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi191.front.sepia.ceph.com': 'permissive'} 2022-08-05T15:05:53.127 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-05T15:05:54.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:05:54.266 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-05T15:05:54.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:05:54.985 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-08-05T15:05:54.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2022-08-05T15:05:56.387 DEBUG:teuthology.orchestra.run.smithi191:> sudo /usr/sbin/setenforce permissive 2022-08-05T15:05:56.738 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-08-05T15:05:57.532 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-08-05T15:05:58.515 INFO:teuthology.repo_utils:Fetching main from origin 2022-08-05T15:06:01.857 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-08-05T15:06:05.888 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-08-05T15:06:06.498 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi191.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-08-05T15:17:57.944 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi191.front.sepia.ceph.com')] 2022-08-05T15:17:57.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-08-05T15:17:57.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:17:58.046 DEBUG:teuthology.orchestra.run.smithi142:> true 2022-08-05T15:17:58.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2022-08-05T15:17:58.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:17:58.221 DEBUG:teuthology.orchestra.run.smithi191:> true 2022-08-05T15:17:58.284 INFO:teuthology.run_tasks:Running task clock... 2022-08-05T15:17:58.297 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-08-05T15:17:58.298 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-08-05T15:17:58.300 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:17:58.303 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-08-05T15:17:58.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:17:58.336 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-08-05T15:17:58.351 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-08-05T15:17:58.357 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-08-05T15:17:58.372 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-08-05T15:17:58.419 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2022-08-05T15:17:58.433 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2022-08-05T15:17:58.441 INFO:teuthology.orchestra.run.smithi191.stderr:sudo: ntpd: command not found 2022-08-05T15:17:58.445 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-08-05T15:17:58.452 INFO:teuthology.orchestra.run.smithi191.stdout:506 Cannot talk to daemon 2022-08-05T15:17:58.459 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-08-05T15:17:58.465 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-08-05T15:17:58.479 INFO:teuthology.orchestra.run.smithi191.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-08-05T15:17:58.528 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2022-08-05T15:17:58.532 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-05T15:17:58.532 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2022-08-05T15:17:58.533 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.533 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.534 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.534 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.542 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2022-08-05T15:17:58.544 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-05T15:17:58.545 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2022-08-05T15:17:58.545 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.546 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.546 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.547 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:17:58.547 INFO:teuthology.run_tasks:Running task install... 2022-08-05T15:17:58.559 DEBUG:teuthology.task.install:project ceph 2022-08-05T15:17:58.560 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}} 2022-08-05T15:17:58.560 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'} 2022-08-05T15:17:58.560 INFO:teuthology.task.install:Using flavor: default 2022-08-05T15:17:58.568 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-08-05T15:17:58.569 INFO:teuthology.task.install:extra packages: [] 2022-08-05T15:17:58.569 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-08-05T15:17:58.610 INFO:teuthology.orchestra.run.smithi142.stdout:CentOSStream 2022-08-05T15:17:58.611 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:17:58.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo lsb_release -is 2022-08-05T15:17:58.613 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'tag': None, 'wait_for_package': False} 2022-08-05T15:17:58.613 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-08-05T15:17:58.649 INFO:teuthology.orchestra.run.smithi191.stdout:CentOSStream 2022-08-05T15:17:58.653 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:17:58.653 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'tag': None, 'wait_for_package': False} 2022-08-05T15:17:58.654 DEBUG:teuthology.orchestra.run.smithi191:> sudo lsb_release -is 2022-08-05T15:17:58.691 INFO:teuthology.orchestra.run.smithi142.stdout:CentOSStream 2022-08-05T15:17:58.693 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:17:58.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:17:58.737 INFO:teuthology.orchestra.run.smithi191.stdout:CentOSStream 2022-08-05T15:17:58.738 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:17:58.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:17:58.857 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/ 2022-08-05T15:17:58.857 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14045.g4a7e6c4a 2022-08-05T15:17:58.907 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/ 2022-08-05T15:17:58.908 INFO:teuthology.task.install.rpm:Package version is 17.0.0-14045.g4a7e6c4a 2022-08-05T15:17:58.984 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-08-05T15:17:58.985 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:17:58.985 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-08-05T15:17:59.013 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-08-05T15:17:59.014 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-08-05T15:17:59.055 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-08-05T15:17:59.056 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:17:59.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-08-05T15:17:59.086 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-08-05T15:17:59.087 DEBUG:teuthology.orchestra.run.smithi191:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-08-05T15:17:59.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-08-05T15:17:59.157 DEBUG:teuthology.orchestra.run.smithi191:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-08-05T15:17:59.166 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-08-05T15:17:59.232 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2022-08-05T15:17:59.235 DEBUG:teuthology.orchestra.run.smithi191:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-08-05T15:17:59.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2022-08-05T15:17:59.301 INFO:teuthology.orchestra.run.smithi191.stdout:check_obsoletes = 1 2022-08-05T15:17:59.303 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum clean all 2022-08-05T15:17:59.485 INFO:teuthology.orchestra.run.smithi142.stdout:65 files removed 2022-08-05T15:17:59.509 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw 2022-08-05T15:17:59.553 INFO:teuthology.orchestra.run.smithi191.stdout:65 files removed 2022-08-05T15:17:59.579 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-radosgw 2022-08-05T15:18:00.140 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 291 kB/s | 81 kB 00:00 2022-08-05T15:18:00.205 INFO:teuthology.orchestra.run.smithi191.stdout:ceph packages for x86_64 302 kB/s | 81 kB 00:00 2022-08-05T15:18:00.457 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2022-08-05T15:18:00.479 INFO:teuthology.orchestra.run.smithi191.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2022-08-05T15:18:00.733 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2022-08-05T15:18:00.738 INFO:teuthology.orchestra.run.smithi191.stdout:ceph source packages 6.4 kB/s | 1.5 kB 00:00 2022-08-05T15:18:01.427 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - AppStream 36 MB/s | 24 MB 00:00 2022-08-05T15:18:01.549 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - AppStream 31 MB/s | 24 MB 00:00 2022-08-05T15:18:06.397 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - BaseOS 37 MB/s | 25 MB 00:00 2022-08-05T15:18:06.566 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - BaseOS 35 MB/s | 25 MB 00:00 2022-08-05T15:18:10.175 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - Extras 146 kB/s | 18 kB 00:00 2022-08-05T15:18:10.364 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - Extras 123 kB/s | 18 kB 00:00 2022-08-05T15:18:10.538 INFO:teuthology.orchestra.run.smithi142.stdout:CentOS-8 - PowerTools 20 MB/s | 5.0 MB 00:00 2022-08-05T15:18:10.784 INFO:teuthology.orchestra.run.smithi191.stdout:CentOS-8 - PowerTools 17 MB/s | 5.0 MB 00:00 2022-08-05T15:18:13.022 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 2.3 kB/s | 3.5 kB 00:01 2022-08-05T15:18:13.049 INFO:teuthology.orchestra.run.smithi191.stdout:Copr repo for python3-asyncssh owned by ceph 2.7 kB/s | 3.5 kB 00:01 2022-08-05T15:18:14.485 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 13 MB 00:01 2022-08-05T15:18:14.525 INFO:teuthology.orchestra.run.smithi191.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 13 MB 00:01 2022-08-05T15:18:17.523 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 363 kB/s | 24 kB 00:00 2022-08-05T15:18:17.611 INFO:teuthology.orchestra.run.smithi191.stdout:lab-extras 333 kB/s | 24 kB 00:00 2022-08-05T15:18:20.627 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:18:20.628 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:18:20.628 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:18:20.629 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:18:20.629 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:18:20.629 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 17 M 2022-08-05T15:18:20.630 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2022-08-05T15:18:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.6 M 2022-08-05T15:18:20.630 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.6 M 2022-08-05T15:18:20.630 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:18:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 7.1 M 2022-08-05T15:18:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 24 M 2022-08-05T15:18:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 24 k 2022-08-05T15:18:20.631 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-08-05T15:18:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 765 k 2022-08-05T15:18:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-08-05T15:18:20.632 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-08-05T15:18:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 473 k 2022-08-05T15:18:20.633 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-08-05T15:18:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 5.7 M 2022-08-05T15:18:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-08-05T15:18:20.634 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-08-05T15:18:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse 2022-08-05T15:18:20.635 INFO:teuthology.orchestra.run.smithi142.stdout: x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 45 k 2022-08-05T15:18:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 108 k 2022-08-05T15:18:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 191 k 2022-08-05T15:18:20.636 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-08-05T15:18:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 370 k 2022-08-05T15:18:20.637 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 358 k 2022-08-05T15:18:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 107 k 2022-08-05T15:18:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-08-05T15:18:20.638 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:18:20.639 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:18:20.639 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:18:20.640 INFO:teuthology.orchestra.run.smithi142.stdout:Install 21 Packages 2022-08-05T15:18:20.641 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 2 Packages 2022-08-05T15:18:20.641 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:18:20.642 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 66 M 2022-08-05T15:18:20.644 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:18:20.644 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:18:20.645 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:18:20.645 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:18:20.646 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:18:20.647 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:18:20.647 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 17 M 2022-08-05T15:18:20.648 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrading: 2022-08-05T15:18:20.648 INFO:teuthology.orchestra.run.smithi191.stdout: librados2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.6 M 2022-08-05T15:18:20.649 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.6 M 2022-08-05T15:18:20.649 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:18:20.650 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 7.1 M 2022-08-05T15:18:20.650 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 24 M 2022-08-05T15:18:20.651 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 24 k 2022-08-05T15:18:20.651 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-08-05T15:18:20.652 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 765 k 2022-08-05T15:18:20.652 INFO:teuthology.orchestra.run.smithi191.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-08-05T15:18:20.653 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-08-05T15:18:20.653 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 473 k 2022-08-05T15:18:20.653 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-08-05T15:18:20.654 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2 x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 5.7 M 2022-08-05T15:18:20.654 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-08-05T15:18:20.655 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-08-05T15:18:20.655 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse 2022-08-05T15:18:20.655 INFO:teuthology.orchestra.run.smithi191.stdout: x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 45 k 2022-08-05T15:18:20.656 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 108 k 2022-08-05T15:18:20.656 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 191 k 2022-08-05T15:18:20.656 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-08-05T15:18:20.657 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 370 k 2022-08-05T15:18:20.657 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 358 k 2022-08-05T15:18:20.658 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 107 k 2022-08-05T15:18:20.658 INFO:teuthology.orchestra.run.smithi191.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-08-05T15:18:20.658 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:18:20.659 INFO:teuthology.orchestra.run.smithi191.stdout:Install 21 Packages 2022-08-05T15:18:20.660 INFO:teuthology.orchestra.run.smithi191.stdout:Upgrade 2 Packages 2022-08-05T15:18:20.660 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:18:20.661 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 66 M 2022-08-05T15:18:20.661 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:18:23.297 INFO:teuthology.orchestra.run.smithi142.stdout:(1/23): ceph-base-17.0.0-14045.g4a7e6c4a.el8.x8 2.7 MB/s | 7.1 MB 00:02 2022-08-05T15:18:23.406 INFO:teuthology.orchestra.run.smithi142.stdout:(2/23): ceph-selinux-17.0.0-14045.g4a7e6c4a.el8 224 kB/s | 24 kB 00:00 2022-08-05T15:18:23.640 INFO:teuthology.orchestra.run.smithi142.stdout:(3/23): libcephfs2-17.0.0-14045.g4a7e6c4a.el8.x 3.2 MB/s | 765 kB 00:00 2022-08-05T15:18:23.868 INFO:teuthology.orchestra.run.smithi142.stdout:(4/23): libradosstriper1-17.0.0-14045.g4a7e6c4a 2.0 MB/s | 473 kB 00:00 2022-08-05T15:18:24.226 INFO:teuthology.orchestra.run.smithi191.stdout:(1/23): ceph-base-17.0.0-14045.g4a7e6c4a.el8.x8 2.0 MB/s | 7.1 MB 00:03 2022-08-05T15:18:24.292 INFO:teuthology.orchestra.run.smithi191.stdout:(2/23): ceph-selinux-17.0.0-14045.g4a7e6c4a.el8 365 kB/s | 24 kB 00:00 2022-08-05T15:18:24.610 INFO:teuthology.orchestra.run.smithi191.stdout:(3/23): libcephfs2-17.0.0-14045.g4a7e6c4a.el8.x 2.4 MB/s | 765 kB 00:00 2022-08-05T15:18:24.819 INFO:teuthology.orchestra.run.smithi191.stdout:(4/23): libradosstriper1-17.0.0-14045.g4a7e6c4a 2.2 MB/s | 473 kB 00:00 2022-08-05T15:18:25.408 INFO:teuthology.orchestra.run.smithi142.stdout:(5/23): librgw2-17.0.0-14045.g4a7e6c4a.el8.x86_ 3.7 MB/s | 5.7 MB 00:01 2022-08-05T15:18:25.540 INFO:teuthology.orchestra.run.smithi142.stdout:(6/23): python3-ceph-argparse-17.0.0-14045.g4a7 335 kB/s | 45 kB 00:00 2022-08-05T15:18:25.665 INFO:teuthology.orchestra.run.smithi142.stdout:(7/23): python3-ceph-common-17.0.0-14045.g4a7e6 869 kB/s | 108 kB 00:00 2022-08-05T15:18:25.782 INFO:teuthology.orchestra.run.smithi142.stdout:(8/23): python3-cephfs-17.0.0-14045.g4a7e6c4a.e 1.6 MB/s | 191 kB 00:00 2022-08-05T15:18:26.049 INFO:teuthology.orchestra.run.smithi142.stdout:(9/23): python3-rados-17.0.0-14045.g4a7e6c4a.el 1.4 MB/s | 370 kB 00:00 2022-08-05T15:18:26.241 INFO:teuthology.orchestra.run.smithi142.stdout:(10/23): python3-rbd-17.0.0-14045.g4a7e6c4a.el8 1.8 MB/s | 358 kB 00:00 2022-08-05T15:18:26.334 INFO:teuthology.orchestra.run.smithi142.stdout:(11/23): python3-rgw-17.0.0-14045.g4a7e6c4a.el8 1.1 MB/s | 107 kB 00:00 2022-08-05T15:18:26.401 INFO:teuthology.orchestra.run.smithi142.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2022-08-05T15:18:26.458 INFO:teuthology.orchestra.run.smithi142.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.4 MB/s | 259 kB 00:00 2022-08-05T15:18:26.503 INFO:teuthology.orchestra.run.smithi142.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.0 MB/s | 44 kB 00:00 2022-08-05T15:18:26.535 INFO:teuthology.orchestra.run.smithi142.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2022-08-05T15:18:26.801 INFO:teuthology.orchestra.run.smithi142.stdout:(16/23): ceph-radosgw-17.0.0-14045.g4a7e6c4a.el 2.8 MB/s | 17 MB 00:06 2022-08-05T15:18:26.868 INFO:teuthology.orchestra.run.smithi142.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 919 kB/s | 306 kB 00:00 2022-08-05T15:18:26.943 INFO:teuthology.orchestra.run.smithi142.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2022-08-05T15:18:27.013 INFO:teuthology.orchestra.run.smithi142.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 282 kB/s | 59 kB 00:00 2022-08-05T15:18:27.252 INFO:teuthology.orchestra.run.smithi142.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2022-08-05T15:18:27.445 INFO:teuthology.orchestra.run.smithi191.stdout:(5/23): librgw2-17.0.0-14045.g4a7e6c4a.el8.x86_ 2.2 MB/s | 5.7 MB 00:02 2022-08-05T15:18:27.502 INFO:teuthology.orchestra.run.smithi191.stdout:(6/23): python3-ceph-argparse-17.0.0-14045.g4a7 768 kB/s | 45 kB 00:00 2022-08-05T15:18:27.590 INFO:teuthology.orchestra.run.smithi191.stdout:(7/23): python3-ceph-common-17.0.0-14045.g4a7e6 1.2 MB/s | 108 kB 00:00 2022-08-05T15:18:27.686 INFO:teuthology.orchestra.run.smithi191.stdout:(8/23): python3-cephfs-17.0.0-14045.g4a7e6c4a.e 1.9 MB/s | 191 kB 00:00 2022-08-05T15:18:27.687 INFO:teuthology.orchestra.run.smithi142.stdout:(21/23): ceph-common-17.0.0-14045.g4a7e6c4a.el8 3.4 MB/s | 24 MB 00:07 2022-08-05T15:18:27.795 INFO:teuthology.orchestra.run.smithi191.stdout:(9/23): python3-rados-17.0.0-14045.g4a7e6c4a.el 3.3 MB/s | 370 kB 00:00 2022-08-05T15:18:27.895 INFO:teuthology.orchestra.run.smithi191.stdout:(10/23): python3-rbd-17.0.0-14045.g4a7e6c4a.el8 3.5 MB/s | 358 kB 00:00 2022-08-05T15:18:27.902 INFO:teuthology.orchestra.run.smithi142.stdout:(22/23): librados2-17.0.0-14045.g4a7e6c4a.el8.x 4.0 MB/s | 3.6 MB 00:00 2022-08-05T15:18:28.112 INFO:teuthology.orchestra.run.smithi191.stdout:(11/23): ceph-radosgw-17.0.0-14045.g4a7e6c4a.el 2.3 MB/s | 17 MB 00:07 2022-08-05T15:18:28.137 INFO:teuthology.orchestra.run.smithi191.stdout:(12/23): python3-rgw-17.0.0-14045.g4a7e6c4a.el8 442 kB/s | 107 kB 00:00 2022-08-05T15:18:28.195 INFO:teuthology.orchestra.run.smithi191.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.2 MB/s | 354 kB 00:00 2022-08-05T15:18:28.203 INFO:teuthology.orchestra.run.smithi142.stdout:(23/23): librbd1-17.0.0-14045.g4a7e6c4a.el8.x86 3.8 MB/s | 3.6 MB 00:00 2022-08-05T15:18:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:18:28.206 INFO:teuthology.orchestra.run.smithi142.stdout:Total 8.8 MB/s | 66 MB 00:07 2022-08-05T15:18:28.221 INFO:teuthology.orchestra.run.smithi191.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2022-08-05T15:18:28.246 INFO:teuthology.orchestra.run.smithi191.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.4 MB/s | 259 kB 00:00 2022-08-05T15:18:28.249 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:18:28.271 INFO:teuthology.orchestra.run.smithi191.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 936 kB/s | 47 kB 00:00 2022-08-05T15:18:28.295 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:18:28.295 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:18:28.438 INFO:teuthology.orchestra.run.smithi191.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 353 kB/s | 59 kB 00:00 2022-08-05T15:18:28.530 INFO:teuthology.orchestra.run.smithi191.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2022-08-05T15:18:28.556 INFO:teuthology.orchestra.run.smithi191.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2022-08-05T15:18:28.681 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:18:28.684 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:18:28.772 INFO:teuthology.orchestra.run.smithi191.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2022-08-05T15:18:29.506 INFO:teuthology.orchestra.run.smithi191.stdout:(21/23): librados2-17.0.0-14045.g4a7e6c4a.el8.x 3.8 MB/s | 3.6 MB 00:00 2022-08-05T15:18:29.756 INFO:teuthology.orchestra.run.smithi191.stdout:(22/23): librbd1-17.0.0-14045.g4a7e6c4a.el8.x86 3.6 MB/s | 3.6 MB 00:00 2022-08-05T15:18:29.996 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:18:30.184 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2022-08-05T15:18:30.445 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2022-08-05T15:18:30.456 INFO:teuthology.orchestra.run.smithi191.stdout:(23/23): ceph-common-17.0.0-14045.g4a7e6c4a.el8 2.4 MB/s | 24 MB 00:09 2022-08-05T15:18:30.461 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:18:30.461 INFO:teuthology.orchestra.run.smithi191.stdout:Total 6.8 MB/s | 66 MB 00:09 2022-08-05T15:18:30.504 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:18:30.549 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:18:30.551 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:18:30.612 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2022-08-05T15:18:30.926 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:18:30.930 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:18:31.079 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2022-08-05T15:18:31.312 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:18:31.403 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:18:31.650 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/25 2022-08-05T15:18:31.878 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/25 2022-08-05T15:18:32.148 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:18:32.252 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/25 2022-08-05T15:18:32.328 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2022-08-05T15:18:32.487 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:18:32.584 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:18:32.594 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2022-08-05T15:18:32.755 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2022-08-05T15:18:32.760 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2022-08-05T15:18:32.928 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2022-08-05T15:18:33.138 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2022-08-05T15:18:33.346 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:18:33.447 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:18:33.505 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2022-08-05T15:18:33.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:18:33.693 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/25 2022-08-05T15:18:33.788 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:18:33.880 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/25 2022-08-05T15:18:33.925 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8 11/25 2022-08-05T15:18:34.162 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 12/25 2022-08-05T15:18:34.268 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/25 2022-08-05T15:18:34.390 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 13/25 2022-08-05T15:18:34.455 INFO:teuthology.orchestra.run.smithi191.stdout: Upgrading : librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:18:34.520 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:18:34.628 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 14/25 2022-08-05T15:18:34.794 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 15/25 2022-08-05T15:18:34.804 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2022-08-05T15:18:34.868 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 15/25 2022-08-05T15:18:34.988 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2022-08-05T15:18:35.078 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2022-08-05T15:18:35.327 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2022-08-05T15:18:35.527 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2022-08-05T15:18:35.545 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2022-08-05T15:18:35.713 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:18:35.720 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x 19/25 2022-08-05T15:18:35.816 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:18:35.948 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8 11/25 2022-08-05T15:18:36.149 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 12/25 2022-08-05T15:18:36.389 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 13/25 2022-08-05T15:18:36.632 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 14/25 2022-08-05T15:18:36.779 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 15/25 2022-08-05T15:18:36.846 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 15/25 2022-08-05T15:18:37.081 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2022-08-05T15:18:37.304 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2022-08-05T15:18:37.527 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2022-08-05T15:18:37.699 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x 19/25 2022-08-05T15:18:39.734 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:40.002 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:40.758 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:41.009 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 21/25 2022-08-05T15:18:41.096 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 21/25 2022-08-05T15:18:41.260 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:18:41.515 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:41.771 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:42.526 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 20/25 2022-08-05T15:18:42.823 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 21/25 2022-08-05T15:18:42.891 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 21/25 2022-08-05T15:18:43.055 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:19:00.488 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:19:00.488 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2022-08-05T15:19:00.489 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2022-08-05T15:19:00.489 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2022-08-05T15:19:00.489 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2022-08-05T15:19:00.489 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2022-08-05T15:19:00.490 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2022-08-05T15:19:00.490 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2022-08-05T15:19:00.490 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2022-08-05T15:19:00.490 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2022-08-05T15:19:00.491 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:01.716 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:19:01.717 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /sys 2022-08-05T15:19:01.717 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /proc 2022-08-05T15:19:01.717 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2022-08-05T15:19:01.717 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /run 2022-08-05T15:19:01.718 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /mnt 2022-08-05T15:19:01.718 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /var/tmp 2022-08-05T15:19:01.718 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /home 2022-08-05T15:19:01.718 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /tmp 2022-08-05T15:19:01.719 INFO:teuthology.orchestra.run.smithi191.stdout:skipping the directory /dev 2022-08-05T15:19:01.719 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:02.282 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 23/25 2022-08-05T15:19:02.357 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 23/25 2022-08-05T15:19:02.358 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2022-08-05T15:19:02.606 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2022-08-05T15:19:02.607 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:03.295 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:03.296 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/25 2022-08-05T15:19:03.296 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/25 2022-08-05T15:19:03.296 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 3/25 2022-08-05T15:19:03.296 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:19:03.297 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/25 2022-08-05T15:19:03.297 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 6/25 2022-08-05T15:19:03.297 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:19:03.297 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8 8/25 2022-08-05T15:19:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x 9/25 2022-08-05T15:19:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:19:03.298 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 11/25 2022-08-05T15:19:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 12/25 2022-08-05T15:19:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 13/25 2022-08-05T15:19:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2022-08-05T15:19:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2022-08-05T15:19:03.299 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2022-08-05T15:19:03.300 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2022-08-05T15:19:03.300 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2022-08-05T15:19:03.300 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2022-08-05T15:19:03.301 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2022-08-05T15:19:03.301 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2022-08-05T15:19:03.301 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:19:03.301 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2022-08-05T15:19:03.302 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 24/25 2022-08-05T15:19:03.572 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 23/25 2022-08-05T15:19:03.638 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 23/25 2022-08-05T15:19:03.639 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2022-08-05T15:19:03.811 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2022-08-05T15:19:03.811 INFO:teuthology.orchestra.run.smithi191.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:04.317 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2022-08-05T15:19:04.317 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.318 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-08-05T15:19:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2022-08-05T15:19:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-08-05T15:19:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-08-05T15:19:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2022-08-05T15:19:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-08-05T15:19:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-08-05T15:19:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.13.0-2.el8.x86_64 2022-08-05T15:19:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:04.330 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:04.443 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:04.443 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/25 2022-08-05T15:19:04.444 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/25 2022-08-05T15:19:04.444 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 3/25 2022-08-05T15:19:04.455 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/25 2022-08-05T15:19:04.456 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/25 2022-08-05T15:19:04.457 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_ 6/25 2022-08-05T15:19:04.457 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 7/25 2022-08-05T15:19:04.460 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8 8/25 2022-08-05T15:19:04.461 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x 9/25 2022-08-05T15:19:04.462 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 10/25 2022-08-05T15:19:04.463 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 11/25 2022-08-05T15:19:04.464 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 12/25 2022-08-05T15:19:04.464 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 13/25 2022-08-05T15:19:04.465 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2022-08-05T15:19:04.465 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2022-08-05T15:19:04.466 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2022-08-05T15:19:04.467 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2022-08-05T15:19:04.467 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2022-08-05T15:19:04.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2022-08-05T15:19:04.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2022-08-05T15:19:04.468 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2022-08-05T15:19:04.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 22/25 2022-08-05T15:19:04.469 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2022-08-05T15:19:04.470 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 24/25 2022-08-05T15:19:04.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-test 2022-08-05T15:19:05.184 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:00:48 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:05.400 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2022-08-05T15:19:05.401 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:05.401 INFO:teuthology.orchestra.run.smithi191.stdout:Upgraded: 2022-08-05T15:19:05.401 INFO:teuthology.orchestra.run.smithi191.stdout: librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.401 INFO:teuthology.orchestra.run.smithi191.stdout: librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.402 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:05.402 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.402 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.402 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-radosgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.403 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-selinux-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.403 INFO:teuthology.orchestra.run.smithi191.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-08-05T15:19:05.403 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.403 INFO:teuthology.orchestra.run.smithi191.stdout: liboath-2.6.2-3.el8.x86_64 2022-08-05T15:19:05.404 INFO:teuthology.orchestra.run.smithi191.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-08-05T15:19:05.404 INFO:teuthology.orchestra.run.smithi191.stdout: libradosstriper1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.404 INFO:teuthology.orchestra.run.smithi191.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-08-05T15:19:05.404 INFO:teuthology.orchestra.run.smithi191.stdout: librgw2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.405 INFO:teuthology.orchestra.run.smithi191.stdout: libunwind-1.3.1-3.el8.x86_64 2022-08-05T15:19:05.405 INFO:teuthology.orchestra.run.smithi191.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-08-05T15:19:05.405 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-argparse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.405 INFO:teuthology.orchestra.run.smithi191.stdout: python3-ceph-common-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.406 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.406 INFO:teuthology.orchestra.run.smithi191.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-08-05T15:19:05.406 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.406 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.407 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:05.407 INFO:teuthology.orchestra.run.smithi191.stdout: thrift-0.13.0-2.el8.x86_64 2022-08-05T15:19:05.407 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:05.407 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:05.673 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-test 2022-08-05T15:19:06.176 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:06.177 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:19:06.178 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:06.178 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 53 M 2022-08-05T15:19:06.179 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:19:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-08-05T15:19:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 137 k 2022-08-05T15:19:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-08-05T15:19:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-08-05T15:19:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-08-05T15:19:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:06.180 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:06.180 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:06.181 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2022-08-05T15:19:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:06.182 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 54 M 2022-08-05T15:19:06.182 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 235 M 2022-08-05T15:19:06.182 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:06.247 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:00:49 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:06.274 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): jq-1.6-3.el8.x86_64.rpm 2.1 MB/s | 202 kB 00:00 2022-08-05T15:19:06.300 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2022-08-05T15:19:06.334 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2022-08-05T15:19:06.434 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): libcephsqlite-17.0.0-14045.g4a7e6c4a.el8 542 kB/s | 137 kB 00:00 2022-08-05T15:19:06.490 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 435 kB/s | 69 kB 00:00 2022-08-05T15:19:07.242 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:07.256 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:07.256 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:19:07.256 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:07.257 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:07.257 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 53 M 2022-08-05T15:19:07.257 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:19:07.258 INFO:teuthology.orchestra.run.smithi191.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-08-05T15:19:07.258 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 137 k 2022-08-05T15:19:07.258 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-08-05T15:19:07.258 INFO:teuthology.orchestra.run.smithi191.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-08-05T15:19:07.259 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-08-05T15:19:07.259 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:07.259 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:07.259 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:07.260 INFO:teuthology.orchestra.run.smithi191.stdout:Install 6 Packages 2022-08-05T15:19:07.260 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:07.260 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 54 M 2022-08-05T15:19:07.260 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 235 M 2022-08-05T15:19:07.261 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:07.315 INFO:teuthology.orchestra.run.smithi191.stdout:(1/6): jq-1.6-3.el8.x86_64.rpm 3.1 MB/s | 202 kB 00:00 2022-08-05T15:19:07.350 INFO:teuthology.orchestra.run.smithi191.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2022-08-05T15:19:07.384 INFO:teuthology.orchestra.run.smithi191.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.6 MB/s | 323 kB 00:00 2022-08-05T15:19:07.517 INFO:teuthology.orchestra.run.smithi191.stdout:(4/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 517 kB/s | 69 kB 00:00 2022-08-05T15:19:07.601 INFO:teuthology.orchestra.run.smithi191.stdout:(5/6): libcephsqlite-17.0.0-14045.g4a7e6c4a.el8 384 kB/s | 137 kB 00:00 2022-08-05T15:19:09.599 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-test-17.0.0-14045.g4a7e6c4a.el8.x86 16 MB/s | 53 MB 00:03 2022-08-05T15:19:09.602 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:09.602 INFO:teuthology.orchestra.run.smithi142.stdout:Total 16 MB/s | 54 MB 00:03 2022-08-05T15:19:09.637 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:09.654 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:09.655 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:09.979 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:09.981 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:10.465 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:10.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-08-05T15:19:10.840 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-08-05T15:19:10.988 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-08-05T15:19:11.073 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-08-05T15:19:11.252 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-08-05T15:19:11.380 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/6 2022-08-05T15:19:11.427 INFO:teuthology.orchestra.run.smithi191.stdout:(6/6): ceph-test-17.0.0-14045.g4a7e6c4a.el8.x86 13 MB/s | 53 MB 00:04 2022-08-05T15:19:11.431 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:11.432 INFO:teuthology.orchestra.run.smithi191.stdout:Total 13 MB/s | 54 MB 00:04 2022-08-05T15:19:11.461 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:19:11.482 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:19:11.482 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:19:11.790 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:19:11.794 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:19:12.278 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:19:12.446 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-08-05T15:19:12.657 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-08-05T15:19:12.798 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-08-05T15:19:12.882 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-08-05T15:19:13.071 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-08-05T15:19:13.206 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/6 2022-08-05T15:19:16.516 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/6 2022-08-05T15:19:16.743 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/6 2022-08-05T15:19:17.026 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/6 2022-08-05T15:19:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/6 2022-08-05T15:19:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/6 2022-08-05T15:19:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-08-05T15:19:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-08-05T15:19:17.027 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-08-05T15:19:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-08-05T15:19:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:17.499 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:17.499 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-3.el8.x86_64 2022-08-05T15:19:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-08-05T15:19:17.500 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-1.el8.x86_64 2022-08-05T15:19:17.501 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-08-05T15:19:17.501 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:17.501 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:17.719 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph 2022-08-05T15:19:18.268 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/6 2022-08-05T15:19:18.294 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:01 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:18.528 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/6 2022-08-05T15:19:18.769 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 6/6 2022-08-05T15:19:18.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/6 2022-08-05T15:19:18.770 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/6 2022-08-05T15:19:18.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-08-05T15:19:18.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-08-05T15:19:18.771 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-08-05T15:19:19.241 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:19.244 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================== 2022-08-05T15:19:19.244 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:19:19.245 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================== 2022-08-05T15:19:19.245 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:19.245 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 6.4 k 2022-08-05T15:19:19.245 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:19:19.247 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 2.3 M 2022-08-05T15:19:19.247 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 1.5 M 2022-08-05T15:19:19.247 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 231 k 2022-08-05T15:19:19.248 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.9 M 2022-08-05T15:19:19.248 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 17 M 2022-08-05T15:19:19.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-08-05T15:19:19.248 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-08-05T15:19:19.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-08-05T15:19:19.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-08-05T15:19:19.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-08-05T15:19:19.249 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-08-05T15:19:19.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-08-05T15:19:19.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-08-05T15:19:19.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-08-05T15:19:19.250 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-08-05T15:19:19.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-08-05T15:19:19.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-08-05T15:19:19.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-08-05T15:19:19.251 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-08-05T15:19:19.252 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-08-05T15:19:19.252 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-08-05T15:19:19.252 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-08-05T15:19:19.252 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-08-05T15:19:19.253 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-08-05T15:19:19.253 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-08-05T15:19:19.253 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-08-05T15:19:19.253 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-08-05T15:19:19.255 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-08-05T15:19:19.255 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-08-05T15:19:19.256 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-08-05T15:19:19.256 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-08-05T15:19:19.256 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:19.256 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:19.257 INFO:teuthology.orchestra.run.smithi142.stdout:======================================================================================== 2022-08-05T15:19:19.257 INFO:teuthology.orchestra.run.smithi142.stdout:Install 32 Packages 2022-08-05T15:19:19.257 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:19.258 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-08-05T15:19:19.259 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:19.259 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:19.259 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-test-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:19.260 INFO:teuthology.orchestra.run.smithi191.stdout: jq-1.6-3.el8.x86_64 2022-08-05T15:19:19.260 INFO:teuthology.orchestra.run.smithi191.stdout: libcephsqlite-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:19.260 INFO:teuthology.orchestra.run.smithi191.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-08-05T15:19:19.260 INFO:teuthology.orchestra.run.smithi191.stdout: socat-1.7.4.1-1.el8.x86_64 2022-08-05T15:19:19.261 INFO:teuthology.orchestra.run.smithi191.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-08-05T15:19:19.261 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:19.261 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:19.262 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 28 M 2022-08-05T15:19:19.262 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 110 M 2022-08-05T15:19:19.262 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:19.409 INFO:teuthology.orchestra.run.smithi142.stdout:(1/32): ceph-17.0.0-14045.g4a7e6c4a.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2022-08-05T15:19:19.493 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph 2022-08-05T15:19:19.691 INFO:teuthology.orchestra.run.smithi142.stdout:(2/32): ceph-mgr-17.0.0-14045.g4a7e6c4a.el8.x86 3.5 MB/s | 1.5 MB 00:00 2022-08-05T15:19:19.816 INFO:teuthology.orchestra.run.smithi142.stdout:(3/32): ceph-mds-17.0.0-14045.g4a7e6c4a.el8.x86 4.0 MB/s | 2.3 MB 00:00 2022-08-05T15:19:19.908 INFO:teuthology.orchestra.run.smithi142.stdout:(4/32): ceph-mgr-modules-core-17.0.0-14045.g4a7 2.5 MB/s | 231 kB 00:00 2022-08-05T15:19:19.966 INFO:teuthology.orchestra.run.smithi142.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-08-05T15:19:19.993 INFO:teuthology.orchestra.run.smithi142.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-08-05T15:19:20.025 INFO:teuthology.orchestra.run.smithi142.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.1 MB/s | 103 kB 00:00 2022-08-05T15:19:20.044 INFO:teuthology.orchestra.run.smithi142.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2022-08-05T15:19:20.063 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:03 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:20.076 INFO:teuthology.orchestra.run.smithi142.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2022-08-05T15:19:20.135 INFO:teuthology.orchestra.run.smithi142.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 237 kB 00:00 2022-08-05T15:19:20.168 INFO:teuthology.orchestra.run.smithi142.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 16 MB/s | 559 kB 00:00 2022-08-05T15:19:20.193 INFO:teuthology.orchestra.run.smithi142.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2022-08-05T15:19:20.369 INFO:teuthology.orchestra.run.smithi142.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 249 kB/s | 44 kB 00:00 2022-08-05T15:19:20.502 INFO:teuthology.orchestra.run.smithi142.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2022-08-05T15:19:20.661 INFO:teuthology.orchestra.run.smithi142.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2022-08-05T15:19:20.824 INFO:teuthology.orchestra.run.smithi142.stdout:(16/32): ceph-mon-17.0.0-14045.g4a7e6c4a.el8.x8 2.7 MB/s | 3.9 MB 00:01 2022-08-05T15:19:20.920 INFO:teuthology.orchestra.run.smithi142.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.5 MB/s | 384 kB 00:00 2022-08-05T15:19:20.946 INFO:teuthology.orchestra.run.smithi142.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 92 kB/s | 11 kB 00:00 2022-08-05T15:19:20.973 INFO:teuthology.orchestra.run.smithi142.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 349 kB/s | 18 kB 00:00 2022-08-05T15:19:21.049 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:21.053 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================== 2022-08-05T15:19:21.053 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:19:21.054 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================== 2022-08-05T15:19:21.054 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:21.054 INFO:teuthology.orchestra.run.smithi191.stdout: ceph x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 6.4 k 2022-08-05T15:19:21.055 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:19:21.055 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 2.3 M 2022-08-05T15:19:21.056 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 1.5 M 2022-08-05T15:19:21.056 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 231 k 2022-08-05T15:19:21.056 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.9 M 2022-08-05T15:19:21.057 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 17 M 2022-08-05T15:19:21.057 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-08-05T15:19:21.058 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-08-05T15:19:21.058 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-08-05T15:19:21.058 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-08-05T15:19:21.059 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-08-05T15:19:21.059 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-08-05T15:19:21.059 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-08-05T15:19:21.059 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-08-05T15:19:21.060 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-08-05T15:19:21.060 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-08-05T15:19:21.060 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-08-05T15:19:21.062 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-08-05T15:19:21.062 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-08-05T15:19:21.062 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-08-05T15:19:21.062 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-08-05T15:19:21.063 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-08-05T15:19:21.063 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-08-05T15:19:21.063 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-08-05T15:19:21.063 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-08-05T15:19:21.064 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-08-05T15:19:21.064 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-08-05T15:19:21.064 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-08-05T15:19:21.064 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-08-05T15:19:21.065 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-08-05T15:19:21.065 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-08-05T15:19:21.065 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-08-05T15:19:21.065 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:21.066 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:21.066 INFO:teuthology.orchestra.run.smithi191.stdout:======================================================================================== 2022-08-05T15:19:21.067 INFO:teuthology.orchestra.run.smithi191.stdout:Install 32 Packages 2022-08-05T15:19:21.067 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:21.068 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 28 M 2022-08-05T15:19:21.069 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 110 M 2022-08-05T15:19:21.069 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:21.181 INFO:teuthology.orchestra.run.smithi142.stdout:(20/32): ceph-osd-17.0.0-14045.g4a7e6c4a.el8.x8 11 MB/s | 17 MB 00:01 2022-08-05T15:19:21.201 INFO:teuthology.orchestra.run.smithi191.stdout:(1/32): ceph-17.0.0-14045.g4a7e6c4a.el8.x86_64. 45 kB/s | 6.4 kB 00:00 2022-08-05T15:19:21.204 INFO:teuthology.orchestra.run.smithi142.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 188 kB/s | 49 kB 00:00 2022-08-05T15:19:21.231 INFO:teuthology.orchestra.run.smithi142.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 227 kB/s | 59 kB 00:00 2022-08-05T15:19:21.255 INFO:teuthology.orchestra.run.smithi142.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2022-08-05T15:19:21.281 INFO:teuthology.orchestra.run.smithi142.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2022-08-05T15:19:21.345 INFO:teuthology.orchestra.run.smithi142.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 266 kB/s | 24 kB 00:00 2022-08-05T15:19:21.380 INFO:teuthology.orchestra.run.smithi142.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 291 kB/s | 29 kB 00:00 2022-08-05T15:19:21.394 INFO:teuthology.orchestra.run.smithi191.stdout:(2/32): ceph-mgr-17.0.0-14045.g4a7e6c4a.el8.x86 4.6 MB/s | 1.5 MB 00:00 2022-08-05T15:19:21.410 INFO:teuthology.orchestra.run.smithi142.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 454 kB/s | 27 kB 00:00 2022-08-05T15:19:21.464 INFO:teuthology.orchestra.run.smithi142.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 993 kB/s | 283 kB 00:00 2022-08-05T15:19:21.502 INFO:teuthology.orchestra.run.smithi191.stdout:(3/32): ceph-mds-17.0.0-14045.g4a7e6c4a.el8.x86 5.1 MB/s | 2.3 MB 00:00 2022-08-05T15:19:21.515 INFO:teuthology.orchestra.run.smithi142.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2022-08-05T15:19:21.576 INFO:teuthology.orchestra.run.smithi142.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2022-08-05T15:19:21.577 INFO:teuthology.orchestra.run.smithi191.stdout:(4/32): ceph-mgr-modules-core-17.0.0-14045.g4a7 3.0 MB/s | 231 kB 00:00 2022-08-05T15:19:21.606 INFO:teuthology.orchestra.run.smithi142.stdout:(31/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.0 MB/s | 241 kB 00:00 2022-08-05T15:19:21.632 INFO:teuthology.orchestra.run.smithi142.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 196 kB/s | 23 kB 00:00 2022-08-05T15:19:21.637 INFO:teuthology.orchestra.run.smithi191.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-08-05T15:19:21.638 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:21.638 INFO:teuthology.orchestra.run.smithi142.stdout:Total 12 MB/s | 28 MB 00:02 2022-08-05T15:19:21.661 INFO:teuthology.orchestra.run.smithi191.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-08-05T15:19:21.687 INFO:teuthology.orchestra.run.smithi191.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2022-08-05T15:19:21.711 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:21.712 INFO:teuthology.orchestra.run.smithi191.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-08-05T15:19:21.747 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:21.748 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:21.753 INFO:teuthology.orchestra.run.smithi191.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 11 MB/s | 457 kB 00:00 2022-08-05T15:19:21.812 INFO:teuthology.orchestra.run.smithi191.stdout:(10/32): ceph-mon-17.0.0-14045.g4a7e6c4a.el8.x8 6.3 MB/s | 3.9 MB 00:00 2022-08-05T15:19:21.845 INFO:teuthology.orchestra.run.smithi191.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 237 kB 00:00 2022-08-05T15:19:21.904 INFO:teuthology.orchestra.run.smithi191.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.8 MB/s | 109 kB 00:00 2022-08-05T15:19:21.938 INFO:teuthology.orchestra.run.smithi191.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 4.4 MB/s | 559 kB 00:00 2022-08-05T15:19:22.033 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:22.036 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:22.055 INFO:teuthology.orchestra.run.smithi191.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 290 kB/s | 44 kB 00:00 2022-08-05T15:19:22.105 INFO:teuthology.orchestra.run.smithi191.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2022-08-05T15:19:22.164 INFO:teuthology.orchestra.run.smithi191.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.6 MB/s | 173 kB 00:00 2022-08-05T15:19:22.197 INFO:teuthology.orchestra.run.smithi191.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.1 MB/s | 384 kB 00:00 2022-08-05T15:19:22.223 INFO:teuthology.orchestra.run.smithi191.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2022-08-05T15:19:22.292 INFO:teuthology.orchestra.run.smithi191.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 190 kB/s | 18 kB 00:00 2022-08-05T15:19:22.644 INFO:teuthology.orchestra.run.smithi191.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 486 kB/s | 49 kB 00:00 2022-08-05T15:19:22.645 INFO:teuthology.orchestra.run.smithi191.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 887 kB/s | 59 kB 00:00 2022-08-05T15:19:22.645 INFO:teuthology.orchestra.run.smithi191.stdout:(22/32): ceph-osd-17.0.0-14045.g4a7e6c4a.el8.x8 15 MB/s | 17 MB 00:01 2022-08-05T15:19:22.646 INFO:teuthology.orchestra.run.smithi191.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 75 kB/s | 16 kB 00:00 2022-08-05T15:19:22.646 INFO:teuthology.orchestra.run.smithi191.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2022-08-05T15:19:22.646 INFO:teuthology.orchestra.run.smithi191.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 475 kB/s | 24 kB 00:00 2022-08-05T15:19:22.647 INFO:teuthology.orchestra.run.smithi191.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 581 kB/s | 29 kB 00:00 2022-08-05T15:19:22.668 INFO:teuthology.orchestra.run.smithi191.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 546 kB/s | 27 kB 00:00 2022-08-05T15:19:22.717 INFO:teuthology.orchestra.run.smithi191.stdout:(28/32): python3-simplegeneric-0.8.1-17.el8.noa 106 kB/s | 19 kB 00:00 2022-08-05T15:19:22.742 INFO:teuthology.orchestra.run.smithi191.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 2.3 MB/s | 241 kB 00:00 2022-08-05T15:19:22.767 INFO:teuthology.orchestra.run.smithi191.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.4 MB/s | 251 kB 00:00 2022-08-05T15:19:22.784 INFO:teuthology.orchestra.run.smithi191.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 546 kB/s | 23 kB 00:00 2022-08-05T15:19:22.813 INFO:teuthology.orchestra.run.smithi191.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 927 kB/s | 85 kB 00:00 2022-08-05T15:19:22.813 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:22.814 INFO:teuthology.orchestra.run.smithi191.stdout:Total 16 MB/s | 28 MB 00:01 2022-08-05T15:19:22.889 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:19:22.926 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:19:22.927 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:19:23.234 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:19:23.238 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:19:23.288 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:23.494 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-08-05T15:19:23.736 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-08-05T15:19:23.944 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-08-05T15:19:24.126 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-08-05T15:19:24.291 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-08-05T15:19:24.392 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:19:24.478 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-08-05T15:19:24.639 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-08-05T15:19:24.697 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-08-05T15:19:24.824 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-08-05T15:19:24.897 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-08-05T15:19:25.031 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-08-05T15:19:25.108 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-08-05T15:19:25.269 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-08-05T15:19:25.319 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-08-05T15:19:25.441 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-08-05T15:19:25.535 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-08-05T15:19:25.588 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-08-05T15:19:25.739 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-08-05T15:19:25.807 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-08-05T15:19:25.967 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-08-05T15:19:26.125 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-08-05T15:19:26.202 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-08-05T15:19:26.397 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-08-05T15:19:26.481 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-08-05T15:19:26.644 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-08-05T15:19:26.694 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-08-05T15:19:26.887 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-08-05T15:19:26.926 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-08-05T15:19:27.145 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-08-05T15:19:27.279 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-08-05T15:19:27.463 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-08-05T15:19:27.532 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-08-05T15:19:27.684 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-08-05T15:19:27.779 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-08-05T15:19:27.877 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-08-05T15:19:28.013 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-08-05T15:19:28.074 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-08-05T15:19:28.281 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-08-05T15:19:28.307 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-08-05T15:19:28.572 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-08-05T15:19:28.637 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-08-05T15:19:28.770 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-08-05T15:19:28.863 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-08-05T15:19:29.081 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-08-05T15:19:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-08-05T15:19:29.325 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-08-05T15:19:29.456 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-08-05T15:19:29.612 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-08-05T15:19:29.810 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8 27/32 2022-08-05T15:19:29.882 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-08-05T15:19:30.068 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 28/32 2022-08-05T15:19:30.090 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-08-05T15:19:30.445 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-08-05T15:19:30.799 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-08-05T15:19:31.226 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8 27/32 2022-08-05T15:19:31.440 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 28/32 2022-08-05T15:19:31.589 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 28/32 2022-08-05T15:19:31.742 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 29/32 2022-08-05T15:19:32.132 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 29/32 2022-08-05T15:19:32.318 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 30/32 2022-08-05T15:19:32.531 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 30/32 2022-08-05T15:19:32.693 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 31/32 2022-08-05T15:19:32.711 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 31/32 2022-08-05T15:19:32.850 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 32/32 2022-08-05T15:19:32.929 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 28/32 2022-08-05T15:19:33.147 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 29/32 2022-08-05T15:19:33.244 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 32/32 2022-08-05T15:19:33.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/32 2022-08-05T15:19:33.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/32 2022-08-05T15:19:33.244 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 3/32 2022-08-05T15:19:33.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/32 2022-08-05T15:19:33.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/32 2022-08-05T15:19:33.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8 6/32 2022-08-05T15:19:33.245 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-08-05T15:19:33.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-08-05T15:19:33.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-08-05T15:19:33.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-08-05T15:19:33.246 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-08-05T15:19:33.247 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-08-05T15:19:33.247 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-08-05T15:19:33.247 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-08-05T15:19:33.247 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-08-05T15:19:33.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-08-05T15:19:33.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-08-05T15:19:33.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-08-05T15:19:33.248 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-08-05T15:19:33.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-08-05T15:19:33.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-08-05T15:19:33.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-08-05T15:19:33.249 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-08-05T15:19:33.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-08-05T15:19:33.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-08-05T15:19:33.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-08-05T15:19:33.250 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-08-05T15:19:33.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-08-05T15:19:33.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-08-05T15:19:33.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-08-05T15:19:33.251 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-08-05T15:19:33.531 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 29/32 2022-08-05T15:19:33.719 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 30/32 2022-08-05T15:19:33.939 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 30/32 2022-08-05T15:19:34.095 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 31/32 2022-08-05T15:19:34.118 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 31/32 2022-08-05T15:19:34.147 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-08-05T15:19:34.148 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:34.148 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:34.149 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:34.150 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-08-05T15:19:34.151 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-08-05T15:19:34.152 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-08-05T15:19:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-08-05T15:19:34.153 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-08-05T15:19:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-08-05T15:19:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2022-08-05T15:19:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-08-05T15:19:34.154 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-08-05T15:19:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-13.el8.noarch 2022-08-05T15:19:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-08-05T15:19:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-08-05T15:19:34.155 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-08-05T15:19:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2022-08-05T15:19:34.156 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-08-05T15:19:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2022-08-05T15:19:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-9.el8.noarch 2022-08-05T15:19:34.157 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-08-05T15:19:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-08-05T15:19:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-08-05T15:19:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-08-05T15:19:34.158 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-08-05T15:19:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-08-05T15:19:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-08-05T15:19:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-08-05T15:19:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-08-05T15:19:34.159 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:34.160 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:34.252 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 32/32 2022-08-05T15:19:34.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-base 2022-08-05T15:19:34.651 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 32/32 2022-08-05T15:19:34.652 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/32 2022-08-05T15:19:34.652 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/32 2022-08-05T15:19:34.653 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 3/32 2022-08-05T15:19:34.653 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 4/32 2022-08-05T15:19:34.653 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 5/32 2022-08-05T15:19:34.654 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8 6/32 2022-08-05T15:19:34.654 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-08-05T15:19:34.655 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-08-05T15:19:34.655 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-08-05T15:19:34.655 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-08-05T15:19:34.656 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-08-05T15:19:34.656 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-08-05T15:19:34.656 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-08-05T15:19:34.657 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-08-05T15:19:34.657 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-08-05T15:19:34.658 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-08-05T15:19:34.658 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-08-05T15:19:34.658 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-08-05T15:19:34.659 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-08-05T15:19:34.659 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-08-05T15:19:34.660 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-08-05T15:19:34.660 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-08-05T15:19:34.661 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-08-05T15:19:34.661 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-08-05T15:19:34.662 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-08-05T15:19:34.662 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-08-05T15:19:34.664 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-08-05T15:19:34.664 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-08-05T15:19:34.665 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-08-05T15:19:34.665 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-08-05T15:19:34.666 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-08-05T15:19:35.053 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:18 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:35.658 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-08-05T15:19:35.659 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:35.659 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:35.660 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:35.660 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mds-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:35.661 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:35.661 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-modules-core-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:35.662 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mon-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:35.662 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-osd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:35.663 INFO:teuthology.orchestra.run.smithi191.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-08-05T15:19:35.663 INFO:teuthology.orchestra.run.smithi191.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-08-05T15:19:35.664 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-08-05T15:19:35.664 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-08-05T15:19:35.665 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-08-05T15:19:35.665 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-08-05T15:19:35.666 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-6.2-6.el8.noarch 2022-08-05T15:19:35.666 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-08-05T15:19:35.666 INFO:teuthology.orchestra.run.smithi191.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-08-05T15:19:35.667 INFO:teuthology.orchestra.run.smithi191.stdout: python3-mako-1.0.6-13.el8.noarch 2022-08-05T15:19:35.667 INFO:teuthology.orchestra.run.smithi191.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-08-05T15:19:35.668 INFO:teuthology.orchestra.run.smithi191.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-08-05T15:19:35.668 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-08-05T15:19:35.669 INFO:teuthology.orchestra.run.smithi191.stdout: python3-portend-2.6-1.el8.noarch 2022-08-05T15:19:35.669 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-08-05T15:19:35.670 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pycparser-2.14-14.el8.noarch 2022-08-05T15:19:35.670 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pytz-2017.2-9.el8.noarch 2022-08-05T15:19:35.670 INFO:teuthology.orchestra.run.smithi191.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-08-05T15:19:35.671 INFO:teuthology.orchestra.run.smithi191.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-08-05T15:19:35.672 INFO:teuthology.orchestra.run.smithi191.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-08-05T15:19:35.672 INFO:teuthology.orchestra.run.smithi191.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-08-05T15:19:35.673 INFO:teuthology.orchestra.run.smithi191.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-08-05T15:19:35.673 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-08-05T15:19:35.673 INFO:teuthology.orchestra.run.smithi191.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-08-05T15:19:35.674 INFO:teuthology.orchestra.run.smithi191.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-08-05T15:19:35.674 INFO:teuthology.orchestra.run.smithi191.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-08-05T15:19:35.675 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:35.675 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:35.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-base 2022-08-05T15:19:35.996 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:19:36.061 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:36.064 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:19:36.064 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:36.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install cephadm 2022-08-05T15:19:36.536 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:19 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:36.907 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:19 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:37.468 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-base-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:19:37.539 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:37.540 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:19:37.540 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:37.625 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install cephadm 2022-08-05T15:19:37.902 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:37.904 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:37.905 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:19:37.905 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:37.905 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:37.906 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 81 k 2022-08-05T15:19:37.906 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:37.907 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:37.907 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:37.908 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:19:37.908 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:37.908 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 81 k 2022-08-05T15:19:37.908 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 367 k 2022-08-05T15:19:37.908 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:38.195 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:21 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:38.384 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm-17.0.0-14045.g4a7e6c4a.el8.noarch.rpm 168 kB/s | 81 kB 00:00 2022-08-05T15:19:38.386 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:38.387 INFO:teuthology.orchestra.run.smithi142.stdout:Total 168 kB/s | 81 kB 00:00 2022-08-05T15:19:38.387 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:38.393 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:38.394 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:38.395 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:38.397 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:38.473 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:39.178 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:39.179 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:39.179 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:19:39.180 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:39.180 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:39.180 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 81 k 2022-08-05T15:19:39.181 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:39.181 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:39.181 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:39.182 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:19:39.182 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:39.182 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 81 k 2022-08-05T15:19:39.183 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 367 k 2022-08-05T15:19:39.183 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:39.676 INFO:teuthology.orchestra.run.smithi191.stdout:cephadm-17.0.0-14045.g4a7e6c4a.el8.noarch.rpm 165 kB/s | 81 kB 00:00 2022-08-05T15:19:39.677 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:39.677 INFO:teuthology.orchestra.run.smithi191.stdout:Total 165 kB/s | 81 kB 00:00 2022-08-05T15:19:39.679 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:19:39.682 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:19:39.683 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:19:39.683 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:19:39.685 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:19:39.726 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:19:40.002 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:40.186 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:40.371 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:40.789 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:40.790 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:40.790 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:40.791 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:40.791 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:40.791 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:41.018 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-immutable-object-cache 2022-08-05T15:19:41.225 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:41.392 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:41.579 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:41.587 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:24 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:42.034 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:19:42.035 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:42.035 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:42.035 INFO:teuthology.orchestra.run.smithi191.stdout: cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:42.036 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:42.036 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:42.364 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-immutable-object-cache 2022-08-05T15:19:42.588 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:42.588 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:42.589 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2022-08-05T15:19:42.589 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:42.591 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:42.592 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 165 k 2022-08-05T15:19:42.592 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:42.598 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:42.598 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:42.599 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:19:42.599 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:42.600 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 165 k 2022-08-05T15:19:42.600 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 503 k 2022-08-05T15:19:42.601 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:42.938 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:25 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:43.148 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-immutable-object-cache-17.0.0-14045.g4a7e6 296 kB/s | 165 kB 00:00 2022-08-05T15:19:43.149 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:43.150 INFO:teuthology.orchestra.run.smithi142.stdout:Total 295 kB/s | 165 kB 00:00 2022-08-05T15:19:43.150 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:43.159 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:43.160 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:43.207 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:43.210 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:43.327 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:43.517 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:43.900 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:43.932 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:43.934 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:43.935 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2022-08-05T15:19:43.935 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:43.935 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:43.935 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 165 k 2022-08-05T15:19:43.936 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:43.936 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:43.936 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:43.936 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:19:43.937 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:43.937 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 165 k 2022-08-05T15:19:43.937 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 503 k 2022-08-05T15:19:43.937 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:44.233 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-immutable-object-cache-17.0.0-14045.g4a7e6 554 kB/s | 165 kB 00:00 2022-08-05T15:19:44.234 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:44.235 INFO:teuthology.orchestra.run.smithi191.stdout:Total 552 kB/s | 165 kB 00:00 2022-08-05T15:19:44.236 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:19:44.245 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:19:44.245 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:19:44.292 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:19:44.295 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:19:44.352 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:44.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:44.353 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:44.353 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:44.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:44.354 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:44.441 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:19:44.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr 2022-08-05T15:19:44.626 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:45.045 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:45.190 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:28 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:45.405 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a 1/1 2022-08-05T15:19:45.405 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:45.405 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:45.406 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-immutable-object-cache-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:19:45.406 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:45.406 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:45.658 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr 2022-08-05T15:19:46.105 INFO:teuthology.orchestra.run.smithi142.stdout:Package ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:19:46.175 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:46.176 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:19:46.177 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:46.241 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:29 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:46.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-dashboard 2022-08-05T15:19:46.848 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:29 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:47.166 INFO:teuthology.orchestra.run.smithi191.stdout:Package ceph-mgr-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:19:47.244 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:47.244 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:19:47.245 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:47.810 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:47.811 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:47.811 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:19:47.812 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:47.812 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:47.813 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 1.6 M 2022-08-05T15:19:47.813 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:19:47.814 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards 2022-08-05T15:19:47.814 INFO:teuthology.orchestra.run.smithi142.stdout: noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 23 k 2022-08-05T15:19:47.815 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 15 k 2022-08-05T15:19:47.815 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-08-05T15:19:47.815 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-08-05T15:19:47.816 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-08-05T15:19:47.816 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:47.817 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:47.817 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:19:47.817 INFO:teuthology.orchestra.run.smithi142.stdout:Install 6 Packages 2022-08-05T15:19:47.818 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:47.819 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 1.9 M 2022-08-05T15:19:47.819 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 7.8 M 2022-08-05T15:19:47.820 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:47.820 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-dashboard 2022-08-05T15:19:48.298 INFO:teuthology.orchestra.run.smithi142.stdout:(1/6): ceph-grafana-dashboards-17.0.0-14045.g4a 47 kB/s | 23 kB 00:00 2022-08-05T15:19:48.331 INFO:teuthology.orchestra.run.smithi142.stdout:(2/6): ceph-prometheus-alerts-17.0.0-14045.g4a7 28 kB/s | 15 kB 00:00 2022-08-05T15:19:48.382 INFO:teuthology.orchestra.run.smithi142.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 507 kB/s | 43 kB 00:00 2022-08-05T15:19:48.402 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:31 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:48.443 INFO:teuthology.orchestra.run.smithi142.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 288 kB/s | 34 kB 00:00 2022-08-05T15:19:48.684 INFO:teuthology.orchestra.run.smithi142.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 637 kB/s | 196 kB 00:00 2022-08-05T15:19:48.901 INFO:teuthology.orchestra.run.smithi142.stdout:(6/6): ceph-mgr-dashboard-17.0.0-14045.g4a7e6c4 1.5 MB/s | 1.6 MB 00:01 2022-08-05T15:19:48.903 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:48.904 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2022-08-05T15:19:48.914 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:48.922 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:48.923 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:48.983 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:48.986 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:49.353 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:49.400 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:49.401 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:49.401 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:19:49.401 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:49.402 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:49.402 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 1.6 M 2022-08-05T15:19:49.402 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:19:49.403 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards 2022-08-05T15:19:49.403 INFO:teuthology.orchestra.run.smithi191.stdout: noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 23 k 2022-08-05T15:19:49.403 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 15 k 2022-08-05T15:19:49.404 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-08-05T15:19:49.404 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-08-05T15:19:49.404 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-08-05T15:19:49.404 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:49.405 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:49.406 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:19:49.406 INFO:teuthology.orchestra.run.smithi191.stdout:Install 6 Packages 2022-08-05T15:19:49.409 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:49.410 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 1.9 M 2022-08-05T15:19:49.410 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 7.8 M 2022-08-05T15:19:49.410 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:49.554 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-08-05T15:19:49.586 INFO:teuthology.orchestra.run.smithi191.stdout:(1/6): ceph-grafana-dashboards-17.0.0-14045.g4a 126 kB/s | 23 kB 00:00 2022-08-05T15:19:49.610 INFO:teuthology.orchestra.run.smithi191.stdout:(2/6): ceph-prometheus-alerts-17.0.0-14045.g4a7 71 kB/s | 15 kB 00:00 2022-08-05T15:19:49.660 INFO:teuthology.orchestra.run.smithi191.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 567 kB/s | 43 kB 00:00 2022-08-05T15:19:49.719 INFO:teuthology.orchestra.run.smithi191.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 309 kB/s | 34 kB 00:00 2022-08-05T15:19:49.777 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-08-05T15:19:49.828 INFO:teuthology.orchestra.run.smithi191.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.1 MB/s | 196 kB 00:00 2022-08-05T15:19:49.960 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-08-05T15:19:50.104 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8. 4/6 2022-08-05T15:19:50.194 INFO:teuthology.orchestra.run.smithi191.stdout:(6/6): ceph-mgr-dashboard-17.0.0-14045.g4a7e6c4 2.1 MB/s | 1.6 MB 00:00 2022-08-05T15:19:50.197 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:50.197 INFO:teuthology.orchestra.run.smithi191.stdout:Total 2.4 MB/s | 1.9 MB 00:00 2022-08-05T15:19:50.206 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:19:50.220 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:19:50.220 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:19:50.278 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:19:50.283 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:19:50.481 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8 5/6 2022-08-05T15:19:50.550 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:19:50.721 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 6/6 2022-08-05T15:19:50.755 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-08-05T15:19:50.968 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 6/6 2022-08-05T15:19:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8 1/6 2022-08-05T15:19:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 2/6 2022-08-05T15:19:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8. 3/6 2022-08-05T15:19:50.969 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-08-05T15:19:50.970 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-08-05T15:19:51.004 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-08-05T15:19:51.171 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-08-05T15:19:51.322 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8. 4/6 2022-08-05T15:19:51.369 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-08-05T15:19:51.369 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:51.370 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:19:51.370 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:51.371 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:51.371 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:51.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-08-05T15:19:51.371 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-08-05T15:19:51.373 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2022-08-05T15:19:51.373 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:51.373 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:19:51.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-diskprediction-local 2022-08-05T15:19:51.700 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8 5/6 2022-08-05T15:19:51.935 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 6/6 2022-08-05T15:19:52.047 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:35 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:52.183 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 6/6 2022-08-05T15:19:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8 1/6 2022-08-05T15:19:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noar 2/6 2022-08-05T15:19:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8. 3/6 2022-08-05T15:19:52.184 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-08-05T15:19:52.185 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-08-05T15:19:52.581 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-08-05T15:19:52.581 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:52.582 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:19:52.582 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-grafana-dashboards-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:52.583 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-dashboard-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:52.583 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-prometheus-alerts-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:19:52.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-08-05T15:19:52.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-08-05T15:19:52.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-routes-2.4.1-12.el8.noarch 2022-08-05T15:19:52.584 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:52.585 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:19:52.709 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-diskprediction-local 2022-08-05T15:19:53.024 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:19:53.025 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-08-05T15:19:53.025 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:19:53.026 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-08-05T15:19:53.026 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:19:53.026 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 7.4 M 2022-08-05T15:19:53.026 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:19:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.5.0-15.el8 CentOS-BaseOS 644 k 2022-08-05T15:19:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.5.0-15.el8 CentOS-BaseOS 172 k 2022-08-05T15:19:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-08-05T15:19:53.027 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-08-05T15:19:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-08-05T15:19:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-08-05T15:19:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-08-05T15:19:53.028 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:53.029 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:19:53.029 INFO:teuthology.orchestra.run.smithi142.stdout:===================================================================================================== 2022-08-05T15:19:53.029 INFO:teuthology.orchestra.run.smithi142.stdout:Install 8 Packages 2022-08-05T15:19:53.030 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:19:53.031 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 35 M 2022-08-05T15:19:53.032 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 210 M 2022-08-05T15:19:53.032 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:19:53.279 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:36 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:19:53.841 INFO:teuthology.orchestra.run.smithi142.stdout:(1/8): openblas-0.3.15-3.el8.x86_64.rpm 5.8 MB/s | 4.7 MB 00:00 2022-08-05T15:19:53.973 INFO:teuthology.orchestra.run.smithi142.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 28 MB/s | 3.7 MB 00:00 2022-08-05T15:19:54.003 INFO:teuthology.orchestra.run.smithi142.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 8.7 MB/s | 225 kB 00:00 2022-08-05T15:19:54.274 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:19:54.277 INFO:teuthology.orchestra.run.smithi191.stdout:===================================================================================================== 2022-08-05T15:19:54.277 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:19:54.278 INFO:teuthology.orchestra.run.smithi191.stdout:===================================================================================================== 2022-08-05T15:19:54.278 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:19:54.279 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 7.4 M 2022-08-05T15:19:54.279 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:19:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran x86_64 8.5.0-15.el8 CentOS-BaseOS 644 k 2022-08-05T15:19:54.280 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath x86_64 8.5.0-15.el8 CentOS-BaseOS 172 k 2022-08-05T15:19:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-08-05T15:19:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-08-05T15:19:54.281 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-08-05T15:19:54.283 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-08-05T15:19:54.284 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-08-05T15:19:54.285 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:54.285 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:19:54.291 INFO:teuthology.orchestra.run.smithi191.stdout:===================================================================================================== 2022-08-05T15:19:54.291 INFO:teuthology.orchestra.run.smithi191.stdout:Install 8 Packages 2022-08-05T15:19:54.292 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:19:54.292 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 35 M 2022-08-05T15:19:54.292 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 210 M 2022-08-05T15:19:54.292 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:19:54.293 INFO:teuthology.orchestra.run.smithi142.stdout:(4/8): python3-scipy-1.0.0-21.module_el8.5.0+77 47 MB/s | 14 MB 00:00 2022-08-05T15:19:54.362 INFO:teuthology.orchestra.run.smithi142.stdout:(5/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 3.7 MB/s | 4.9 MB 00:01 2022-08-05T15:19:54.431 INFO:teuthology.orchestra.run.smithi142.stdout:(6/8): libgfortran-8.5.0-15.el8.x86_64.rpm 4.7 MB/s | 644 kB 00:00 2022-08-05T15:19:54.452 INFO:teuthology.orchestra.run.smithi142.stdout:(7/8): libquadmath-8.5.0-15.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2022-08-05T15:19:54.477 INFO:teuthology.orchestra.run.smithi191.stdout:(1/8): openblas-0.3.15-3.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2022-08-05T15:19:54.584 INFO:teuthology.orchestra.run.smithi191.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 35 MB/s | 3.7 MB 00:00 2022-08-05T15:19:54.651 INFO:teuthology.orchestra.run.smithi191.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 3.3 MB/s | 225 kB 00:00 2022-08-05T15:19:54.785 INFO:teuthology.orchestra.run.smithi191.stdout:(4/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 9.6 MB/s | 4.9 MB 00:00 2022-08-05T15:19:54.844 INFO:teuthology.orchestra.run.smithi191.stdout:(5/8): libgfortran-8.5.0-15.el8.x86_64.rpm 11 MB/s | 644 kB 00:00 2022-08-05T15:19:54.887 INFO:teuthology.orchestra.run.smithi191.stdout:(6/8): libquadmath-8.5.0-15.el8.x86_64.rpm 4.0 MB/s | 172 kB 00:00 2022-08-05T15:19:55.085 INFO:teuthology.orchestra.run.smithi191.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 32 MB/s | 14 MB 00:00 2022-08-05T15:19:57.617 INFO:teuthology.orchestra.run.smithi142.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-140 1.6 MB/s | 7.4 MB 00:04 2022-08-05T15:19:57.617 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:19:57.618 INFO:teuthology.orchestra.run.smithi142.stdout:Total 7.7 MB/s | 35 MB 00:04 2022-08-05T15:19:57.844 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:19:57.860 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:19:57.860 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:19:58.208 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:19:58.211 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:19:58.952 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:19:59.089 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.5.0-15.el8.x86_64 1/8 2022-08-05T15:19:59.255 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.5.0-15.el8.x86_64 1/8 2022-08-05T15:19:59.425 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.5.0-15.el8.x86_64 2/8 2022-08-05T15:20:00.026 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.5.0-15.el8.x86_64 2/8 2022-08-05T15:20:00.234 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:00.570 INFO:teuthology.orchestra.run.smithi191.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-140 1.2 MB/s | 7.4 MB 00:06 2022-08-05T15:20:00.573 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:00.574 INFO:teuthology.orchestra.run.smithi191.stdout:Total 5.6 MB/s | 35 MB 00:06 2022-08-05T15:20:00.811 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:00.825 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:00.826 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:00.874 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:01.106 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-08-05T15:20:01.194 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:01.195 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:01.720 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:01.774 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-08-05T15:20:01.839 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libquadmath-8.5.0-15.el8.x86_64 1/8 2022-08-05T15:20:02.002 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libquadmath-8.5.0-15.el8.x86_64 1/8 2022-08-05T15:20:02.114 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-08-05T15:20:02.148 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libgfortran-8.5.0-15.el8.x86_64 2/8 2022-08-05T15:20:02.364 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-08-05T15:20:02.745 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libgfortran-8.5.0-15.el8.x86_64 2/8 2022-08-05T15:20:02.930 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:03.555 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:03.757 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-08-05T15:20:04.112 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-08-05T15:20:04.456 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-08-05T15:20:04.751 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-08-05T15:20:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-08-05T15:20:05.898 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 8/8 2022-08-05T15:20:05.939 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-08-05T15:20:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 8/8 2022-08-05T15:20:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 1/8 2022-08-05T15:20:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-08-05T15:20:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-08-05T15:20:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-08-05T15:20:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-08-05T15:20:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.5.0-15.el8.x86_64 7/8 2022-08-05T15:20:06.575 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.5.0-15.el8.x86_64 8/8 2022-08-05T15:20:06.576 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:06.577 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:06.577 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.5.0-15.el8.x86_64 2022-08-05T15:20:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.5.0-15.el8.x86_64 2022-08-05T15:20:06.579 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.15-3.el8.x86_64 2022-08-05T15:20:06.580 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-08-05T15:20:06.580 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-08-05T15:20:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-08-05T15:20:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-08-05T15:20:06.585 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:06.586 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:06.678 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-rook 2022-08-05T15:20:07.255 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:50 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:07.681 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-08-05T15:20:08.232 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:08.234 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2022-08-05T15:20:08.234 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:20:08.234 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2022-08-05T15:20:08.235 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:08.235 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 47 k 2022-08-05T15:20:08.235 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:20:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-08-05T15:20:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-08-05T15:20:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-08-05T15:20:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-08-05T15:20:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-08-05T15:20:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-08-05T15:20:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-08-05T15:20:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-08-05T15:20:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-08-05T15:20:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-08-05T15:20:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-08-05T15:20:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-08-05T15:20:08.241 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:08.241 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:08.242 INFO:teuthology.orchestra.run.smithi142.stdout:========================================================================================= 2022-08-05T15:20:08.242 INFO:teuthology.orchestra.run.smithi142.stdout:Install 13 Packages 2022-08-05T15:20:08.243 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:08.245 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 1.9 M 2022-08-05T15:20:08.246 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 25 M 2022-08-05T15:20:08.246 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:08.316 INFO:teuthology.orchestra.run.smithi142.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 336 kB/s | 27 kB 00:00 2022-08-05T15:20:08.343 INFO:teuthology.orchestra.run.smithi142.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 192 kB/s | 20 kB 00:00 2022-08-05T15:20:08.367 INFO:teuthology.orchestra.run.smithi142.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.7 MB/s | 126 kB 00:00 2022-08-05T15:20:08.396 INFO:teuthology.orchestra.run.smithi142.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2022-08-05T15:20:08.451 INFO:teuthology.orchestra.run.smithi142.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.8 MB/s | 155 kB 00:00 2022-08-05T15:20:08.476 INFO:teuthology.orchestra.run.smithi142.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 513 kB/s | 43 kB 00:00 2022-08-05T15:20:08.593 INFO:teuthology.orchestra.run.smithi142.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 232 kB/s | 33 kB 00:00 2022-08-05T15:20:08.618 INFO:teuthology.orchestra.run.smithi142.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 115 kB/s | 16 kB 00:00 2022-08-05T15:20:08.685 INFO:teuthology.orchestra.run.smithi142.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 884 kB/s | 81 kB 00:00 2022-08-05T15:20:08.711 INFO:teuthology.orchestra.run.smithi142.stdout:(10/13): ceph-mgr-rook-17.0.0-14045.g4a7e6c4a.e 99 kB/s | 47 kB 00:00 2022-08-05T15:20:08.737 INFO:teuthology.orchestra.run.smithi142.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2022-08-05T15:20:08.844 INFO:teuthology.orchestra.run.smithi142.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 459 kB/s | 61 kB 00:00 2022-08-05T15:20:08.928 INFO:teuthology.orchestra.run.smithi142.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 3.8 MB/s | 1.2 MB 00:00 2022-08-05T15:20:08.930 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:08.931 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.8 MB/s | 1.9 MB 00:00 2022-08-05T15:20:08.939 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-08-05T15:20:08.982 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:08.998 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:08.999 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:09.072 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:09.075 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:09.200 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 8/8 2022-08-05T15:20:09.494 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 8/8 2022-08-05T15:20:09.495 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c 1/8 2022-08-05T15:20:09.495 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-08-05T15:20:09.496 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-08-05T15:20:09.497 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-08-05T15:20:09.497 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-08-05T15:20:09.498 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-08-05T15:20:09.498 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libgfortran-8.5.0-15.el8.x86_64 7/8 2022-08-05T15:20:09.848 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:09.911 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libquadmath-8.5.0-15.el8.x86_64 8/8 2022-08-05T15:20:09.912 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:09.912 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:09.912 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-diskprediction-local-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:09.913 INFO:teuthology.orchestra.run.smithi191.stdout: libgfortran-8.5.0-15.el8.x86_64 2022-08-05T15:20:09.913 INFO:teuthology.orchestra.run.smithi191.stdout: libquadmath-8.5.0-15.el8.x86_64 2022-08-05T15:20:09.913 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-0.3.15-3.el8.x86_64 2022-08-05T15:20:09.914 INFO:teuthology.orchestra.run.smithi191.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-08-05T15:20:09.915 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-08-05T15:20:09.915 INFO:teuthology.orchestra.run.smithi191.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-08-05T15:20:09.915 INFO:teuthology.orchestra.run.smithi191.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-08-05T15:20:09.915 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:09.916 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:10.013 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-rook 2022-08-05T15:20:10.064 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-08-05T15:20:10.272 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-08-05T15:20:10.548 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-08-05T15:20:10.586 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:01:53 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:10.786 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-08-05T15:20:11.027 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-08-05T15:20:11.284 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-08-05T15:20:11.541 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-08-05T15:20:11.572 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:11.573 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-08-05T15:20:11.573 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:20:11.574 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-08-05T15:20:11.574 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:11.575 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 47 k 2022-08-05T15:20:11.575 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:20:11.576 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-08-05T15:20:11.576 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-08-05T15:20:11.576 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-08-05T15:20:11.577 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-08-05T15:20:11.578 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-08-05T15:20:11.578 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-08-05T15:20:11.579 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-08-05T15:20:11.579 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-08-05T15:20:11.580 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-08-05T15:20:11.583 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-08-05T15:20:11.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-08-05T15:20:11.584 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-08-05T15:20:11.585 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:11.586 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:11.586 INFO:teuthology.orchestra.run.smithi191.stdout:========================================================================================= 2022-08-05T15:20:11.587 INFO:teuthology.orchestra.run.smithi191.stdout:Install 13 Packages 2022-08-05T15:20:11.587 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:11.589 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 1.9 M 2022-08-05T15:20:11.590 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 25 M 2022-08-05T15:20:11.591 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:11.653 INFO:teuthology.orchestra.run.smithi191.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 348 kB/s | 27 kB 00:00 2022-08-05T15:20:11.712 INFO:teuthology.orchestra.run.smithi191.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 148 kB/s | 20 kB 00:00 2022-08-05T15:20:11.727 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-08-05T15:20:11.736 INFO:teuthology.orchestra.run.smithi191.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2022-08-05T15:20:11.763 INFO:teuthology.orchestra.run.smithi191.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.2 MB/s | 110 kB 00:00 2022-08-05T15:20:11.788 INFO:teuthology.orchestra.run.smithi191.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.7 MB/s | 43 kB 00:00 2022-08-05T15:20:11.812 INFO:teuthology.orchestra.run.smithi191.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 2.0 MB/s | 155 kB 00:00 2022-08-05T15:20:11.920 INFO:teuthology.orchestra.run.smithi191.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 150 kB/s | 16 kB 00:00 2022-08-05T15:20:11.938 INFO:teuthology.orchestra.run.smithi191.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 219 kB/s | 33 kB 00:00 2022-08-05T15:20:11.971 INFO:teuthology.orchestra.run.smithi191.stdout:(9/13): ceph-mgr-rook-17.0.0-14045.g4a7e6c4a.el 119 kB/s | 47 kB 00:00 2022-08-05T15:20:12.030 INFO:teuthology.orchestra.run.smithi191.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 746 kB/s | 81 kB 00:00 2022-08-05T15:20:12.114 INFO:teuthology.orchestra.run.smithi191.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 735 kB/s | 61 kB 00:00 2022-08-05T15:20:12.131 INFO:teuthology.orchestra.run.smithi191.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 386 kB/s | 61 kB 00:00 2022-08-05T15:20:12.222 INFO:teuthology.orchestra.run.smithi191.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.1 MB/s | 1.2 MB 00:00 2022-08-05T15:20:12.224 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:12.225 INFO:teuthology.orchestra.run.smithi191.stdout:Total 3.0 MB/s | 1.9 MB 00:00 2022-08-05T15:20:12.280 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:12.290 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:12.291 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:12.363 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:12.366 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:12.763 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-08-05T15:20:12.870 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:13.037 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-08-05T15:20:13.122 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-08-05T15:20:13.235 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-08-05T15:20:13.351 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-08-05T15:20:13.470 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-08-05T15:20:13.590 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-08-05T15:20:13.661 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 13/13 2022-08-05T15:20:13.818 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-08-05T15:20:13.929 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 13/13 2022-08-05T15:20:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/13 2022-08-05T15:20:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-08-05T15:20:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-08-05T15:20:13.930 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-08-05T15:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-08-05T15:20:13.931 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-08-05T15:20:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-08-05T15:20:13.932 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-08-05T15:20:13.934 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-08-05T15:20:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-08-05T15:20:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-08-05T15:20:13.935 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-08-05T15:20:14.034 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-08-05T15:20:14.289 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-08-05T15:20:14.372 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-08-05T15:20:14.372 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:14.372 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:14.373 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:14.373 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-08-05T15:20:14.373 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-08-05T15:20:14.373 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-08-05T15:20:14.374 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-08-05T15:20:14.374 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-08-05T15:20:14.374 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-08-05T15:20:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-08-05T15:20:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-08-05T15:20:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-08-05T15:20:14.375 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-08-05T15:20:14.376 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.8-1.el8.noarch 2022-08-05T15:20:14.376 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-08-05T15:20:14.376 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:14.377 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:14.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-mgr-cephadm 2022-08-05T15:20:14.530 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-08-05T15:20:14.765 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-08-05T15:20:15.056 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:58 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:15.844 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-08-05T15:20:16.048 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:16.048 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:16.049 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:20:16.049 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:16.050 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:16.051 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 113 k 2022-08-05T15:20:16.051 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:20:16.052 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-08-05T15:20:16.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-08-05T15:20:16.055 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-08-05T15:20:16.056 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-08-05T15:20:16.056 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:16.056 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:16.057 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:16.057 INFO:teuthology.orchestra.run.smithi142.stdout:Install 5 Packages 2022-08-05T15:20:16.058 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:16.058 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 5.9 M 2022-08-05T15:20:16.059 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 26 M 2022-08-05T15:20:16.059 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:16.169 INFO:teuthology.orchestra.run.smithi142.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.6 MB/s | 538 kB 00:00 2022-08-05T15:20:16.261 INFO:teuthology.orchestra.run.smithi142.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2022-08-05T15:20:16.359 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-08-05T15:20:16.461 INFO:teuthology.orchestra.run.smithi142.stdout:(3/5): python3-natsort-7.1.1-2.el8.noarch.rpm 301 kB/s | 60 kB 00:00 2022-08-05T15:20:16.486 INFO:teuthology.orchestra.run.smithi142.stdout:(4/5): ceph-mgr-cephadm-17.0.0-14045.g4a7e6c4a. 259 kB/s | 113 kB 00:00 2022-08-05T15:20:16.519 INFO:teuthology.orchestra.run.smithi142.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.2 MB/s | 476 kB 00:00 2022-08-05T15:20:16.522 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:16.522 INFO:teuthology.orchestra.run.smithi142.stdout:Total 13 MB/s | 5.9 MB 00:00 2022-08-05T15:20:16.543 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-08-05T15:20:16.579 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:16.583 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:16.584 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:16.697 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:16.779 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-08-05T15:20:16.944 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 13/13 2022-08-05T15:20:16.945 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:17.237 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 13/13 2022-08-05T15:20:17.237 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/13 2022-08-05T15:20:17.257 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-08-05T15:20:17.258 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-08-05T15:20:17.258 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-08-05T15:20:17.259 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-08-05T15:20:17.259 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-08-05T15:20:17.259 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-08-05T15:20:17.260 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-08-05T15:20:17.260 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-08-05T15:20:17.278 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-08-05T15:20:17.279 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-08-05T15:20:17.279 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-08-05T15:20:17.298 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2022-08-05T15:20:17.688 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-08-05T15:20:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:17.713 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:17.713 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-rook-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:17.714 INFO:teuthology.orchestra.run.smithi191.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-08-05T15:20:17.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-08-05T15:20:17.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-08-05T15:20:17.715 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-08-05T15:20:17.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-08-05T15:20:17.716 INFO:teuthology.orchestra.run.smithi191.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-08-05T15:20:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-08-05T15:20:17.717 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-08-05T15:20:17.724 INFO:teuthology.orchestra.run.smithi191.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-08-05T15:20:17.725 INFO:teuthology.orchestra.run.smithi191.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-08-05T15:20:17.726 INFO:teuthology.orchestra.run.smithi191.stdout: python3-rsa-4.8-1.el8.noarch 2022-08-05T15:20:17.726 INFO:teuthology.orchestra.run.smithi191.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-08-05T15:20:17.727 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:17.727 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:17.780 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-mgr-cephadm 2022-08-05T15:20:18.250 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2022-08-05T15:20:18.356 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:01 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:18.672 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2022-08-05T15:20:18.920 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2022-08-05T15:20:19.138 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 5/5 2022-08-05T15:20:19.347 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:19.348 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:19.349 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:20:19.349 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:19.349 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:19.350 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 113 k 2022-08-05T15:20:19.350 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:20:19.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-08-05T15:20:19.351 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-08-05T15:20:19.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-08-05T15:20:19.352 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-08-05T15:20:19.353 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:19.353 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:19.354 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:19.354 INFO:teuthology.orchestra.run.smithi191.stdout:Install 5 Packages 2022-08-05T15:20:19.355 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:19.355 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 5.9 M 2022-08-05T15:20:19.356 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 26 M 2022-08-05T15:20:19.356 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:19.387 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 5/5 2022-08-05T15:20:19.388 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/5 2022-08-05T15:20:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2022-08-05T15:20:19.389 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2022-08-05T15:20:19.390 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2022-08-05T15:20:19.457 INFO:teuthology.orchestra.run.smithi191.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 4.7 MB/s | 538 kB 00:00 2022-08-05T15:20:19.576 INFO:teuthology.orchestra.run.smithi191.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2022-08-05T15:20:19.635 INFO:teuthology.orchestra.run.smithi191.stdout:(3/5): ceph-mgr-cephadm-17.0.0-14045.g4a7e6c4a. 389 kB/s | 113 kB 00:00 2022-08-05T15:20:19.734 INFO:teuthology.orchestra.run.smithi191.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.7 MB/s | 476 kB 00:00 2022-08-05T15:20:19.748 INFO:teuthology.orchestra.run.smithi191.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 339 kB/s | 60 kB 00:00 2022-08-05T15:20:19.750 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:19.751 INFO:teuthology.orchestra.run.smithi191.stdout:Total 14 MB/s | 5.9 MB 00:00 2022-08-05T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2022-08-05T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:19.792 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-08-05T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-7.el8.noarch 2022-08-05T15:20:19.793 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-08-05T15:20:19.797 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-08-05T15:20:19.798 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:19.798 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:19.800 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:19.810 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:19.811 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:19.902 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:19.905 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:19.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-fuse 2022-08-05T15:20:20.149 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:20.500 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:03 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:20.509 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2022-08-05T15:20:21.471 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2022-08-05T15:20:21.487 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:21.489 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:21.490 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:20:21.490 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:21.491 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:21.491 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 843 k 2022-08-05T15:20:21.492 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2022-08-05T15:20:21.492 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-08-05T15:20:21.493 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:21.494 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:21.495 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:21.495 INFO:teuthology.orchestra.run.smithi142.stdout:Install 2 Packages 2022-08-05T15:20:21.496 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:21.496 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 926 k 2022-08-05T15:20:21.497 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 2.9 M 2022-08-05T15:20:21.497 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:21.553 INFO:teuthology.orchestra.run.smithi142.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2022-08-05T15:20:21.943 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2022-08-05T15:20:21.967 INFO:teuthology.orchestra.run.smithi142.stdout:(2/2): ceph-fuse-17.0.0-14045.g4a7e6c4a.el8.x86 1.7 MB/s | 843 kB 00:00 2022-08-05T15:20:21.968 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:21.968 INFO:teuthology.orchestra.run.smithi142.stdout:Total 1.9 MB/s | 926 kB 00:00 2022-08-05T15:20:21.975 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:21.993 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:21.994 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:22.066 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:22.072 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:22.187 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2022-08-05T15:20:22.255 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:22.411 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 5/5 2022-08-05T15:20:22.585 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2022-08-05T15:20:22.645 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 5/5 2022-08-05T15:20:22.646 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/5 2022-08-05T15:20:22.647 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2022-08-05T15:20:22.647 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2022-08-05T15:20:22.648 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2022-08-05T15:20:22.827 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/2 2022-08-05T15:20:23.037 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2022-08-05T15:20:23.037 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:23.038 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:23.038 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-mgr-cephadm-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:23.039 INFO:teuthology.orchestra.run.smithi191.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-08-05T15:20:23.039 INFO:teuthology.orchestra.run.smithi191.stdout: python3-babel-2.5.1-7.el8.noarch 2022-08-05T15:20:23.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-08-05T15:20:23.040 INFO:teuthology.orchestra.run.smithi191.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-08-05T15:20:23.040 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:23.041 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:23.164 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-fuse 2022-08-05T15:20:23.181 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/2 2022-08-05T15:20:23.182 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/2 2022-08-05T15:20:23.561 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2022-08-05T15:20:23.561 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:23.562 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:23.562 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2022-08-05T15:20:23.563 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:23.563 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:23.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-volume 2022-08-05T15:20:23.755 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:06 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:24.331 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:07 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:24.760 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:24.760 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:24.770 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:20:24.770 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:24.771 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:24.771 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 843 k 2022-08-05T15:20:24.772 INFO:teuthology.orchestra.run.smithi191.stdout:Installing dependencies: 2022-08-05T15:20:24.774 INFO:teuthology.orchestra.run.smithi191.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-08-05T15:20:24.774 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:24.775 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:24.775 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:24.776 INFO:teuthology.orchestra.run.smithi191.stdout:Install 2 Packages 2022-08-05T15:20:24.776 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:24.776 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 926 k 2022-08-05T15:20:24.777 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 2.9 M 2022-08-05T15:20:24.777 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:24.827 INFO:teuthology.orchestra.run.smithi191.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2022-08-05T15:20:25.328 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:25.329 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:25.329 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2022-08-05T15:20:25.330 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:25.330 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:25.331 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 262 k 2022-08-05T15:20:25.339 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:25.339 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:25.340 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:25.340 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:25.341 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 262 k 2022-08-05T15:20:25.341 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 1.3 M 2022-08-05T15:20:25.343 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:25.421 INFO:teuthology.orchestra.run.smithi191.stdout:(2/2): ceph-fuse-17.0.0-14045.g4a7e6c4a.el8.x86 1.2 MB/s | 843 kB 00:00 2022-08-05T15:20:25.422 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:25.423 INFO:teuthology.orchestra.run.smithi191.stdout:Total 1.4 MB/s | 926 kB 00:00 2022-08-05T15:20:25.436 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:25.453 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:25.453 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:25.529 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:25.547 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:25.607 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-volume-17.0.0-14045.g4a7e6c4a.el8.noarch.r 943 kB/s | 262 kB 00:00 2022-08-05T15:20:25.608 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:25.608 INFO:teuthology.orchestra.run.smithi142.stdout:Total 938 kB/s | 262 kB 00:00 2022-08-05T15:20:25.609 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:25.628 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:25.629 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:25.651 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:25.651 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:25.686 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:25.851 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:26.042 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2022-08-05T15:20:26.121 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:26.251 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/2 2022-08-05T15:20:26.511 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:26.647 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2/2 2022-08-05T15:20:26.647 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/2 2022-08-05T15:20:26.895 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:26.896 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:26.896 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:26.897 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:26.898 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:26.898 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:27.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados-devel 2022-08-05T15:20:27.269 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2022-08-05T15:20:27.276 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:27.276 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2022-08-05T15:20:27.277 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:27.277 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:27.465 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install ceph-volume 2022-08-05T15:20:27.661 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:10 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:28.044 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:11 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:28.653 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:28.653 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:28.654 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2022-08-05T15:20:28.654 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:28.655 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:28.655 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 139 k 2022-08-05T15:20:28.655 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:28.656 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:28.657 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:28.657 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:28.658 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:28.658 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 139 k 2022-08-05T15:20:28.659 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 511 k 2022-08-05T15:20:28.659 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:29.026 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:29.027 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:29.028 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repository Size 2022-08-05T15:20:29.028 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:29.029 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:29.029 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume noarch 2:17.0.0-14045.g4a7e6c4a.el8 ceph-noarch 262 k 2022-08-05T15:20:29.029 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:29.030 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:29.030 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:29.031 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:29.031 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:29.033 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 262 k 2022-08-05T15:20:29.033 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 1.3 M 2022-08-05T15:20:29.034 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:29.059 INFO:teuthology.orchestra.run.smithi142.stdout:librados-devel-17.0.0-14045.g4a7e6c4a.el8.x86_6 332 kB/s | 139 kB 00:00 2022-08-05T15:20:29.061 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:29.061 INFO:teuthology.orchestra.run.smithi142.stdout:Total 331 kB/s | 139 kB 00:00 2022-08-05T15:20:29.062 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:29.075 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:29.076 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:29.116 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:29.118 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:29.250 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:29.424 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:29.563 INFO:teuthology.orchestra.run.smithi191.stdout:ceph-volume-17.0.0-14045.g4a7e6c4a.el8.noarch.r 491 kB/s | 262 kB 00:00 2022-08-05T15:20:29.564 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:29.564 INFO:teuthology.orchestra.run.smithi191.stdout:Total 490 kB/s | 262 kB 00:00 2022-08-05T15:20:29.565 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:29.574 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:29.574 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:29.595 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:29.595 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:29.712 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:29.808 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:30.071 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:30.156 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:30.158 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:30.160 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:30.170 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:30.171 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:30.172 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:30.381 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs2 2022-08-05T15:20:30.435 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:30.862 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 1/1 2022-08-05T15:20:30.863 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:30.863 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:30.864 INFO:teuthology.orchestra.run.smithi191.stdout: ceph-volume-2:17.0.0-14045.g4a7e6c4a.el8.noarch 2022-08-05T15:20:30.864 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:30.865 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:30.970 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:13 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:31.052 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados-devel 2022-08-05T15:20:31.625 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:14 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:31.841 INFO:teuthology.orchestra.run.smithi142.stdout:Package libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:31.905 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:31.906 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:31.907 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:31.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install libcephfs-devel 2022-08-05T15:20:32.558 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:15 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:32.610 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:32.611 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:32.611 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2022-08-05T15:20:32.612 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:32.612 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:32.613 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 139 k 2022-08-05T15:20:32.613 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:32.613 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:32.614 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:32.614 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:32.615 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:32.615 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 139 k 2022-08-05T15:20:32.615 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 511 k 2022-08-05T15:20:32.616 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:32.815 INFO:teuthology.orchestra.run.smithi191.stdout:librados-devel-17.0.0-14045.g4a7e6c4a.el8.x86_6 674 kB/s | 139 kB 00:00 2022-08-05T15:20:32.816 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:32.816 INFO:teuthology.orchestra.run.smithi191.stdout:Total 670 kB/s | 139 kB 00:00 2022-08-05T15:20:32.817 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:32.834 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:32.835 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:32.869 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:32.872 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:33.015 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:33.198 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:33.456 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:33.547 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:33.547 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:33.548 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2022-08-05T15:20:33.548 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:33.548 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 30 k 2022-08-05T15:20:33.549 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:33.549 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:33.550 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:33.550 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:33.551 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:33.551 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 30 k 2022-08-05T15:20:33.552 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 136 k 2022-08-05T15:20:33.552 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:33.720 INFO:teuthology.orchestra.run.smithi142.stdout:libcephfs-devel-17.0.0-14045.g4a7e6c4a.el8.x86_ 181 kB/s | 30 kB 00:00 2022-08-05T15:20:33.720 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:33.721 INFO:teuthology.orchestra.run.smithi142.stdout:Total 180 kB/s | 30 kB 00:00 2022-08-05T15:20:33.721 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:33.722 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:33.722 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:33.738 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:33.741 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:33.801 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:33.882 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:33.883 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:33.884 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:33.884 INFO:teuthology.orchestra.run.smithi191.stdout: librados-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:33.884 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:33.885 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:34.007 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:34.088 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs2 2022-08-05T15:20:34.227 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:34.574 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:34.575 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:34.575 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:34.576 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:34.576 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:34.667 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:17 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:34.697 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librados2 2022-08-05T15:20:35.273 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:18 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:35.595 INFO:teuthology.orchestra.run.smithi191.stdout:Package libcephfs2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:35.662 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:35.663 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:35.663 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:35.743 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install libcephfs-devel 2022-08-05T15:20:36.200 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:36.277 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:36.278 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:36.354 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:19 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:36.362 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install librbd1 2022-08-05T15:20:36.938 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:19 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:37.331 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:37.332 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:37.332 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2022-08-05T15:20:37.332 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:37.332 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:37.333 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 30 k 2022-08-05T15:20:37.333 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:37.333 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:37.334 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:37.334 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:37.334 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:37.335 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 30 k 2022-08-05T15:20:37.336 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 136 k 2022-08-05T15:20:37.336 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:37.495 INFO:teuthology.orchestra.run.smithi191.stdout:libcephfs-devel-17.0.0-14045.g4a7e6c4a.el8.x86_ 188 kB/s | 30 kB 00:00 2022-08-05T15:20:37.495 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:37.499 INFO:teuthology.orchestra.run.smithi191.stdout:Total 187 kB/s | 30 kB 00:00 2022-08-05T15:20:37.500 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:37.500 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:37.501 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:37.529 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:37.532 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:37.590 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:37.813 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:37.875 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:37.949 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:37.962 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:37.963 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:38.022 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:38.063 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rados 2022-08-05T15:20:38.640 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:21 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:39.035 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:39.035 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:39.036 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:39.036 INFO:teuthology.orchestra.run.smithi191.stdout: libcephfs-devel-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:39.036 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:39.036 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:39.568 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:39.643 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:39.643 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:39.644 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:39.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rgw 2022-08-05T15:20:39.976 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librados2 2022-08-05T15:20:40.291 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:23 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:40.554 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:23 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:41.182 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:41.251 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:41.251 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:41.252 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:41.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-cephfs 2022-08-05T15:20:41.472 INFO:teuthology.orchestra.run.smithi191.stdout:Package librados2-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:41.541 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:41.543 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:41.543 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:41.632 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install librbd1 2022-08-05T15:20:41.914 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:24 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:42.201 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:25 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:42.843 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:42.912 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:42.921 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:42.922 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:43.113 INFO:teuthology.orchestra.run.smithi191.stdout:Package librbd1-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:43.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install python3-rbd 2022-08-05T15:20:43.190 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:43.191 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:43.191 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:43.288 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rados 2022-08-05T15:20:43.730 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:26 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:43.894 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:26 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:44.661 INFO:teuthology.orchestra.run.smithi142.stdout:Package python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:44.733 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:44.734 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2022-08-05T15:20:44.734 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:44.809 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rados-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:44.817 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-fuse 2022-08-05T15:20:44.879 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:44.880 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:44.880 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:44.970 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rgw 2022-08-05T15:20:45.387 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:28 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:45.649 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:28 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:46.366 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:46.367 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:46.367 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2022-08-05T15:20:46.367 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:46.369 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:46.369 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 94 k 2022-08-05T15:20:46.370 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:46.370 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:46.370 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:46.371 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:46.372 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:46.372 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 94 k 2022-08-05T15:20:46.372 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 276 k 2022-08-05T15:20:46.372 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:46.554 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rgw-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:46.563 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-fuse-17.0.0-14045.g4a7e6c4a.el8.x86_64.rpm 472 kB/s | 94 kB 00:00 2022-08-05T15:20:46.567 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:46.567 INFO:teuthology.orchestra.run.smithi142.stdout:Total 469 kB/s | 94 kB 00:00 2022-08-05T15:20:46.568 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:46.575 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:46.576 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:46.633 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:46.633 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:46.634 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:46.634 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:46.634 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:46.713 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-cephfs 2022-08-05T15:20:46.735 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:46.938 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:47.179 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:47.276 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:30 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:47.563 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:47.563 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:47.564 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:47.564 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:47.565 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:47.565 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:47.752 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-mirror 2022-08-05T15:20:48.170 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-cephfs-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:48.238 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:48.238 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:48.238 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:48.331 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install python3-rbd 2022-08-05T15:20:48.332 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:31 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:48.899 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:31 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:49.338 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:49.339 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:49.339 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repo Size 2022-08-05T15:20:49.340 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:49.340 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:49.340 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.5 M 2022-08-05T15:20:49.341 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:49.341 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:49.342 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:49.343 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:49.343 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:49.343 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 3.5 M 2022-08-05T15:20:49.344 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 16 M 2022-08-05T15:20:49.347 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:49.805 INFO:teuthology.orchestra.run.smithi191.stdout:Package python3-rbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 is already installed. 2022-08-05T15:20:49.874 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:49.876 INFO:teuthology.orchestra.run.smithi191.stdout:Nothing to do. 2022-08-05T15:20:49.876 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:49.964 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-fuse 2022-08-05T15:20:50.544 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:33 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:50.700 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-mirror-17.0.0-14045.g4a7e6c4a.el8.x86_64.rp 2.5 MB/s | 3.5 MB 00:01 2022-08-05T15:20:50.701 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:50.702 INFO:teuthology.orchestra.run.smithi142.stdout:Total 2.5 MB/s | 3.5 MB 00:01 2022-08-05T15:20:50.702 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:50.715 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:50.716 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:50.775 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:50.778 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:51.224 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:51.414 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:51.534 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:51.535 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:51.535 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2022-08-05T15:20:51.536 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:51.537 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:51.537 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 94 k 2022-08-05T15:20:51.538 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:51.538 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:51.538 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:51.539 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:51.539 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:51.540 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 94 k 2022-08-05T15:20:51.540 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 276 k 2022-08-05T15:20:51.541 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:51.799 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:52.080 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-fuse-17.0.0-14045.g4a7e6c4a.el8.x86_64.rpm 172 kB/s | 94 kB 00:00 2022-08-05T15:20:52.081 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:52.081 INFO:teuthology.orchestra.run.smithi191.stdout:Total 171 kB/s | 94 kB 00:00 2022-08-05T15:20:52.089 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:52.094 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:52.095 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:52.151 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:52.152 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:52.277 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:52.278 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:52.280 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:52.281 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:52.295 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:52.461 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:52.531 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install rbd-nbd 2022-08-05T15:20:52.726 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:53.137 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:36 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:53.147 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:53.148 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:53.149 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:53.149 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-fuse-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:53.154 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:53.155 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:53.356 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-mirror 2022-08-05T15:20:54.019 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:37 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:54.137 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2022-08-05T15:20:54.137 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:54.138 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2022-08-05T15:20:54.138 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:54.139 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2022-08-05T15:20:54.139 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 175 k 2022-08-05T15:20:54.139 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:54.140 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2022-08-05T15:20:54.140 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2022-08-05T15:20:54.140 INFO:teuthology.orchestra.run.smithi142.stdout:Install 1 Package 2022-08-05T15:20:54.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:54.141 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 175 k 2022-08-05T15:20:54.141 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 556 k 2022-08-05T15:20:54.143 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2022-08-05T15:20:54.318 INFO:teuthology.orchestra.run.smithi142.stdout:rbd-nbd-17.0.0-14045.g4a7e6c4a.el8.x86_64.rpm 888 kB/s | 175 kB 00:00 2022-08-05T15:20:54.319 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:54.319 INFO:teuthology.orchestra.run.smithi142.stdout:Total 882 kB/s | 175 kB 00:00 2022-08-05T15:20:54.320 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2022-08-05T15:20:54.320 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2022-08-05T15:20:54.321 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2022-08-05T15:20:54.373 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2022-08-05T15:20:54.373 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2022-08-05T15:20:54.477 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2022-08-05T15:20:54.700 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:54.951 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:55.007 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:55.008 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:55.008 INFO:teuthology.orchestra.run.smithi191.stdout: Package Arch Version Repo Size 2022-08-05T15:20:55.011 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:55.011 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:55.012 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 3.5 M 2022-08-05T15:20:55.012 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:55.012 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:55.013 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:55.014 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:55.014 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:55.035 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 3.5 M 2022-08-05T15:20:55.043 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 16 M 2022-08-05T15:20:55.043 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:55.352 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:55.353 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:55.353 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2022-08-05T15:20:55.353 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:55.354 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:20:55.354 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2022-08-05T15:20:55.499 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-mirror-17.0.0-14045.g4a7e6c4a.el8.x86_64.rp 7.0 MB/s | 3.5 MB 00:00 2022-08-05T15:20:55.500 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:55.500 INFO:teuthology.orchestra.run.smithi191.stdout:Total 7.0 MB/s | 3.5 MB 00:00 2022-08-05T15:20:55.501 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:55.513 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:55.514 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:55.577 DEBUG:teuthology.parallel:result is None 2022-08-05T15:20:55.591 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:55.592 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:56.020 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:56.505 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:56.879 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:57.271 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:57.275 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:57.276 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:20:57.276 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-mirror-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:20:57.277 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:57.277 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:20:57.437 DEBUG:teuthology.orchestra.run.smithi191:> sudo yum -y install rbd-nbd 2022-08-05T15:20:58.028 INFO:teuthology.orchestra.run.smithi191.stdout:Last metadata expiration check: 0:02:41 ago on Fri 05 Aug 2022 03:18:17 PM UTC. 2022-08-05T15:20:59.033 INFO:teuthology.orchestra.run.smithi191.stdout:Dependencies resolved. 2022-08-05T15:20:59.034 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:59.035 INFO:teuthology.orchestra.run.smithi191.stdout: Package Architecture Version Repository Size 2022-08-05T15:20:59.037 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:59.038 INFO:teuthology.orchestra.run.smithi191.stdout:Installing: 2022-08-05T15:20:59.039 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd x86_64 2:17.0.0-14045.g4a7e6c4a.el8 ceph 175 k 2022-08-05T15:20:59.039 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:59.040 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction Summary 2022-08-05T15:20:59.041 INFO:teuthology.orchestra.run.smithi191.stdout:================================================================================ 2022-08-05T15:20:59.041 INFO:teuthology.orchestra.run.smithi191.stdout:Install 1 Package 2022-08-05T15:20:59.042 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:20:59.042 INFO:teuthology.orchestra.run.smithi191.stdout:Total download size: 175 k 2022-08-05T15:20:59.043 INFO:teuthology.orchestra.run.smithi191.stdout:Installed size: 556 k 2022-08-05T15:20:59.044 INFO:teuthology.orchestra.run.smithi191.stdout:Downloading Packages: 2022-08-05T15:20:59.234 INFO:teuthology.orchestra.run.smithi191.stdout:rbd-nbd-17.0.0-14045.g4a7e6c4a.el8.x86_64.rpm 871 kB/s | 175 kB 00:00 2022-08-05T15:20:59.235 INFO:teuthology.orchestra.run.smithi191.stdout:-------------------------------------------------------------------------------- 2022-08-05T15:20:59.236 INFO:teuthology.orchestra.run.smithi191.stdout:Total 866 kB/s | 175 kB 00:00 2022-08-05T15:20:59.236 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction check 2022-08-05T15:20:59.245 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction check succeeded. 2022-08-05T15:20:59.261 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction test 2022-08-05T15:20:59.297 INFO:teuthology.orchestra.run.smithi191.stdout:Transaction test succeeded. 2022-08-05T15:20:59.301 INFO:teuthology.orchestra.run.smithi191.stdout:Running transaction 2022-08-05T15:20:59.413 INFO:teuthology.orchestra.run.smithi191.stdout: Preparing : 1/1 2022-08-05T15:20:59.615 INFO:teuthology.orchestra.run.smithi191.stdout: Installing : rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:20:59.871 INFO:teuthology.orchestra.run.smithi191.stdout: Running scriptlet: rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:21:00.255 INFO:teuthology.orchestra.run.smithi191.stdout: Verifying : rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 1/1 2022-08-05T15:21:00.255 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:00.256 INFO:teuthology.orchestra.run.smithi191.stdout:Installed: 2022-08-05T15:21:00.256 INFO:teuthology.orchestra.run.smithi191.stdout: rbd-nbd-2:17.0.0-14045.g4a7e6c4a.el8.x86_64 2022-08-05T15:21:00.257 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:00.257 INFO:teuthology.orchestra.run.smithi191.stdout:Complete! 2022-08-05T15:21:00.496 DEBUG:teuthology.parallel:result is None 2022-08-05T15:21:00.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-08-05T15:21:00.599 INFO:teuthology.orchestra.run.smithi142.stdout:CentOSStream 2022-08-05T15:21:00.607 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:21:00.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:21:00.852 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-08-05T15:21:00.893 INFO:teuthology.orchestra.run.smithi142.stdout:17.0.0-14045.g4a7e6c4a.el8 2022-08-05T15:21:00.894 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14045.g4a7e6c4a.el8 2022-08-05T15:21:00.895 INFO:teuthology.task.install:The correct ceph version 17.0.0-14045.g4a7e6c4a is installed. 2022-08-05T15:21:00.910 DEBUG:teuthology.orchestra.run.smithi191:> sudo lsb_release -is 2022-08-05T15:21:00.954 INFO:teuthology.orchestra.run.smithi191.stdout:CentOSStream 2022-08-05T15:21:00.954 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:21:00.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:21:01.156 DEBUG:teuthology.orchestra.run.smithi191:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-08-05T15:21:01.202 INFO:teuthology.orchestra.run.smithi191.stdout:17.0.0-14045.g4a7e6c4a.el8 2022-08-05T15:21:01.203 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14045.g4a7e6c4a.el8 2022-08-05T15:21:01.204 INFO:teuthology.task.install:The correct ceph version 17.0.0-14045.g4a7e6c4a is installed. 2022-08-05T15:21:01.205 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-08-05T15:21:01.206 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:01.207 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-08-05T15:21:01.238 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:01.239 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-08-05T15:21:01.287 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-08-05T15:21:01.288 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:01.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2022-08-05T15:21:01.340 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-08-05T15:21:01.412 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:01.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/daemon-helper 2022-08-05T15:21:01.450 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-08-05T15:21:01.526 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-08-05T15:21:01.528 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:01.529 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2022-08-05T15:21:01.575 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-08-05T15:21:01.634 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:01.635 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/usr/bin/adjust-ulimits 2022-08-05T15:21:01.684 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-08-05T15:21:01.759 INFO:teuthology.run_tasks:Running task ceph... 2022-08-05T15:21:01.969 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-08-05T15:21:01.970 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /var/log/ceph 2022-08-05T15:21:01.999 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 777 /var/log/ceph 2022-08-05T15:21:02.031 INFO:tasks.ceph:Disabling ceph logrotate... 2022-08-05T15:21:02.032 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/logrotate.d/ceph 2022-08-05T15:21:02.057 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/logrotate.d/ceph 2022-08-05T15:21:02.108 INFO:tasks.ceph:Creating extra log directories... 2022-08-05T15:21:02.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-08-05T15:21:02.149 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-08-05T15:21:02.221 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-08-05T15:21:02.222 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-08-05T15:21:02.222 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398', 'branch': 'wip-yuri4-testing-2022-08-04-1413', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6959398', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2022-08-04-1413'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2022-08-04-1413', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2022-08-04-1413', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'targets': {'smithi142.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0G51TIUs1Te9w/irRkV++8fsy+oO4Sq/MxBYMUjgVlw/k8zOFoebRUmfs18Cvg1hXm5fdG4P239ymHW9TgMxtgEHXKjJx2rfRtH7kbfl18oWXFm8rXnYpFkmV92F56oCo6O1BcEy1Bm8EU3YwXJHYZcmSfk0sHbu68GORquDIMgBuOgy96VuZtUimTWS3nq4dH+Kqq9EhBLb9PYH477ocMAvpm9o7UZ4w50pOxLJjXfGJh/xmYapt8qJoB1Yz4zeXfwQHTxIUg6rkYwyKtBeEjVK3JtdN+Jar7Gl55LIkiWGegbX+7tOGfaeorYXJ/FkCG2Ap7G/BBmQRvpH39yAufYqOBq7BTWuSVNDX1CsY9CtWG8Nzlw9eQoMtvALG89aGQ7zCfhWSY5rxYTKqUIPKDT2oMFrnWcd7lPNX7c0sKRvLU0LV9grcyepsxcjwaS7Ovns0sr3JU3J/YHb25aQPRLKpR0I093OF+yKxjTr8auZ4Q7JnIQaGb6JJ8LaxPFU=', 'smithi191.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrx/AZ06i0m8z/Mh93OCPegr7IIVhRZm8FId+cwwnHHGJjB84Zn8z0gASxKMl4S84PiQnffagUDI4U0Xn1a5Ze2lCpOTBKDfJS8BVDljL/G7+Fherz1nOKUUWYDPLUMS7H0IFnvnZEiImq5NXxIafz/RJiSqZXIxY6tOmTNVu1kR5eW4WeSfC21G6yZSw/EwGfzgPtFtzreUtQvXa29PNzIV3IW+I7/ndsS3n6N3cLwovgbiO2uCW9tf+k3PrOjnSzQwZqCugj7079wGMM9Q2VrRM/Hd3w0jmAToRZbaZLm0h0H3u3ahtOehJoi3LivSZSWi3m4RJ8/owm4o4Z0GnYyigQBskXiiNDKXyfaqFTW7U4Gj8qodbK0ulmrTqAkiCfxThmeWoCnUeV/HazSYimmliwSsf8Tkb8AK+mtSMD9h+2fwBUeUXylGUl2+jvCNoPZKt2BPD/ERkJW5YFoMkfSGinMPebF+cy9iEGJwf0wa20EmAT6tu+LOgjzL5BIQc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'must scrub before tier agent can activate'], 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53', 'timestamp': '2022-08-05_14:49:51', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1713'} 2022-08-05T15:21:02.224 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-08-05T15:21:02.237 DEBUG:teuthology.orchestra.run.smithi191:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-08-05T15:21:02.261 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m0777 -- /var/run/ceph 2022-08-05T15:21:02.297 DEBUG:teuthology.orchestra.run.smithi191:> sudo install -d -m0777 -- /var/run/ceph 2022-08-05T15:21:02.340 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:02.341 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2022-08-05T15:21:02.386 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-08-05T15:21:02.388 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-08-05T15:21:02.450 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-08-05T15:21:02.451 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.451 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 398833 Links: 1 2022-08-05T15:21:02.451 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.452 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.452 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-08-05 15:20:51.588070341 +0000 2022-08-05T15:21:02.453 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-08-05 15:17:22.479432042 +0000 2022-08-05T15:21:02.453 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-08-05 15:17:22.479432042 +0000 2022-08-05T15:21:02.459 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-08-05T15:21:02.461 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-08-05T15:21:02.461 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-08-05T15:21:02.462 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000227199 s, 2.3 MB/s 2022-08-05T15:21:02.462 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-08-05T15:21:02.540 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-08-05T15:21:02.540 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.541 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 398932 Links: 1 2022-08-05T15:21:02.541 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.548 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.549 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-08-05 15:20:51.588070341 +0000 2022-08-05T15:21:02.549 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-08-05 15:17:23.107420429 +0000 2022-08-05T15:21:02.550 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-08-05 15:17:23.107420429 +0000 2022-08-05T15:21:02.550 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-08-05T15:21:02.561 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-08-05T15:21:02.579 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-08-05T15:21:02.579 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000194481 s, 2.6 MB/s 2022-08-05T15:21:02.580 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-08-05T15:21:02.634 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-08-05T15:21:02.650 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.650 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 399005 Links: 1 2022-08-05T15:21:02.651 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.651 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.652 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-08-05 15:20:51.588070341 +0000 2022-08-05T15:21:02.652 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-08-05 15:17:23.698409501 +0000 2022-08-05T15:21:02.652 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-08-05 15:17:23.698409501 +0000 2022-08-05T15:21:02.653 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-08-05T15:21:02.659 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-08-05T15:21:02.660 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-08-05T15:21:02.661 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.00018681 s, 2.7 MB/s 2022-08-05T15:21:02.661 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-08-05T15:21:02.766 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-08-05T15:21:02.766 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.767 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 6h/6d Inode: 405111 Links: 1 2022-08-05T15:21:02.767 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.768 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.768 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2022-08-05 15:20:51.588070341 +0000 2022-08-05T15:21:02.768 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2022-08-05 15:17:24.344397556 +0000 2022-08-05T15:21:02.769 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2022-08-05 15:17:24.344397556 +0000 2022-08-05T15:21:02.769 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: - 2022-08-05T15:21:02.772 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2022-08-05T15:21:02.773 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2022-08-05T15:21:02.773 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000200378 s, 2.6 MB/s 2022-08-05T15:21:02.774 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:02.778 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:02.779 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/scratch_devs of=/dev/stdout 2022-08-05T15:21:02.804 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-08-05T15:21:02.805 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-08-05T15:21:02.870 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-08-05T15:21:02.871 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.871 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 402449 Links: 1 2022-08-05T15:21:02.872 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.872 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.873 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-08-05 15:20:56.662135865 +0000 2022-08-05T15:21:02.873 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-08-05 15:17:21.701035366 +0000 2022-08-05T15:21:02.879 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-08-05 15:17:21.701035366 +0000 2022-08-05T15:21:02.879 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-08-05T15:21:02.882 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-08-05T15:21:02.883 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-08-05T15:21:02.883 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000207353 s, 2.5 MB/s 2022-08-05T15:21:02.884 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-08-05T15:21:02.974 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-08-05T15:21:02.975 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:02.975 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 401780 Links: 1 2022-08-05T15:21:02.976 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:02.977 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:02.978 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-08-05 15:20:56.662135865 +0000 2022-08-05T15:21:02.979 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-08-05 15:17:22.285025673 +0000 2022-08-05T15:21:02.979 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-08-05 15:17:22.285025673 +0000 2022-08-05T15:21:02.979 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-08-05T15:21:02.982 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-08-05T15:21:02.982 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-08-05T15:21:02.983 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000191006 s, 2.7 MB/s 2022-08-05T15:21:02.983 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-08-05T15:21:03.043 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-08-05T15:21:03.044 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:03.044 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 398984 Links: 1 2022-08-05T15:21:03.045 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:03.045 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:03.046 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-08-05 15:20:56.662135865 +0000 2022-08-05T15:21:03.046 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-08-05 15:17:22.858016162 +0000 2022-08-05T15:21:03.046 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-08-05 15:17:22.858016162 +0000 2022-08-05T15:21:03.046 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-08-05T15:21:03.055 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-08-05T15:21:03.056 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-08-05T15:21:03.056 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000197199 s, 2.6 MB/s 2022-08-05T15:21:03.056 DEBUG:teuthology.orchestra.run.smithi191:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-08-05T15:21:03.120 INFO:teuthology.orchestra.run.smithi191.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-08-05T15:21:03.121 INFO:teuthology.orchestra.run.smithi191.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:21:03.122 INFO:teuthology.orchestra.run.smithi191.stdout:Device: 6h/6d Inode: 397195 Links: 1 2022-08-05T15:21:03.122 INFO:teuthology.orchestra.run.smithi191.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:21:03.122 INFO:teuthology.orchestra.run.smithi191.stdout:Context: system_u:object_r:device_t:s0 2022-08-05T15:21:03.124 INFO:teuthology.orchestra.run.smithi191.stdout:Access: 2022-08-05 15:20:56.662135865 +0000 2022-08-05T15:21:03.124 INFO:teuthology.orchestra.run.smithi191.stdout:Modify: 2022-08-05 15:17:23.445006418 +0000 2022-08-05T15:21:03.124 INFO:teuthology.orchestra.run.smithi191.stdout:Change: 2022-08-05 15:17:23.445006418 +0000 2022-08-05T15:21:03.125 INFO:teuthology.orchestra.run.smithi191.stdout: Birth: - 2022-08-05T15:21:03.131 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records in 2022-08-05T15:21:03.131 INFO:teuthology.orchestra.run.smithi191.stderr:1+0 records out 2022-08-05T15:21:03.131 INFO:teuthology.orchestra.run.smithi191.stderr:512 bytes copied, 0.000216076 s, 2.4 MB/s 2022-08-05T15:21:03.133 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:03.133 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-08-05T15:21:03.134 INFO:tasks.ceph:Generating config... 2022-08-05T15:21:03.136 INFO:tasks.ceph:[osd] debug monc = 20 2022-08-05T15:21:03.137 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-08-05T15:21:03.137 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2022-08-05T15:21:03.137 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2022-08-05T15:21:03.141 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-08-05T15:21:03.142 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2022-08-05T15:21:03.142 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-08-05T15:21:03.142 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-08-05T15:21:03.143 INFO:tasks.ceph:[osd] debug ms = 1 2022-08-05T15:21:03.143 INFO:tasks.ceph:[osd] debug osd = 20 2022-08-05T15:21:03.143 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-08-05T15:21:03.144 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-08-05T15:21:03.144 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-08-05T15:21:03.144 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-08-05T15:21:03.145 INFO:tasks.ceph:[osd] osd backoff on peering = True 2022-08-05T15:21:03.145 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2022-08-05T15:21:03.145 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2022-08-05T15:21:03.146 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2022-08-05T15:21:03.146 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-08-05T15:21:03.146 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2022-08-05T15:21:03.147 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2022-08-05T15:21:03.147 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2022-08-05T15:21:03.148 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-08-05T15:21:03.151 INFO:tasks.ceph:[osd] osd op queue = debug_random 2022-08-05T15:21:03.159 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2022-08-05T15:21:03.159 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2022-08-05T15:21:03.168 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2022-08-05T15:21:03.169 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2022-08-05T15:21:03.170 INFO:tasks.ceph:[global] mon client directed command retry = 5 2022-08-05T15:21:03.170 INFO:tasks.ceph:[global] mon election default strategy = 1 2022-08-05T15:21:03.170 INFO:tasks.ceph:[global] ms bind msgr1 = False 2022-08-05T15:21:03.171 INFO:tasks.ceph:[global] ms bind msgr2 = True 2022-08-05T15:21:03.171 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2022-08-05T15:21:03.171 INFO:tasks.ceph:[global] ms type = async 2022-08-05T15:21:03.172 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2022-08-05T15:21:03.172 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2022-08-05T15:21:03.172 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-08-05T15:21:03.172 INFO:tasks.ceph:[mgr] debug ms = 1 2022-08-05T15:21:03.173 INFO:tasks.ceph:[mon] debug mon = 20 2022-08-05T15:21:03.173 INFO:tasks.ceph:[mon] debug ms = 1 2022-08-05T15:21:03.173 INFO:tasks.ceph:[mon] debug paxos = 20 2022-08-05T15:21:03.174 INFO:tasks.ceph:[mon] mon scrub interval = 300 2022-08-05T15:21:03.174 INFO:tasks.ceph:Setting up mon.a... 2022-08-05T15:21:03.175 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-08-05T15:21:03.237 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.keyring 2022-08-05T15:21:03.262 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-08-05T15:21:03.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-05T15:21:03.382 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.142'), ('mon.c', '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]'), ('mon.b', '172.21.15.191')] 2022-08-05T15:21:03.383 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.191', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2022-08-05T15:21:03.396 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:03.397 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-08-05T15:21:03.472 DEBUG:teuthology.orchestra.run.smithi142:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.142 --addv c '[v2:172.21.15.142:3301,v1:172.21.15.142:6790]' --add b 172.21.15.191 --print /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:03.560 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:03.561 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: generated fsid 3625c1ed-9263-4d4e-ad74-d2fe5e076c60 2022-08-05T15:21:03.561 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = octopus 2022-08-05T15:21:03.562 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 0 2022-08-05T15:21:03.562 INFO:teuthology.orchestra.run.smithi142.stdout:fsid 3625c1ed-9263-4d4e-ad74-d2fe5e076c60 2022-08-05T15:21:03.562 INFO:teuthology.orchestra.run.smithi142.stdout:last_changed 2022-08-05T15:21:03.558426+0000 2022-08-05T15:21:03.563 INFO:teuthology.orchestra.run.smithi142.stdout:created 2022-08-05T15:21:03.558426+0000 2022-08-05T15:21:03.563 INFO:teuthology.orchestra.run.smithi142.stdout:min_mon_release 15 (octopus) 2022-08-05T15:21:03.563 INFO:teuthology.orchestra.run.smithi142.stdout:election_strategy: 1 2022-08-05T15:21:03.563 INFO:teuthology.orchestra.run.smithi142.stdout:0: [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon.a 2022-08-05T15:21:03.564 INFO:teuthology.orchestra.run.smithi142.stdout:1: [v2:172.21.15.191:3300/0,v1:172.21.15.191:6789/0] mon.b 2022-08-05T15:21:03.564 INFO:teuthology.orchestra.run.smithi142.stdout:2: [v2:172.21.15.142:3301/0,v1:172.21.15.142:6790/0] mon.c 2022-08-05T15:21:03.564 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-08-05T15:21:03.567 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-08-05T15:21:03.598 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3625c1ed-9263-4d4e-ad74-d2fe5e076c60... 2022-08-05T15:21:03.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-08-05T15:21:03.643 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-08-05T15:21:03.682 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2022-08-05T15:21:03.683 INFO:teuthology.orchestra.run.smithi142.stdout: chdir = "" 2022-08-05T15:21:03.684 INFO:teuthology.orchestra.run.smithi142.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-08-05T15:21:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: auth supported = cephx 2022-08-05T15:21:03.685 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: filestore xattr use omap = true 2022-08-05T15:21:03.686 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.687 INFO:teuthology.orchestra.run.smithi142.stdout: mon clock drift allowed = 1.000 2022-08-05T15:21:03.688 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.688 INFO:teuthology.orchestra.run.smithi142.stdout: osd crush chooseleaf type = 0 2022-08-05T15:21:03.689 INFO:teuthology.orchestra.run.smithi142.stdout: auth debug = true 2022-08-05T15:21:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.690 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on old message = true 2022-08-05T15:21:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: ms die on bug = true 2022-08-05T15:21:03.691 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: mon max pg per osd = 10000 # >= luminous 2022-08-05T15:21:03.692 INFO:teuthology.orchestra.run.smithi142.stdout: mon pg warn max object skew = 0 2022-08-05T15:21:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: # disable pg_autoscaler by default for new pools 2022-08-05T15:21:03.693 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_pg_autoscale_mode = off 2022-08-05T15:21:03.694 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default size = 2 2022-08-05T15:21:03.695 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow primary affinity = true 2022-08-05T15:21:03.696 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd allow pg remap = true 2022-08-05T15:21:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on legacy crush tunables = false 2022-08-05T15:21:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on crush straw calc version zero = false 2022-08-05T15:21:03.697 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on no sortbitwise = false 2022-08-05T15:21:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on osd down out interval zero = false 2022-08-05T15:21:03.698 INFO:teuthology.orchestra.run.smithi142.stdout: mon warn on too few osds = false 2022-08-05T15:21:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-08-05T15:21:03.699 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_pool_no_redundancy = false 2022-08-05T15:21:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: mon_allow_pool_size_one = true 2022-08-05T15:21:03.700 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-08-05T15:21:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.701 INFO:teuthology.orchestra.run.smithi142.stdout: osd default data pool replay window = 5 2022-08-05T15:21:03.702 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: mon allow pool delete = true 2022-08-05T15:21:03.703 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: mon cluster log file level = debug 2022-08-05T15:21:03.704 INFO:teuthology.orchestra.run.smithi142.stdout: debug asserts on shutdown = true 2022-08-05T15:21:03.705 INFO:teuthology.orchestra.run.smithi142.stdout: mon health detail to clog = false 2022-08-05T15:21:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.191" 2022-08-05T15:21:03.706 INFO:teuthology.orchestra.run.smithi142.stdout: mon client directed command retry = 5 2022-08-05T15:21:03.707 INFO:teuthology.orchestra.run.smithi142.stdout: mon election default strategy = 1 2022-08-05T15:21:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: ms bind msgr1 = False 2022-08-05T15:21:03.708 INFO:teuthology.orchestra.run.smithi142.stdout: ms bind msgr2 = True 2022-08-05T15:21:03.709 INFO:teuthology.orchestra.run.smithi142.stdout: ms inject socket failures = 5000 2022-08-05T15:21:03.710 INFO:teuthology.orchestra.run.smithi142.stdout: ms type = async 2022-08-05T15:21:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_min_size = 2 2022-08-05T15:21:03.711 INFO:teuthology.orchestra.run.smithi142.stdout: osd_pool_default_size = 2 2022-08-05T15:21:03.712 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = 3625c1ed-9263-4d4e-ad74-d2fe5e076c60 2022-08-05T15:21:03.713 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.713 INFO:teuthology.orchestra.run.smithi142.stdout:[osd] 2022-08-05T15:21:03.714 INFO:teuthology.orchestra.run.smithi142.stdout: osd journal size = 100 2022-08-05T15:21:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub load threshold = 5.0 2022-08-05T15:21:03.715 INFO:teuthology.orchestra.run.smithi142.stdout: osd scrub max interval = 600 2022-08-05T15:21:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.716 INFO:teuthology.orchestra.run.smithi142.stdout: osd recover clone overlap = true 2022-08-05T15:21:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: osd recovery max chunk = 1048576 2022-08-05T15:21:03.717 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug shutdown = true 2022-08-05T15:21:03.726 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug op order = true 2022-08-05T15:21:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify stray on activate = true 2022-08-05T15:21:03.727 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: osd open classes on start = true 2022-08-05T15:21:03.728 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug pg log writeout = true 2022-08-05T15:21:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.729 INFO:teuthology.orchestra.run.smithi142.stdout: osd deep scrub update digest min age = 30 2022-08-05T15:21:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.730 INFO:teuthology.orchestra.run.smithi142.stdout: osd map max advance = 10 2022-08-05T15:21:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.731 INFO:teuthology.orchestra.run.smithi142.stdout: journal zero on create = true 2022-08-05T15:21:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.736 INFO:teuthology.orchestra.run.smithi142.stdout: filestore ondisk finisher threads = 3 2022-08-05T15:21:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: filestore apply finisher threads = 3 2022-08-05T15:21:03.737 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.739 INFO:teuthology.orchestra.run.smithi142.stdout: bdev debug aio = true 2022-08-05T15:21:03.740 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug misdirected ops = true 2022-08-05T15:21:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: debug monc = 20 2022-08-05T15:21:03.741 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore block size = 96636764160 2022-08-05T15:21:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression algorithm = zstd 2022-08-05T15:21:03.742 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore compression mode = aggressive 2022-08-05T15:21:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore fsck on mount = True 2022-08-05T15:21:03.743 INFO:teuthology.orchestra.run.smithi142.stdout: bluestore zero block detection = True 2022-08-05T15:21:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluefs = 20 2022-08-05T15:21:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: debug bluestore = 20 2022-08-05T15:21:03.744 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-08-05T15:21:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: debug osd = 20 2022-08-05T15:21:03.745 INFO:teuthology.orchestra.run.smithi142.stdout: debug rocksdb = 10 2022-08-05T15:21:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd backfillfull_ratio = 0.85 2022-08-05T15:21:03.746 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd full ratio = 0.9 2022-08-05T15:21:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd nearfull ratio = 0.8 2022-08-05T15:21:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: osd backoff on peering = True 2022-08-05T15:21:03.747 INFO:teuthology.orchestra.run.smithi142.stdout: osd blocked scrub grace period = 3600 2022-08-05T15:21:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify cached snaps = True 2022-08-05T15:21:03.748 INFO:teuthology.orchestra.run.smithi142.stdout: osd debug verify missing on start = True 2022-08-05T15:21:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: osd failsafe full ratio = 0.95 2022-08-05T15:21:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: osd heartbeat use min delay socket = True 2022-08-05T15:21:03.749 INFO:teuthology.orchestra.run.smithi142.stdout: osd inject bad map crc probability = 0.1 2022-08-05T15:21:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: osd max markdown count = 1000 2022-08-05T15:21:03.750 INFO:teuthology.orchestra.run.smithi142.stdout: osd objectstore = bluestore 2022-08-05T15:21:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue = debug_random 2022-08-05T15:21:03.751 INFO:teuthology.orchestra.run.smithi142.stdout: osd op queue cut off = debug_random 2022-08-05T15:21:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: osd shutdown pgref assert = True 2022-08-05T15:21:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: osd_max_pg_log_entries = 3000 2022-08-05T15:21:03.752 INFO:teuthology.orchestra.run.smithi142.stdout: osd_min_pg_log_entries = 3000 2022-08-05T15:21:03.754 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.754 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr] 2022-08-05T15:21:03.755 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-08-05T15:21:03.755 INFO:teuthology.orchestra.run.smithi142.stdout: debug mgr = 20 2022-08-05T15:21:03.756 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2022-08-05T15:21:03.756 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2022-08-05T15:21:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:21:03.758 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:21:03.759 INFO:teuthology.orchestra.run.smithi142.stdout: mgr/telemetry/nag = false 2022-08-05T15:21:03.759 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.760 INFO:teuthology.orchestra.run.smithi142.stdout:[mon] 2022-08-05T15:21:03.760 INFO:teuthology.orchestra.run.smithi142.stdout: debug ms = 1 2022-08-05T15:21:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: debug mon = 20 2022-08-05T15:21:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: debug paxos = 20 2022-08-05T15:21:03.761 INFO:teuthology.orchestra.run.smithi142.stdout: debug auth = 20 2022-08-05T15:21:03.762 INFO:teuthology.orchestra.run.smithi142.stdout: mon data avail warn = 5 2022-08-05T15:21:03.762 INFO:teuthology.orchestra.run.smithi142.stdout: mon mgr mkfs grace = 240 2022-08-05T15:21:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:21:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd reporter subtree level = osd 2022-08-05T15:21:03.763 INFO:teuthology.orchestra.run.smithi142.stdout: mon osd prime pg temp = true 2022-08-05T15:21:03.764 INFO:teuthology.orchestra.run.smithi142.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:21:03.765 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.778 INFO:teuthology.orchestra.run.smithi142.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-08-05T15:21:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: auth mon ticket ttl = 660 # 11m 2022-08-05T15:21:03.780 INFO:teuthology.orchestra.run.smithi142.stdout: auth service ticket ttl = 240 # 4m 2022-08-05T15:21:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.781 INFO:teuthology.orchestra.run.smithi142.stdout: # don't complain about insecure global_id in the test suite 2022-08-05T15:21:03.782 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-08-05T15:21:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-08-05T15:21:03.783 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.784 INFO:teuthology.orchestra.run.smithi142.stdout: # 1m isn't quite enough 2022-08-05T15:21:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: mon_down_mkfs_grace = 2m 2022-08-05T15:21:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.785 INFO:teuthology.orchestra.run.smithi142.stdout: mon_warn_on_filestore_osds = false 2022-08-05T15:21:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: mon scrub interval = 300 2022-08-05T15:21:03.786 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:03.786 INFO:teuthology.orchestra.run.smithi142.stdout:[client] 2022-08-05T15:21:03.787 INFO:teuthology.orchestra.run.smithi142.stdout: rgw cache enabled = true 2022-08-05T15:21:03.787 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable ops log = true 2022-08-05T15:21:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: rgw enable usage log = true 2022-08-05T15:21:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-08-05T15:21:03.788 INFO:teuthology.orchestra.run.smithi142.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-08-05T15:21:03.789 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.a] 2022-08-05T15:21:03.790 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.c] 2022-08-05T15:21:03.790 INFO:teuthology.orchestra.run.smithi142.stdout:[mon.b] 2022-08-05T15:21:03.794 INFO:teuthology.orchestra.run.smithi191.stdout:[global] 2022-08-05T15:21:03.795 INFO:teuthology.orchestra.run.smithi191.stdout: chdir = "" 2022-08-05T15:21:03.795 INFO:teuthology.orchestra.run.smithi191.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-08-05T15:21:03.796 INFO:teuthology.orchestra.run.smithi191.stdout: auth supported = cephx 2022-08-05T15:21:03.797 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.797 INFO:teuthology.orchestra.run.smithi191.stdout: filestore xattr use omap = true 2022-08-05T15:21:03.798 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.799 INFO:teuthology.orchestra.run.smithi191.stdout: mon clock drift allowed = 1.000 2022-08-05T15:21:03.799 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.800 INFO:teuthology.orchestra.run.smithi191.stdout: osd crush chooseleaf type = 0 2022-08-05T15:21:03.800 INFO:teuthology.orchestra.run.smithi191.stdout: auth debug = true 2022-08-05T15:21:03.800 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.801 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on old message = true 2022-08-05T15:21:03.801 INFO:teuthology.orchestra.run.smithi191.stdout: ms die on bug = true 2022-08-05T15:21:03.802 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.802 INFO:teuthology.orchestra.run.smithi191.stdout: mon max pg per osd = 10000 # >= luminous 2022-08-05T15:21:03.803 INFO:teuthology.orchestra.run.smithi191.stdout: mon pg warn max object skew = 0 2022-08-05T15:21:03.803 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.803 INFO:teuthology.orchestra.run.smithi191.stdout: # disable pg_autoscaler by default for new pools 2022-08-05T15:21:03.804 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_pg_autoscale_mode = off 2022-08-05T15:21:03.804 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.805 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default size = 2 2022-08-05T15:21:03.805 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.805 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow primary affinity = true 2022-08-05T15:21:03.806 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd allow pg remap = true 2022-08-05T15:21:03.807 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on legacy crush tunables = false 2022-08-05T15:21:03.807 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on crush straw calc version zero = false 2022-08-05T15:21:03.808 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on no sortbitwise = false 2022-08-05T15:21:03.808 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on osd down out interval zero = false 2022-08-05T15:21:03.808 INFO:teuthology.orchestra.run.smithi191.stdout: mon warn on too few osds = false 2022-08-05T15:21:03.809 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-08-05T15:21:03.809 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_pool_no_redundancy = false 2022-08-05T15:21:03.810 INFO:teuthology.orchestra.run.smithi191.stdout: mon_allow_pool_size_one = true 2022-08-05T15:21:03.816 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.816 INFO:teuthology.orchestra.run.smithi191.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-08-05T15:21:03.817 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.817 INFO:teuthology.orchestra.run.smithi191.stdout: osd default data pool replay window = 5 2022-08-05T15:21:03.818 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.818 INFO:teuthology.orchestra.run.smithi191.stdout: mon allow pool delete = true 2022-08-05T15:21:03.819 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.819 INFO:teuthology.orchestra.run.smithi191.stdout: mon cluster log file level = debug 2022-08-05T15:21:03.820 INFO:teuthology.orchestra.run.smithi191.stdout: debug asserts on shutdown = true 2022-08-05T15:21:03.820 INFO:teuthology.orchestra.run.smithi191.stdout: mon health detail to clog = false 2022-08-05T15:21:03.821 INFO:teuthology.orchestra.run.smithi191.stdout: mon host = "172.21.15.142,[v2:172.21.15.142:3301,v1:172.21.15.142:6790],172.21.15.191" 2022-08-05T15:21:03.821 INFO:teuthology.orchestra.run.smithi191.stdout: mon client directed command retry = 5 2022-08-05T15:21:03.821 INFO:teuthology.orchestra.run.smithi191.stdout: mon election default strategy = 1 2022-08-05T15:21:03.822 INFO:teuthology.orchestra.run.smithi191.stdout: ms bind msgr1 = False 2022-08-05T15:21:03.822 INFO:teuthology.orchestra.run.smithi191.stdout: ms bind msgr2 = True 2022-08-05T15:21:03.823 INFO:teuthology.orchestra.run.smithi191.stdout: ms inject socket failures = 5000 2022-08-05T15:21:03.823 INFO:teuthology.orchestra.run.smithi191.stdout: ms type = async 2022-08-05T15:21:03.824 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_min_size = 2 2022-08-05T15:21:03.824 INFO:teuthology.orchestra.run.smithi191.stdout: osd_pool_default_size = 2 2022-08-05T15:21:03.825 INFO:teuthology.orchestra.run.smithi191.stdout: fsid = 3625c1ed-9263-4d4e-ad74-d2fe5e076c60 2022-08-05T15:21:03.825 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.826 INFO:teuthology.orchestra.run.smithi191.stdout:[osd] 2022-08-05T15:21:03.827 INFO:teuthology.orchestra.run.smithi191.stdout: osd journal size = 100 2022-08-05T15:21:03.828 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.828 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub load threshold = 5.0 2022-08-05T15:21:03.829 INFO:teuthology.orchestra.run.smithi191.stdout: osd scrub max interval = 600 2022-08-05T15:21:03.830 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.830 INFO:teuthology.orchestra.run.smithi191.stdout: osd recover clone overlap = true 2022-08-05T15:21:03.832 INFO:teuthology.orchestra.run.smithi191.stdout: osd recovery max chunk = 1048576 2022-08-05T15:21:03.836 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.836 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug shutdown = true 2022-08-05T15:21:03.837 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug op order = true 2022-08-05T15:21:03.837 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify stray on activate = true 2022-08-05T15:21:03.838 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.838 INFO:teuthology.orchestra.run.smithi191.stdout: osd open classes on start = true 2022-08-05T15:21:03.839 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug pg log writeout = true 2022-08-05T15:21:03.856 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.857 INFO:teuthology.orchestra.run.smithi191.stdout: osd deep scrub update digest min age = 30 2022-08-05T15:21:03.858 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.859 INFO:teuthology.orchestra.run.smithi191.stdout: osd map max advance = 10 2022-08-05T15:21:03.859 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.860 INFO:teuthology.orchestra.run.smithi191.stdout: journal zero on create = true 2022-08-05T15:21:03.861 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.861 INFO:teuthology.orchestra.run.smithi191.stdout: filestore ondisk finisher threads = 3 2022-08-05T15:21:03.863 INFO:teuthology.orchestra.run.smithi191.stdout: filestore apply finisher threads = 3 2022-08-05T15:21:03.863 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.864 INFO:teuthology.orchestra.run.smithi191.stdout: bdev debug aio = true 2022-08-05T15:21:03.865 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug misdirected ops = true 2022-08-05T15:21:03.865 INFO:teuthology.orchestra.run.smithi191.stdout: debug monc = 20 2022-08-05T15:21:03.866 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore block size = 96636764160 2022-08-05T15:21:03.866 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore compression algorithm = zstd 2022-08-05T15:21:03.867 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore compression mode = aggressive 2022-08-05T15:21:03.887 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore fsck on mount = True 2022-08-05T15:21:03.887 INFO:teuthology.orchestra.run.smithi191.stdout: bluestore zero block detection = True 2022-08-05T15:21:03.888 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluefs = 20 2022-08-05T15:21:03.888 INFO:teuthology.orchestra.run.smithi191.stdout: debug bluestore = 20 2022-08-05T15:21:03.888 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2022-08-05T15:21:03.889 INFO:teuthology.orchestra.run.smithi191.stdout: debug osd = 20 2022-08-05T15:21:03.889 INFO:teuthology.orchestra.run.smithi191.stdout: debug rocksdb = 10 2022-08-05T15:21:03.890 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd backfillfull_ratio = 0.85 2022-08-05T15:21:03.890 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd full ratio = 0.9 2022-08-05T15:21:03.891 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd nearfull ratio = 0.8 2022-08-05T15:21:03.891 INFO:teuthology.orchestra.run.smithi191.stdout: osd backoff on peering = True 2022-08-05T15:21:03.892 INFO:teuthology.orchestra.run.smithi191.stdout: osd blocked scrub grace period = 3600 2022-08-05T15:21:03.892 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify cached snaps = True 2022-08-05T15:21:03.892 INFO:teuthology.orchestra.run.smithi191.stdout: osd debug verify missing on start = True 2022-08-05T15:21:03.893 INFO:teuthology.orchestra.run.smithi191.stdout: osd failsafe full ratio = 0.95 2022-08-05T15:21:03.893 INFO:teuthology.orchestra.run.smithi191.stdout: osd heartbeat use min delay socket = True 2022-08-05T15:21:03.894 INFO:teuthology.orchestra.run.smithi191.stdout: osd inject bad map crc probability = 0.1 2022-08-05T15:21:03.894 INFO:teuthology.orchestra.run.smithi191.stdout: osd max markdown count = 1000 2022-08-05T15:21:03.895 INFO:teuthology.orchestra.run.smithi191.stdout: osd objectstore = bluestore 2022-08-05T15:21:03.895 INFO:teuthology.orchestra.run.smithi191.stdout: osd op queue = debug_random 2022-08-05T15:21:03.896 INFO:teuthology.orchestra.run.smithi191.stdout: osd op queue cut off = debug_random 2022-08-05T15:21:03.896 INFO:teuthology.orchestra.run.smithi191.stdout: osd shutdown pgref assert = True 2022-08-05T15:21:03.902 INFO:teuthology.orchestra.run.smithi191.stdout: osd_max_pg_log_entries = 3000 2022-08-05T15:21:03.903 INFO:teuthology.orchestra.run.smithi191.stdout: osd_min_pg_log_entries = 3000 2022-08-05T15:21:03.903 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.903 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr] 2022-08-05T15:21:03.904 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2022-08-05T15:21:03.904 INFO:teuthology.orchestra.run.smithi191.stdout: debug mgr = 20 2022-08-05T15:21:03.905 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2022-08-05T15:21:03.905 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2022-08-05T15:21:03.905 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:21:03.907 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:21:03.908 INFO:teuthology.orchestra.run.smithi191.stdout: mgr/telemetry/nag = false 2022-08-05T15:21:03.909 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.909 INFO:teuthology.orchestra.run.smithi191.stdout:[mon] 2022-08-05T15:21:03.910 INFO:teuthology.orchestra.run.smithi191.stdout: debug ms = 1 2022-08-05T15:21:03.911 INFO:teuthology.orchestra.run.smithi191.stdout: debug mon = 20 2022-08-05T15:21:03.911 INFO:teuthology.orchestra.run.smithi191.stdout: debug paxos = 20 2022-08-05T15:21:03.912 INFO:teuthology.orchestra.run.smithi191.stdout: debug auth = 20 2022-08-05T15:21:03.912 INFO:teuthology.orchestra.run.smithi191.stdout: mon data avail warn = 5 2022-08-05T15:21:03.913 INFO:teuthology.orchestra.run.smithi191.stdout: mon mgr mkfs grace = 240 2022-08-05T15:21:03.913 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:21:03.914 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd reporter subtree level = osd 2022-08-05T15:21:03.915 INFO:teuthology.orchestra.run.smithi191.stdout: mon osd prime pg temp = true 2022-08-05T15:21:03.915 INFO:teuthology.orchestra.run.smithi191.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:21:03.916 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.917 INFO:teuthology.orchestra.run.smithi191.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-08-05T15:21:03.917 INFO:teuthology.orchestra.run.smithi191.stdout: auth mon ticket ttl = 660 # 11m 2022-08-05T15:21:03.918 INFO:teuthology.orchestra.run.smithi191.stdout: auth service ticket ttl = 240 # 4m 2022-08-05T15:21:03.918 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.919 INFO:teuthology.orchestra.run.smithi191.stdout: # don't complain about insecure global_id in the test suite 2022-08-05T15:21:03.920 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-08-05T15:21:03.920 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-08-05T15:21:03.921 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.921 INFO:teuthology.orchestra.run.smithi191.stdout: # 1m isn't quite enough 2022-08-05T15:21:03.922 INFO:teuthology.orchestra.run.smithi191.stdout: mon_down_mkfs_grace = 2m 2022-08-05T15:21:03.922 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.923 INFO:teuthology.orchestra.run.smithi191.stdout: mon_warn_on_filestore_osds = false 2022-08-05T15:21:03.924 INFO:teuthology.orchestra.run.smithi191.stdout: mon scrub interval = 300 2022-08-05T15:21:03.925 INFO:teuthology.orchestra.run.smithi191.stdout: 2022-08-05T15:21:03.925 INFO:teuthology.orchestra.run.smithi191.stdout:[client] 2022-08-05T15:21:03.926 INFO:teuthology.orchestra.run.smithi191.stdout: rgw cache enabled = true 2022-08-05T15:21:03.926 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable ops log = true 2022-08-05T15:21:03.927 INFO:teuthology.orchestra.run.smithi191.stdout: rgw enable usage log = true 2022-08-05T15:21:03.927 INFO:teuthology.orchestra.run.smithi191.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-08-05T15:21:03.927 INFO:teuthology.orchestra.run.smithi191.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-08-05T15:21:03.928 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.a] 2022-08-05T15:21:03.928 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.c] 2022-08-05T15:21:03.929 INFO:teuthology.orchestra.run.smithi191.stdout:[mon.b] 2022-08-05T15:21:03.929 INFO:tasks.ceph:Creating admin key on mon.a... 2022-08-05T15:21:03.931 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-08-05T15:21:04.001 INFO:tasks.ceph:Copying monmap to all nodes... 2022-08-05T15:21:04.001 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:04.002 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-08-05T15:21:04.028 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:04.029 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-08-05T15:21:04.096 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:04.097 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:04.097 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.keyring 2022-08-05T15:21:04.098 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-05T15:21:04.192 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:04.192 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:04.271 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:04.272 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:04.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd of=/etc/ceph/ceph.keyring 2022-08-05T15:21:04.272 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-05T15:21:04.335 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:04.336 DEBUG:teuthology.orchestra.run.smithi191:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:04.411 INFO:tasks.ceph:Setting up mon nodes... 2022-08-05T15:21:04.412 INFO:tasks.ceph:Setting up mgr nodes... 2022-08-05T15:21:04.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-08-05T15:21:04.471 INFO:teuthology.orchestra.run.smithi142.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-08-05T15:21:04.472 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-08-05T15:21:04.548 INFO:teuthology.orchestra.run.smithi191.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-08-05T15:21:04.549 INFO:tasks.ceph:Setting up mds nodes... 2022-08-05T15:21:04.550 INFO:tasks.ceph_client:Setting up client nodes... 2022-08-05T15:21:04.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-08-05T15:21:04.597 INFO:teuthology.orchestra.run.smithi142.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-08-05T15:21:04.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-08-05T15:21:04.687 INFO:teuthology.orchestra.run.smithi191.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-08-05T15:21:04.688 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-08-05T15:21:04.688 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi142.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi191.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-08-05T15:21:04.709 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-08-05T15:21:04.751 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:04.752 INFO:tasks.ceph:role: osd.0 2022-08-05T15:21:04.752 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:04.753 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-08-05T15:21:04.839 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:04.839 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:04.842 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:04.842 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:04.843 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:04.843 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:04.844 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:04.853 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:04.853 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:05.279 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-08-05T15:21:05.280 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-08-05T15:21:05.281 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-08-05T15:21:05.503 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-08-05T15:21:05.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-08-05T15:21:05.620 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:05.620 INFO:tasks.ceph:role: osd.1 2022-08-05T15:21:05.621 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:05.621 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-08-05T15:21:05.702 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:05.705 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:05.706 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:05.706 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:05.706 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:06.111 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-08-05T15:21:06.113 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-08-05T15:21:06.120 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-08-05T15:21:06.256 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-08-05T15:21:06.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-08-05T15:21:06.391 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:06.392 INFO:tasks.ceph:role: osd.2 2022-08-05T15:21:06.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:06.395 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-08-05T15:21:06.496 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:06.497 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:06.505 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:06.507 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:06.508 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:06.508 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:06.508 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:06.936 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-08-05T15:21:06.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-08-05T15:21:06.937 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-08-05T15:21:07.138 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-08-05T15:21:07.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-08-05T15:21:07.252 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:07.253 INFO:tasks.ceph:role: osd.3 2022-08-05T15:21:07.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:07.253 DEBUG:teuthology.orchestra.run.smithi142:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-08-05T15:21:07.346 INFO:teuthology.orchestra.run.smithi142.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:07.346 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:07.347 INFO:teuthology.orchestra.run.smithi142.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:07.347 INFO:teuthology.orchestra.run.smithi142.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:07.347 INFO:teuthology.orchestra.run.smithi142.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:07.348 INFO:teuthology.orchestra.run.smithi142.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:07.348 INFO:teuthology.orchestra.run.smithi142.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:07.349 INFO:teuthology.orchestra.run.smithi142.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:07.349 INFO:teuthology.orchestra.run.smithi142.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:07.352 INFO:teuthology.orchestra.run.smithi142.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:07.782 INFO:teuthology.orchestra.run.smithi142.stdout:Discarding blocks...Done. 2022-08-05T15:21:07.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi142.front.sepia.ceph.com -o noatime 2022-08-05T15:21:07.786 DEBUG:teuthology.orchestra.run.smithi142:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-08-05T15:21:07.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-08-05T15:21:07.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:08.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.081+0000 7f7ccac0f440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-08-05T15:21:08.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.081+0000 7f7ccac0f440 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-08-05T15:21:08.084 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.081+0000 7f7ccac0f440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:21:08.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.081+0000 7f7ccac0f440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:21:08.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.081+0000 7f7ccac0f440 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:21:08.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:08.082+0000 7f7ccac0f440 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-08-05T15:21:10.937 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-08-05T15:21:10.987 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:11.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.077+0000 7f830993e440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-08-05T15:21:11.101 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.077+0000 7f830993e440 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-08-05T15:21:11.102 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.077+0000 7f830993e440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:21:11.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.077+0000 7f830993e440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:21:11.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.077+0000 7f830993e440 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:21:11.107 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:11.078+0000 7f830993e440 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-08-05T15:21:13.927 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-08-05T15:21:13.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:14.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-08-05T15:21:14.085 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-08-05T15:21:14.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:21:14.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:21:14.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:21:14.086 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:14.082+0000 7ff468449440 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-08-05T15:21:16.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-08-05T15:21:17.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:17.106 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-08-05T15:21:17.114 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-08-05T15:21:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-05T15:21:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-05T15:21:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-08-05T15:21:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2022-08-05T15:21:17.098+0000 7fbda4011440 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-08-05T15:21:19.990 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-08-05T15:21:20.048 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-08-05T15:21:20.094 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:20.094 INFO:tasks.ceph:role: osd.4 2022-08-05T15:21:20.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:20.095 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-08-05T15:21:20.175 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:20.176 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:20.176 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:20.177 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:20.177 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:20.179 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:20.179 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:20.180 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:20.180 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:20.181 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:20.602 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2022-08-05T15:21:20.608 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2022-08-05T15:21:20.609 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-08-05T15:21:20.801 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-08-05T15:21:20.843 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-08-05T15:21:20.943 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:20.944 INFO:tasks.ceph:role: osd.5 2022-08-05T15:21:20.945 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:20.945 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-08-05T15:21:21.021 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:21.022 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:21.026 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:21.026 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:21.026 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:21.027 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:21.027 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:21.028 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:21.028 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:21.028 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:21.440 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2022-08-05T15:21:21.441 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2022-08-05T15:21:21.441 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-08-05T15:21:21.603 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-08-05T15:21:21.639 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-08-05T15:21:21.727 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:21.774 INFO:tasks.ceph:role: osd.6 2022-08-05T15:21:21.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:21.778 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-08-05T15:21:21.875 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:21.876 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:21.876 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:21.876 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:21.877 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:21.877 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:21.877 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:21.877 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:21.878 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:21.878 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:22.295 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2022-08-05T15:21:22.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2022-08-05T15:21:22.324 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-08-05T15:21:22.501 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-08-05T15:21:22.537 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-08-05T15:21:22.635 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-08-05T15:21:22.642 INFO:tasks.ceph:role: osd.7 2022-08-05T15:21:22.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:22.643 DEBUG:teuthology.orchestra.run.smithi191:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-08-05T15:21:22.703 INFO:teuthology.orchestra.run.smithi191.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:21:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:21:22.703 INFO:teuthology.orchestra.run.smithi191.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:21:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-08-05T15:21:22.704 INFO:teuthology.orchestra.run.smithi191.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:21:22.704 INFO:teuthology.orchestra.run.smithi191.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:21:22.704 INFO:teuthology.orchestra.run.smithi191.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:21:22.705 INFO:teuthology.orchestra.run.smithi191.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:21:22.705 INFO:teuthology.orchestra.run.smithi191.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:21:22.705 INFO:teuthology.orchestra.run.smithi191.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:21:23.129 INFO:teuthology.orchestra.run.smithi191.stdout:Discarding blocks...Done. 2022-08-05T15:21:23.132 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi191.front.sepia.ceph.com -o noatime 2022-08-05T15:21:23.133 DEBUG:teuthology.orchestra.run.smithi191:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-08-05T15:21:23.290 DEBUG:teuthology.orchestra.run.smithi191:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-08-05T15:21:23.325 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:23.449 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.413+0000 7f801c620440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-08-05T15:21:23.451 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.413+0000 7f801c620440 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-08-05T15:21:23.451 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.413+0000 7f801c620440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-05T15:21:23.452 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.413+0000 7f801c620440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-05T15:21:23.452 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.413+0000 7f801c620440 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-08-05T15:21:23.452 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:23.414+0000 7f801c620440 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-08-05T15:21:26.261 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-08-05T15:21:26.352 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:26.460 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.444+0000 7fb5ecc18440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-08-05T15:21:26.461 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.445+0000 7fb5ecc18440 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-08-05T15:21:26.471 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.445+0000 7fb5ecc18440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-05T15:21:26.472 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.445+0000 7fb5ecc18440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-05T15:21:26.472 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.445+0000 7fb5ecc18440 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-08-05T15:21:26.473 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:26.445+0000 7fb5ecc18440 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-08-05T15:21:29.301 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-08-05T15:21:29.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:29.474 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.469+0000 7fa86cd10440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-08-05T15:21:29.475 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.469+0000 7fa86cd10440 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-08-05T15:21:29.475 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.469+0000 7fa86cd10440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-05T15:21:29.476 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.469+0000 7fa86cd10440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-05T15:21:29.476 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.469+0000 7fa86cd10440 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-08-05T15:21:29.477 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:29.470+0000 7fa86cd10440 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-08-05T15:21:32.313 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-08-05T15:21:32.366 DEBUG:teuthology.orchestra.run.smithi191:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:32.465 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.455+0000 7f86f48dd440 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-08-05T15:21:32.468 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.455+0000 7f86f48dd440 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-08-05T15:21:32.469 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.456+0000 7f86f48dd440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-05T15:21:32.470 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.456+0000 7f86f48dd440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-05T15:21:32.470 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.456+0000 7f86f48dd440 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-08-05T15:21:32.471 INFO:teuthology.orchestra.run.smithi191.stderr:2022-08-05T15:21:32.456+0000 7f86f48dd440 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-08-05T15:21:35.305 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-08-05T15:21:35.341 INFO:tasks.ceph:Reading keys from all nodes... 2022-08-05T15:21:35.342 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:35.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-08-05T15:21:35.394 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:35.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-08-05T15:21:35.473 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:35.474 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-08-05T15:21:35.548 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:35.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-08-05T15:21:35.623 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:35.624 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-08-05T15:21:35.702 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:35.703 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-08-05T15:21:35.737 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:35.738 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-08-05T15:21:35.813 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:35.825 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-08-05T15:21:35.893 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:35.893 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-08-05T15:21:35.967 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:35.968 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-08-05T15:21:36.040 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:36.040 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-08-05T15:21:36.064 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:36.065 DEBUG:teuthology.orchestra.run.smithi191:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-08-05T15:21:36.107 INFO:tasks.ceph:Adding keys to all mons... 2022-08-05T15:21:36.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo tee -a /etc/ceph/ceph.keyring 2022-08-05T15:21:36.121 DEBUG:teuthology.orchestra.run.smithi191:> sudo tee -a /etc/ceph/ceph.keyring 2022-08-05T15:21:36.155 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.y] 2022-08-05T15:21:36.155 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBgNe1ia0nKGxAA5TiQdba9UnwrhoFi+zE/kQ== 2022-08-05T15:21:36.156 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.0] 2022-08-05T15:21:36.156 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBkNe1iLVX3BBAAr69HCPRN0OCaZvA3n58CUA== 2022-08-05T15:21:36.157 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.1] 2022-08-05T15:21:36.157 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBnNe1i75m3BBAABqNlP5mMN1rJtVdcwGsj7g== 2022-08-05T15:21:36.157 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.2] 2022-08-05T15:21:36.158 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBqNe1ioe//BBAAA/LsVK3cv1wJibtVydwtvA== 2022-08-05T15:21:36.158 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.3] 2022-08-05T15:21:36.158 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBtNe1ivinzBRAAmJ2sBDg6nR+Kv+4fG16FSQ== 2022-08-05T15:21:36.159 INFO:teuthology.orchestra.run.smithi142.stdout:[mgr.x] 2022-08-05T15:21:36.159 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBgNe1iiDBmIBAAYABBKOH9mk5Gln04haaLgA== 2022-08-05T15:21:36.159 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.4] 2022-08-05T15:21:36.160 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBzNe1iXdW5GBAAD5zTDIbYRIHgkEw7HxfpQw== 2022-08-05T15:21:36.160 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.5] 2022-08-05T15:21:36.160 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB2Ne1i4d6XGhAA0FLCufCtzetXN3Jx61SQwQ== 2022-08-05T15:21:36.161 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.6] 2022-08-05T15:21:36.161 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB5Ne1iSWQMHBAAspyKGgMSSlvYtkDK+cL49A== 2022-08-05T15:21:36.162 INFO:teuthology.orchestra.run.smithi142.stdout:[osd.7] 2022-08-05T15:21:36.162 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQB8Ne1iem48GxAA0a4jddWW7ZBmbz8gwlD+JA== 2022-08-05T15:21:36.162 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2022-08-05T15:21:36.162 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBgNe1iJCt3IxAArtliz4CHgbuEn5kmipBvvg== 2022-08-05T15:21:36.163 INFO:teuthology.orchestra.run.smithi142.stdout:[client.1] 2022-08-05T15:21:36.164 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQBgNe1ircEVJxAAXtlwtOHeDX4cpqIU5aheXg== 2022-08-05T15:21:36.178 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.y] 2022-08-05T15:21:36.178 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgNe1ia0nKGxAA5TiQdba9UnwrhoFi+zE/kQ== 2022-08-05T15:21:36.179 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.0] 2022-08-05T15:21:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBkNe1iLVX3BBAAr69HCPRN0OCaZvA3n58CUA== 2022-08-05T15:21:36.179 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.1] 2022-08-05T15:21:36.179 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBnNe1i75m3BBAABqNlP5mMN1rJtVdcwGsj7g== 2022-08-05T15:21:36.179 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.2] 2022-08-05T15:21:36.180 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBqNe1ioe//BBAAA/LsVK3cv1wJibtVydwtvA== 2022-08-05T15:21:36.180 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.3] 2022-08-05T15:21:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBtNe1ivinzBRAAmJ2sBDg6nR+Kv+4fG16FSQ== 2022-08-05T15:21:36.181 INFO:teuthology.orchestra.run.smithi191.stdout:[mgr.x] 2022-08-05T15:21:36.181 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgNe1iiDBmIBAAYABBKOH9mk5Gln04haaLgA== 2022-08-05T15:21:36.181 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.4] 2022-08-05T15:21:36.182 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBzNe1iXdW5GBAAD5zTDIbYRIHgkEw7HxfpQw== 2022-08-05T15:21:36.182 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.5] 2022-08-05T15:21:36.183 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB2Ne1i4d6XGhAA0FLCufCtzetXN3Jx61SQwQ== 2022-08-05T15:21:36.183 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.6] 2022-08-05T15:21:36.184 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB5Ne1iSWQMHBAAspyKGgMSSlvYtkDK+cL49A== 2022-08-05T15:21:36.184 INFO:teuthology.orchestra.run.smithi191.stdout:[osd.7] 2022-08-05T15:21:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQB8Ne1iem48GxAA0a4jddWW7ZBmbz8gwlD+JA== 2022-08-05T15:21:36.185 INFO:teuthology.orchestra.run.smithi191.stdout:[client.0] 2022-08-05T15:21:36.185 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgNe1iJCt3IxAArtliz4CHgbuEn5kmipBvvg== 2022-08-05T15:21:36.185 INFO:teuthology.orchestra.run.smithi191.stdout:[client.1] 2022-08-05T15:21:36.186 INFO:teuthology.orchestra.run.smithi191.stdout: key = AQBgNe1ircEVJxAAXtlwtOHeDX4cpqIU5aheXg== 2022-08-05T15:21:36.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-05T15:21:36.219 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-05T15:21:36.276 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.286 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.355 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.444 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.524 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.606 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-05T15:21:36.612 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-05T15:21:36.667 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.675 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.737 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.817 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.890 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:21:36.957 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-05T15:21:36.992 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-05T15:21:37.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-05T15:21:37.077 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-05T15:21:37.136 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-08-05T15:21:37.137 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-08-05T15:21:37.193 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:21:37.310 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-08-05T15:21:37.347 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-08-05T15:21:37.433 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:21:37.543 DEBUG:teuthology.orchestra.run.smithi142:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-08-05T15:21:37.594 DEBUG:teuthology.orchestra.run.smithi191:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-08-05T15:21:37.647 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:21:37.764 DEBUG:teuthology.orchestra.run.smithi191:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-08-05T15:21:37.810 DEBUG:teuthology.orchestra.run.smithi142:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:37.823 DEBUG:teuthology.orchestra.run.smithi191:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:21:37.874 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-08-05T15:21:37.875 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-05T15:21:37.886 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-05T15:21:37.905 INFO:tasks.ceph.mon.a:Started 2022-08-05T15:21:37.909 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-05T15:21:37.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-05T15:21:37.932 INFO:tasks.ceph.mon.c:Started 2022-08-05T15:21:37.932 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-05T15:21:37.933 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-05T15:21:37.952 INFO:tasks.ceph.mon.b:Started 2022-08-05T15:21:37.954 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-08-05T15:21:37.955 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-08-05T15:21:37.956 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-08-05T15:21:37.961 INFO:tasks.ceph.mgr.y:Started 2022-08-05T15:21:37.961 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-08-05T15:21:37.962 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-08-05T15:21:37.982 INFO:tasks.ceph.mgr.x:Started 2022-08-05T15:21:37.983 INFO:tasks.ceph:Setting crush tunables to default 2022-08-05T15:21:37.984 DEBUG:teuthology.orchestra.run.smithi142:> sudo ceph --cluster ceph osd crush tunables default 2022-08-05T15:21:38.346 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2022-08-05T15:21:38.355 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:38.352+0000 7f1d85284080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-08-05T15:21:38.358 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-08-05T15:21:38.359 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:38.361 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-08-05T15:21:38.367 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:38.362+0000 7ff8c3230080 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-08-05T15:21:38.391 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:38.392 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-08-05T15:21:38.465 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:38.466 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-08-05T15:21:38.532 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2022-08-05T15:21:38.533 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-08-05T15:21:38.606 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:38.607 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-08-05T15:21:38.641 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:38.641 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-08-05T15:21:38.687 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:38.685+0000 7ff8c3230080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-08-05T15:21:38.705 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:38.699+0000 7f1d85284080 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-08-05T15:21:38.710 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:38.711 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-08-05T15:21:38.784 DEBUG:teuthology.orchestra.run.smithi191:> set -ex 2022-08-05T15:21:38.785 DEBUG:teuthology.orchestra.run.smithi191:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-08-05T15:21:38.864 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:38.841+0000 7ff8c3230080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-08-05T15:21:38.867 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 904ac3fe-d553-42d8-a169-4fb0b9783023 0 2022-08-05T15:21:38.868 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:38.862+0000 7f1d85284080 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-08-05T15:21:38.960 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:38.954+0000 7f1d85284080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-08-05T15:21:38.960 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:38.940+0000 7ff8c3230080 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-08-05T15:21:39.039 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:39.035+0000 7ff8c3230080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-08-05T15:21:39.059 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:39.052+0000 7f1d85284080 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-08-05T15:21:39.134 INFO:teuthology.orchestra.run.smithi191.stdout:0 2022-08-05T15:21:39.143 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 8fe9d624-f6f4-4d82-a956-fd94bb3121f6 1 2022-08-05T15:21:39.169 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:39.168+0000 7ff8c3230080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-08-05T15:21:39.189 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:39.187+0000 7f1d85284080 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-08-05T15:21:39.238 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:39.237+0000 7ff8c3230080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-08-05T15:21:39.261 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:39.260+0000 7f1d85284080 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-08-05T15:21:39.399 INFO:teuthology.orchestra.run.smithi191.stdout:1 2022-08-05T15:21:39.416 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new add4536e-7a46-41ea-8140-3488f9847db1 2 2022-08-05T15:21:39.687 INFO:teuthology.orchestra.run.smithi191.stdout:2 2022-08-05T15:21:39.708 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 043172be-7df6-46d1-80f4-f217a13e30fa 3 2022-08-05T15:21:39.774 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:39.772+0000 7ff8c3230080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-08-05T15:21:39.821 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:39.820+0000 7f1d85284080 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-08-05T15:21:39.849 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:39.846+0000 7ff8c3230080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-08-05T15:21:39.902 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:39.898+0000 7f1d85284080 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-08-05T15:21:39.927 INFO:teuthology.orchestra.run.smithi191.stdout:3 2022-08-05T15:21:39.940 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 1a002aeb-5bf7-4f05-a887-f19cd27c4039 4 2022-08-05T15:21:40.159 INFO:teuthology.orchestra.run.smithi191.stdout:4 2022-08-05T15:21:40.175 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new 21fe5496-7d49-4913-ac53-47d8bf38aa4e 5 2022-08-05T15:21:40.393 INFO:teuthology.orchestra.run.smithi191.stdout:5 2022-08-05T15:21:40.412 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new dac921fe-2c85-4421-b6f0-675478be9207 6 2022-08-05T15:21:40.483 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:40.481+0000 7ff8c3230080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-08-05T15:21:40.585 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:40.578+0000 7f1d85284080 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-08-05T15:21:40.631 INFO:teuthology.orchestra.run.smithi191.stdout:6 2022-08-05T15:21:40.645 DEBUG:teuthology.orchestra.run.smithi191:> sudo ceph --cluster ceph osd new ef9faf75-5570-47b7-b4b5-ef804fc61418 7 2022-08-05T15:21:40.651 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:40.648+0000 7ff8c3230080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-08-05T15:21:40.726 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:40.724+0000 7ff8c3230080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-08-05T15:21:40.752 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:40.750+0000 7f1d85284080 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-08-05T15:21:40.803 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:40.799+0000 7ff8c3230080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-08-05T15:21:40.841 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:40.831+0000 7f1d85284080 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-08-05T15:21:40.868 INFO:teuthology.orchestra.run.smithi191.stdout:7 2022-08-05T15:21:40.869 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:40.867+0000 7ff8c3230080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-08-05T15:21:40.880 INFO:tasks.ceph.osd.0:Restarting daemon 2022-08-05T15:21:40.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-08-05T15:21:40.888 INFO:tasks.ceph.osd.0:Started 2022-08-05T15:21:40.889 INFO:tasks.ceph.osd.1:Restarting daemon 2022-08-05T15:21:40.890 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-08-05T15:21:40.905 INFO:tasks.ceph.osd.1:Started 2022-08-05T15:21:40.908 INFO:tasks.ceph.osd.2:Restarting daemon 2022-08-05T15:21:40.909 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-08-05T15:21:40.911 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:40.908+0000 7f1d85284080 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-08-05T15:21:40.918 INFO:tasks.ceph.osd.2:Started 2022-08-05T15:21:40.918 INFO:tasks.ceph.osd.3:Restarting daemon 2022-08-05T15:21:40.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-08-05T15:21:40.934 INFO:tasks.ceph.osd.3:Started 2022-08-05T15:21:40.935 INFO:tasks.ceph.osd.4:Restarting daemon 2022-08-05T15:21:40.936 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-08-05T15:21:40.944 INFO:tasks.ceph.osd.4:Started 2022-08-05T15:21:40.945 INFO:tasks.ceph.osd.5:Restarting daemon 2022-08-05T15:21:40.946 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-08-05T15:21:40.952 INFO:tasks.ceph.osd.5:Started 2022-08-05T15:21:40.953 INFO:tasks.ceph.osd.6:Restarting daemon 2022-08-05T15:21:40.954 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-08-05T15:21:40.964 INFO:tasks.ceph.osd.6:Started 2022-08-05T15:21:40.970 INFO:tasks.ceph.osd.7:Restarting daemon 2022-08-05T15:21:40.971 DEBUG:teuthology.orchestra.run.smithi191:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-08-05T15:21:40.985 INFO:tasks.ceph.osd.1.smithi142.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:40.987 INFO:tasks.ceph.osd.1.smithi142.stderr: in thread 7fea1dcc2440 thread_name:ceph-osd 2022-08-05T15:21:40.987 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:40.983+0000 7f1d85284080 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-08-05T15:21:40.989 INFO:tasks.ceph.osd.7:Started 2022-08-05T15:21:40.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-05T15:21:41.013 INFO:tasks.ceph.osd.2.smithi142.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.015 INFO:tasks.ceph.osd.2.smithi142.stderr: in thread 7efda9d7c440 thread_name:ceph-osd 2022-08-05T15:21:41.036 INFO:tasks.ceph.osd.3.smithi142.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.036 INFO:tasks.ceph.osd.3.smithi142.stderr: in thread 7faa10097440 thread_name:ceph-osd 2022-08-05T15:21:41.044 INFO:tasks.ceph.osd.4.smithi191.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.044 INFO:tasks.ceph.osd.4.smithi191.stderr: in thread 7f3ea0fb1440 thread_name:ceph-osd 2022-08-05T15:21:41.046 INFO:tasks.ceph.osd.5.smithi191.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.046 INFO:tasks.ceph.osd.5.smithi191.stderr: in thread 7f02e2636440 thread_name:ceph-osd 2022-08-05T15:21:41.056 INFO:tasks.ceph.osd.6.smithi191.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.057 INFO:tasks.ceph.osd.6.smithi191.stderr: in thread 7efd01bb5440 thread_name:ceph-osd 2022-08-05T15:21:41.118 INFO:tasks.ceph.osd.7.smithi191.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:21:41.119 INFO:tasks.ceph.osd.7.smithi191.stderr: in thread 7f868816b440 thread_name:ceph-osd 2022-08-05T15:21:41.153 INFO:tasks.ceph.osd.0.smithi142.stderr:daemon-helper: command failed with exit status 1 2022-08-05T15:21:41.246 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-08-05T15:21:41.247 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":10,"fsid":"3625c1ed-9263-4d4e-ad74-d2fe5e076c60","created":"2022-08-05T15:21:38.221578+0000","modified":"2022-08-05T15:21:40.863030+0000","last_up_change":"0.000000","last_in_change":"2022-08-05T15:21:40.863030+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"904ac3fe-d553-42d8-a169-4fb0b9783023","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8fe9d624-f6f4-4d82-a956-fd94bb3121f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"add4536e-7a46-41ea-8140-3488f9847db1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"043172be-7df6-46d1-80f4-f217a13e30fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1a002aeb-5bf7-4f05-a887-f19cd27c4039","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"21fe5496-7d49-4913-ac53-47d8bf38aa4e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"dac921fe-2c85-4421-b6f0-675478be9207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ef9faf75-5570-47b7-b4b5-ef804fc61418","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-05T15:21:41.247 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:41.245+0000 7ff8c3230080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-08-05T15:21:41.264 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-08-05T15:21:41.265 INFO:tasks.ceph:Waiting for OSDs to come up 2022-08-05T15:21:41.266 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:21:41.268 INFO:teuthology.misc:Shutting down osd daemons... 2022-08-05T15:21:41.269 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-08-05T15:21:41.270 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:41.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:41.282 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:21:41.283 INFO:tasks.ceph.osd.0:Stopped 2022-08-05T15:21:41.286 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-08-05T15:21:41.287 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:41.293 INFO:tasks.ceph.osd.1.smithi142.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:41.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:41.299 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2022-08-05T15:21:41.300 INFO:tasks.ceph.osd.1:Stopped 2022-08-05T15:21:41.301 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-08-05T15:21:41.301 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:41.346 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:41.344+0000 7ff8c3230080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-08-05T15:21:41.356 INFO:tasks.ceph.osd.2.smithi142.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:41.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:41.357 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2022-08-05T15:21:41.359 INFO:tasks.ceph.osd.2:Stopped 2022-08-05T15:21:41.360 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2022-08-05T15:21:41.361 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:41.390 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:41.387+0000 7f1d85284080 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-08-05T15:21:41.393 INFO:tasks.ceph.osd.3.smithi142.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:41.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:41.399 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3' 2022-08-05T15:21:41.400 INFO:tasks.ceph.osd.3:Stopped 2022-08-05T15:21:41.401 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2022-08-05T15:21:41.402 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:41.429 INFO:tasks.ceph.osd.6.smithi191.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:41.486 INFO:tasks.ceph.osd.4.smithi191.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:41.513 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:41.484+0000 7f1d85284080 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-08-05T15:21:41.522 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:41.521+0000 7ff8c3230080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-08-05T15:21:41.663 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:41.661+0000 7f1d85284080 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-08-05T15:21:41.664 INFO:tasks.ceph.osd.7.smithi191.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:42.047 INFO:tasks.ceph.osd.5.smithi191.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:21:42.264 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:42.262+0000 7ff8c3230080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-08-05T15:21:42.335 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:42.332+0000 7ff8c3230080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-08-05T15:21:42.408 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:42.404+0000 7ff8c3230080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-08-05T15:21:42.409 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:42.403+0000 7f1d85284080 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-08-05T15:21:42.480 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:42.471+0000 7f1d85284080 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-08-05T15:21:42.490 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:42.484+0000 7ff8c3230080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-08-05T15:21:42.546 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:42.543+0000 7f1d85284080 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-08-05T15:21:42.623 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:42.622+0000 7ff8c3230080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-08-05T15:21:42.626 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:42.625+0000 7f1d85284080 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-08-05T15:21:42.766 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:42.764+0000 7f1d85284080 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-08-05T15:21:43.301 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:43.293+0000 7ff8c3230080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-08-05T15:21:43.423 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:43.408+0000 7ff8c3230080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-08-05T15:21:43.430 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:43.428+0000 7f1d85284080 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-08-05T15:21:43.546 INFO:tasks.ceph.mgr.x.smithi191.stderr:2022-08-05T15:21:43.543+0000 7f1d85284080 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-08-05T15:21:44.588 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:44.574+0000 7ff8769b4700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-08-05T15:21:44.588 INFO:tasks.ceph.mgr.y.smithi142.stderr:2022-08-05T15:21:44.575+0000 7ff8769b4700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-08-05T15:21:47.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:47.517 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi191 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4' 2022-08-05T15:21:47.519 INFO:tasks.ceph.osd.4:Stopped 2022-08-05T15:21:47.526 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2022-08-05T15:21:47.527 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.528 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:47.529 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi191 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5' 2022-08-05T15:21:47.530 INFO:tasks.ceph.osd.5:Stopped 2022-08-05T15:21:47.537 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2022-08-05T15:21:47.537 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:47.538 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi191 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6' 2022-08-05T15:21:47.539 INFO:tasks.ceph.osd.6:Stopped 2022-08-05T15:21:47.540 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2022-08-05T15:21:47.550 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:47.553 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi191 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7' 2022-08-05T15:21:47.554 INFO:tasks.ceph.osd.7:Stopped 2022-08-05T15:21:47.555 INFO:teuthology.misc:Shutting down mgr daemons... 2022-08-05T15:21:47.555 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2022-08-05T15:21:47.556 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.582 INFO:tasks.ceph.mgr.y:Stopped 2022-08-05T15:21:47.583 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-08-05T15:21:47.584 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.613 INFO:tasks.ceph.mgr.x:Stopped 2022-08-05T15:21:47.631 INFO:teuthology.misc:Shutting down mon daemons... 2022-08-05T15:21:47.632 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-05T15:21:47.633 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.660 INFO:tasks.ceph.mon.a:Stopped 2022-08-05T15:21:47.662 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-05T15:21:47.662 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.722 INFO:tasks.ceph.mon.c:Stopped 2022-08-05T15:21:47.723 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-05T15:21:47.724 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:21:47.736 INFO:tasks.ceph.mon.b:Stopped 2022-08-05T15:21:47.736 INFO:tasks.ceph:Checking cluster log for badness... 2022-08-05T15:21:47.737 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'must scrub before tier agent can activate' | head -n 1 2022-08-05T15:21:47.814 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:47.844 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2022-08-05T15:21:48.205 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:48.208 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2022-08-05T15:21:48.310 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:48.312 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2022-08-05T15:21:48.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:48.392 DEBUG:teuthology.orchestra.run.smithi142:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2022-08-05T15:21:48.487 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:48.488 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2022-08-05T15:21:48.767 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:48.768 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2022-08-05T15:21:48.933 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:48.933 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2022-08-05T15:21:49.028 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:49.029 DEBUG:teuthology.orchestra.run.smithi191:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2022-08-05T15:21:49.125 INFO:tasks.ceph:Archiving mon data... 2022-08-05T15:21:49.127 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/data/mon.a.tgz 2022-08-05T15:21:49.135 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-08-05T15:21:49.197 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.ZESOUHBh3R 2022-08-05T15:21:49.197 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZESOUHBh3R 2022-08-05T15:21:49.303 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.ZESOUHBh3R 2022-08-05T15:21:49.442 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.ZESOUHBh3R is 128KB 2022-08-05T15:21:49.543 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.ZESOUHBh3R 2022-08-05T15:21:49.573 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/data/mon.c.tgz 2022-08-05T15:21:49.575 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-08-05T15:21:49.632 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.ayy6UwhMOZ 2022-08-05T15:21:49.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ayy6UwhMOZ 2022-08-05T15:21:49.733 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.ayy6UwhMOZ 2022-08-05T15:21:49.848 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.ayy6UwhMOZ is 182KB 2022-08-05T15:21:49.952 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.ayy6UwhMOZ 2022-08-05T15:21:49.982 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/data/mon.b.tgz 2022-08-05T15:21:49.983 DEBUG:teuthology.orchestra.run.smithi191:> mktemp 2022-08-05T15:21:50.016 INFO:teuthology.orchestra.run.smithi191.stdout:/tmp/tmp.m54je3RpA9 2022-08-05T15:21:50.017 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.m54je3RpA9 2022-08-05T15:21:50.125 DEBUG:teuthology.orchestra.run.smithi191:> sudo chmod 0666 /tmp/tmp.m54je3RpA9 2022-08-05T15:21:50.246 DEBUG:teuthology.orchestra.remote:smithi191:/tmp/tmp.m54je3RpA9 is 182KB 2022-08-05T15:21:50.374 DEBUG:teuthology.orchestra.run.smithi191:> rm -fr /tmp/tmp.m54je3RpA9 2022-08-05T15:21:50.399 INFO:tasks.ceph:Cleaning ceph cluster... 2022-08-05T15:21:50.400 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-08-05T15:21:50.405 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-08-05T15:21:50.491 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2022-08-05T15:21:50.493 DEBUG:teuthology.orchestra.run.smithi142:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-08-05T15:21:50.509 DEBUG:teuthology.orchestra.run.smithi191:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-08-05T15:21:50.547 INFO:teuthology.orchestra.run.smithi142.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-08-05T15:21:50.585 INFO:teuthology.orchestra.run.smithi191.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-08-05T15:21:50.622 INFO:tasks.ceph:Archiving crash dumps... 2022-08-05T15:21:50.632 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi142/crash 2022-08-05T15:21:50.641 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-08-05T15:21:50.695 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi191/crash 2022-08-05T15:21:50.697 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-08-05T15:21:50.735 INFO:tasks.ceph:Compressing logs... 2022-08-05T15:21:50.736 DEBUG:teuthology.orchestra.run.smithi142:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:21:50.740 DEBUG:teuthology.orchestra.run.smithi191:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:21:50.883 INFO:tasks.ceph:Archiving logs... 2022-08-05T15:21:50.885 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi142/log 2022-08-05T15:21:50.903 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /var/log/ceph -- . 2022-08-05T15:21:51.085 DEBUG:teuthology.misc:Transferring archived files from smithi191:/var/log/ceph to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi191/log 2022-08-05T15:21:51.104 DEBUG:teuthology.orchestra.run.smithi191:> sudo tar cz -f - -C /var/log/ceph -- . 2022-08-05T15:21:51.212 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:21:51.865 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=bbe4cbd50ece4f6785d78a850f593f45 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:21:51.870 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2022-08-05T15:21:51.897 DEBUG:teuthology.run_tasks:Unwinding manager install 2022-08-05T15:21:51.915 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2022-08-05T15:21:51.916 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-08-05T15:21:51.979 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-08-05T15:21:52.122 DEBUG:teuthology.run_tasks:Unwinding manager clock 2022-08-05T15:21:52.140 INFO:teuthology.task.clock:Checking final clock skew... 2022-08-05T15:21:52.141 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:21:52.161 DEBUG:teuthology.orchestra.run.smithi191:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:21:52.176 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2022-08-05T15:21:52.181 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-05T15:21:52.189 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2022-08-05T15:21:52.191 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 34 -1066us[-1082us] +/- 103ms 2022-08-05T15:21:52.192 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 2 6 177 32 +107us[ +91us] +/- 43ms 2022-08-05T15:21:52.193 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 33 +596us[ +579us] +/- 79ms 2022-08-05T15:21:52.194 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:21:52.195 INFO:teuthology.orchestra.run.smithi191.stderr:bash: ntpq: command not found 2022-08-05T15:21:52.232 INFO:teuthology.orchestra.run.smithi191.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-08-05T15:21:52.233 INFO:teuthology.orchestra.run.smithi191.stdout:=============================================================================== 2022-08-05T15:21:52.271 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv01.front.sepia.ceph.com 3 6 177 34 -1085us[-1085us] +/- 103ms 2022-08-05T15:21:52.279 INFO:teuthology.orchestra.run.smithi191.stdout:^* hv02.front.sepia.ceph.com 2 6 177 34 +95us[ +62us] +/- 43ms 2022-08-05T15:21:52.279 INFO:teuthology.orchestra.run.smithi191.stdout:^+ hv03.front.sepia.ceph.com 3 6 177 34 +565us[ +565us] +/- 79ms 2022-08-05T15:21:52.280 INFO:teuthology.orchestra.run.smithi191.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2022-08-05T15:21:52.280 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2022-08-05T15:21:52.308 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2022-08-05T15:21:52.311 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2022-08-05T15:21:52.336 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2022-08-05T15:21:52.423 DEBUG:teuthology.orchestra.run.smithi191:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2022-08-05T15:21:52.512 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-05T15:21:52.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:52.546 DEBUG:teuthology.orchestra.run.smithi191:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-08-05T15:21:52.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:21:52.589 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2022-08-05T15:21:52.663 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2022-08-05T15:21:52.684 INFO:teuthology.task.internal:Duration was 965.681026 seconds 2022-08-05T15:21:52.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2022-08-05T15:21:52.726 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2022-08-05T15:21:52.727 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-08-05T15:21:52.733 DEBUG:teuthology.orchestra.run.smithi191:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-08-05T15:21:52.779 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-05T15:21:52.783 INFO:teuthology.orchestra.run.smithi191.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-08-05T15:21:53.289 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2022-08-05T15:21:53.290 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2022-08-05T15:21:53.312 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-08-05T15:21:53.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi191.front.sepia.ceph.com 2022-08-05T15:21:53.380 DEBUG:teuthology.orchestra.run.smithi191:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-08-05T15:21:53.428 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2022-08-05T15:21:53.429 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:21:53.459 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:21:53.513 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2022-08-05T15:21:53.514 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-08-05T15:21:53.570 DEBUG:teuthology.orchestra.run.smithi191:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-08-05T15:21:53.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2022-08-05T15:21:53.697 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2022-08-05T15:21:53.699 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-08-05T15:21:53.755 DEBUG:teuthology.orchestra.run.smithi191:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-08-05T15:21:53.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2022-08-05T15:21:53.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:21:53.853 DEBUG:teuthology.orchestra.run.smithi191:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:21:53.890 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2022-08-05T15:21:53.912 INFO:teuthology.orchestra.run.smithi191.stdout:kernel.core_pattern = core 2022-08-05T15:21:53.916 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:21:53.981 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi142.front.sepia.ceph.com, flagging run as failed 2022-08-05T15:21:53.982 DEBUG:teuthology.orchestra.run.smithi191:> test -e /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:21:54.013 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi191.front.sepia.ceph.com, flagging run as failed 2022-08-05T15:21:54.014 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2022-08-05T15:21:54.055 INFO:teuthology.task.internal:Transferring archived files... 2022-08-05T15:21:54.058 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi142 2022-08-05T15:21:54.059 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-08-05T15:22:36.807 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2022-08-05T15:22:36.914 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398/remote/smithi142/coredump/1659712901.134244.core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 2', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/bin/ceph-osd', platform: 'x86_64' 2022-08-05T15:22:36.932 DEBUG:teuthology.orchestra.run.smithi142:> which ceph-osd 2022-08-05T15:22:36.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-osd 2022-08-05T15:22:37.053 DEBUG:teuthology.orchestra.remote:smithi142:/usr/bin/ceph-osd is 28MB 2022-08-05T15:22:42.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo lsb_release -is 2022-08-05T15:22:42.296 INFO:teuthology.orchestra.run.smithi142.stdout:CentOSStream 2022-08-05T15:22:42.297 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-08-05T15:22:42.301 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2022-08-05T15:22:42.407 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.Ly5hdUpME9 2022-08-05T15:22:42.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /usr/bin/ceph-osd.debug /tmp/tmp.Ly5hdUpME9 2022-08-05T15:22:42.502 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:22:42.502 INFO:teuthology.orchestra.run.smithi142.stderr:cp: cannot stat '/usr/bin/ceph-osd.debug': No such file or directory 2022-08-05T15:22:42.503 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 399, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 342, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/remote.py", line 593, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/remote.py", line 510, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph-osd.debug /tmp/tmp.Ly5hdUpME9' 2022-08-05T15:22:42.645 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2022-08-05T15:22:42.697 INFO:teuthology.task.internal:Not uploading archives. 2022-08-05T15:22:42.735 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2022-08-05T15:22:42.773 INFO:teuthology.task.internal:Tidying up after the test... 2022-08-05T15:22:42.776 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-08-05T15:22:42.825 DEBUG:teuthology.orchestra.run.smithi191:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-08-05T15:22:42.843 INFO:teuthology.orchestra.run.smithi142.stdout: 262206 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest 2022-08-05T15:22:42.843 INFO:teuthology.orchestra.run.smithi142.stdout: 262207 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive 2022-08-05T15:22:42.844 INFO:teuthology.orchestra.run.smithi142.stdout: 262209 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog 2022-08-05T15:22:42.847 INFO:teuthology.orchestra.run.smithi142.stdout: 262210 96 -rw-rw-r-- 1 ubuntu ubuntu 97841 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-08-05T15:22:42.847 INFO:teuthology.orchestra.run.smithi142.stdout: 262363 92 -rw-rw-rw- 1 ubuntu ubuntu 93774 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2022-08-05T15:22:42.847 INFO:teuthology.orchestra.run.smithi142.stdout: 262211 4 -rw-rw-rw- 1 ubuntu ubuntu 1062 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2022-08-05T15:22:42.850 INFO:teuthology.orchestra.run.smithi142.stdout: 262208 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:22:42.850 INFO:teuthology.orchestra.run.smithi142.stdout: 263748 13272 -rw------- 1 root root 98394112 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134244.core 2022-08-05T15:22:42.850 INFO:teuthology.orchestra.run.smithi142.stdout: 263746 13608 -rw------- 1 root root 98394112 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134225.core 2022-08-05T15:22:42.851 INFO:teuthology.orchestra.run.smithi142.stdout: 263747 15964 -rw------- 1 root root 98394112 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134247.core 2022-08-05T15:22:42.851 INFO:teuthology.orchestra.run.smithi142.stdout: 530326 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/audit 2022-08-05T15:22:42.852 INFO:teuthology.orchestra.run.smithi142.stdout: 530595 212 -rw------- 1 ubuntu ubuntu 216028 Aug 5 15:21 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2022-08-05T15:22:42.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:22:42.890 INFO:teuthology.orchestra.run.smithi142.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2022-08-05T15:22:42.892 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 399, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 342, in fetch_binaries_for_coredumps remote.get_file(debug_path, coredump_path) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/remote.py", line 593, in get_file self.run(args=args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/remote.py", line 510, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph-osd.debug /tmp/tmp.Ly5hdUpME9' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 188, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/task/internal/__init__.py", line 58, in base wait=False, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi142 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2022-08-05T15:22:42.929 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2022-08-05T15:22:42.953 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi142 with status 1: 'sudo cp /usr/bin/ceph-osd.debug /tmp/tmp.Ly5hdUpME9' 2022-08-05T15:22:42.954 INFO:teuthology.nuke:Checking targets against current locks 2022-08-05T15:22:42.977 INFO:teuthology.orchestra.run.smithi191.stdout: 262206 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest 2022-08-05T15:22:42.978 INFO:teuthology.orchestra.run.smithi191.stdout: 262207 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive 2022-08-05T15:22:42.978 INFO:teuthology.orchestra.run.smithi191.stdout: 262209 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog 2022-08-05T15:22:42.979 INFO:teuthology.orchestra.run.smithi191.stdout: 262210 96 -rw-rw-r-- 1 ubuntu ubuntu 96809 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-08-05T15:22:42.980 INFO:teuthology.orchestra.run.smithi191.stdout: 262439 92 -rw-rw-rw- 1 ubuntu ubuntu 91893 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2022-08-05T15:22:43.024 INFO:teuthology.orchestra.run.smithi191.stdout: 262211 4 -rw-rw-rw- 1 ubuntu ubuntu 1105 Aug 5 15:21 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2022-08-05T15:22:43.025 INFO:teuthology.orchestra.run.smithi191.stdout: 262208 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:22:43.028 INFO:teuthology.orchestra.run.smithi191.stdout: 263758 12724 -rw------- 1 root root 98394112 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134079.core 2022-08-05T15:22:43.029 INFO:teuthology.orchestra.run.smithi191.stdout: 263755 15284 -rw------- 1 root root 98398208 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134091.core 2022-08-05T15:22:43.029 INFO:teuthology.orchestra.run.smithi191.stdout: 263756 13592 -rw------- 1 root root 98390016 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134074.core 2022-08-05T15:22:43.029 INFO:teuthology.orchestra.run.smithi191.stdout: 263757 13684 -rw------- 1 root root 98390016 Aug 5 15:21 /home/ubuntu/cephtest/archive/coredump/1659712901.134115.core 2022-08-05T15:22:43.030 INFO:teuthology.orchestra.run.smithi191.stdout: 530297 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Aug 5 15:21 /home/ubuntu/cephtest/archive/audit 2022-08-05T15:22:43.030 INFO:teuthology.orchestra.run.smithi191.stdout: 530566 212 -rw------- 1 ubuntu ubuntu 214701 Aug 5 15:21 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2022-08-05T15:22:43.076 INFO:teuthology.orchestra.run.smithi191.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2022-08-05T15:22:43.147 DEBUG:teuthology.nuke:shortname: smithi142 2022-08-05T15:22:43.149 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-05T15:22:43.272 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 14:51:57.807239', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0G51TIUs1Te9w/irRkV++8fsy+oO4Sq/MxBYMUjgVlw/k8zOFoebRUmfs18Cvg1hXm5fdG4P239ymHW9TgMxtgEHXKjJx2rfRtH7kbfl18oWXFm8rXnYpFkmV92F56oCo6O1BcEy1Bm8EU3YwXJHYZcmSfk0sHbu68GORquDIMgBuOgy96VuZtUimTWS3nq4dH+Kqq9EhBLb9PYH477ocMAvpm9o7UZ4w50pOxLJjXfGJh/xmYapt8qJoB1Yz4zeXfwQHTxIUg6rkYwyKtBeEjVK3JtdN+Jar7Gl55LIkiWGegbX+7tOGfaeorYXJ/FkCG2Ap7G/BBmQRvpH39yAufYqOBq7BTWuSVNDX1CsY9CtWG8Nzlw9eQoMtvALG89aGQ7zCfhWSY5rxYTKqUIPKDT2oMFrnWcd7lPNX7c0sKRvLU0LV9grcyepsxcjwaS7Ovns0sr3JU3J/YHb25aQPRLKpR0I093OF+yKxjTr8auZ4Q7JnIQaGb6JJ8LaxPFU='} 2022-08-05T15:22:43.321 DEBUG:teuthology.nuke:shortname: smithi191 2022-08-05T15:22:43.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-05T15:22:43.461 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi191.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959398', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 14:51:57.808752', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDrx/AZ06i0m8z/Mh93OCPegr7IIVhRZm8FId+cwwnHHGJjB84Zn8z0gASxKMl4S84PiQnffagUDI4U0Xn1a5Ze2lCpOTBKDfJS8BVDljL/G7+Fherz1nOKUUWYDPLUMS7H0IFnvnZEiImq5NXxIafz/RJiSqZXIxY6tOmTNVu1kR5eW4WeSfC21G6yZSw/EwGfzgPtFtzreUtQvXa29PNzIV3IW+I7/ndsS3n6N3cLwovgbiO2uCW9tf+k3PrOjnSzQwZqCugj7079wGMM9Q2VrRM/Hd3w0jmAToRZbaZLm0h0H3u3ahtOehJoi3LivSZSWi3m4RJ8/owm4o4Z0GnYyigQBskXiiNDKXyfaqFTW7U4Gj8qodbK0ulmrTqAkiCfxThmeWoCnUeV/HazSYimmliwSsf8Tkb8AK+mtSMD9h+2fwBUeUXylGUl2+jvCNoPZKt2BPD/ERkJW5YFoMkfSGinMPebF+cy9iEGJwf0wa20EmAT6tu+LOgjzL5BIQc='} 2022-08-05T15:22:43.839 INFO:teuthology.orchestra.console:Power off smithi142 2022-08-05T15:22:43.841 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2022-08-05T15:22:43.949 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:44.164 INFO:teuthology.orchestra.console:Power off smithi191 2022-08-05T15:22:44.215 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2022-08-05T15:22:44.266 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:48.263 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:48.379 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:52.535 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:52.636 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:52.847 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-08-05T15:22:56.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T15:22:57.085 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2022-08-05T15:22:57.216 INFO:teuthology.run:Summary data: description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} duration: 965.6810262203217 failure_reason: 'Command failed on smithi142 with status 1: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=bbe4cbd50ece4f6785d78a850f593f45 status: fail success: false 2022-08-05T15:22:57.217 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-08-05T15:22:57.330 INFO:teuthology.run:FAIL