2023-01-25T04:28:41.325 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T04:28:41.326 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760 --description rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} --name yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760/orig.config.yaml 2023-01-25T04:28:41.372 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T04:28:41.437 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760 branch: wip-yuri-testing-2023-01-23-0926 description: rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} email: yweinstein@radhat.com first_in_suite: false job_id: '7136760' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri-testing-2023-01-23-0926 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - \(MON_DOWN\) sha1: b0d2592529629ab4f86fed5991e556a87dcda563 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0d2592529629ab4f86fed5991e556a87dcda563 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-01-23-0926 sha1: b0d2592529629ab4f86fed5991e556a87dcda563 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - - osd.3 - osd.4 - osd.5 - client.0 sha1: b0d2592529629ab4f86fed5991e556a87dcda563 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri-testing-2023-01-23-0926 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b0d2592529629ab4f86fed5991e556a87dcda563 targets: smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSKBKA9036Qhn2C354OVRNKzxqQ+w28M0QBPYUC5mRg8CEKlb9fHuhV1UKhyewZRtsRqABAr6VzLQhiarxmP+EFlXjN+KLXKJvi3zTPSavgs4lNRYoHfryvDe308Cocb+fcXYW+TOZ+LnUEiFGAYVPRyCew0GjRzBZn0rGHS4mOmK4U7xalU6zhl8jdUvIA/b0ov26PdpLrE5HSr9DSd+Erf+cB2BEQzG2AkXn2o7MqaF/lIgH9NqyWjs0C5p57s/Ie8U4s9gnjQ6eTQXavJLnRzNFNYOE8KkcF7rLLYxT63ztt4ahZlLJ9mHvpya7q2dup9Zvw6pDkPQGpidSI8L2RpmbvzZwbAfNFfo6G+otmw2FwP8bWR86CvizuatOziJ859Tki/VvuFd3KuoWaUYbPMF327gytGpG8fD0ZpcKZvfyHXjvlzX2MmrOY8jS2GAVHMcnDyLlDui+34vq1OfGfD5/lY9UcQI0gYG+vDnhXCq36tcJsLk17KoWugd7Lq0= smithi116.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+U7ZRiceaF5WRuH54Uwk2WT1/5oyO5nLjqrIQtin2Lf++jeYt53+lVaAxoHg7LnfCzhgYI2mvMuFCz4WkyLELPpCqT/p8yJKj4Z5rvRsDwWG2K/TOTs/obL5d9Bko7K7DZDpH/bJvZooExZ1IY5wdVal/GxALbCvsazgyScsPLxJsaQv8CKwHNOE0skPWxgHinaw48BufP9pN+rJxfklSZkOLceAvfeno32eMC5HqDQurlDdTKeRX/vAvDg7AXzZovh1c38qEtk2GMAxqKCr9NNvcJUf/aI6sn57jDDgAN2QTeqV1AgPTXZRWH0LEthuNeCQCCCL4M+FHgacRnc99qtlhT/ZmEPKfNosBDjHS9fzdSNL77j9oHjhRnyseP9FyI3gWzzdwuPHmfaI1I+6jIVn5mcm3tk2luWZPG5+FMirgVqKLlyEpWhWuXnw/t7jh0PGekzoqR/4o2T/1O73ZyBSBDujCCyrke4SldhVZQ292SM+Wb8av8LiD9CzUiec= tasks: - install: null - ceph: log-ignorelist: - but it is still running - slow request - overall HEALTH_ - \(CACHE_POOL_ pre-mgr-commands: - sudo ceph config set mgr mgr_pool false --force - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 500 - background_exec: mon.a: - while true - do sleep 30 - sudo ceph osd pool set cache cache_target_full_ratio .001 - echo cache-try-flush-evict-all - rados -p cache cache-try-flush-evict-all - sleep 5 - echo cache-flush-evict-all - rados -p cache cache-flush-evict-all - sleep 5 - echo remove overlay - sudo ceph osd tier remove-overlay base - sleep 20 - done - rados: clients: - client.0 max_seconds: 600 objects: 10000 op_weights: copy_from: 50 delete: 50 read: 100 write: 100 ops: 400000 pools: - base size: 1024 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:20:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T04:28:41.438 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa; will attempt to use it 2023-01-25T04:28:41.439 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa/tasks 2023-01-25T04:28:41.439 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T04:28:41.441 INFO:teuthology.task.internal:Checking packages... 2023-01-25T04:28:41.471 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0d2592529629ab4f86fed5991e556a87dcda563' 2023-01-25T04:28:41.472 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T04:28:41.472 INFO:teuthology.packaging:ref: None 2023-01-25T04:28:41.472 INFO:teuthology.packaging:tag: None 2023-01-25T04:28:41.473 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-01-23-0926 2023-01-25T04:28:41.473 INFO:teuthology.packaging:sha1: b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:28:41.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-01-23-0926 2023-01-25T04:28:41.620 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1959.gb0d25925 2023-01-25T04:28:41.620 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T04:28:41.628 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T04:28:41.628 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T04:28:41.712 INFO:teuthology.task.internal:Saving configuration 2023-01-25T04:28:41.731 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T04:28:41.768 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T04:28:41.795 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 04:23:34.856121', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIsbgejcOPH2O7wBuQHV7JDV3ykTzrJw4V0lQWZYOywK/IOCVVvRFGfuTNY7KN4Oy2Q0a/uJZDFIGhfdSxlqX/I='} 2023-01-25T04:28:41.821 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 04:23:34.854323', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKFQ1ojX+uxNrpYMBK9MeD0NJ1vGZHwXUWUQ4kmSEohH5a2esnYGrvJ4Zyx05MjbYMyDBJi5dbnQzAmxkzxTkQY='} 2023-01-25T04:28:41.822 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T04:28:41.833 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'] 2023-01-25T04:28:41.833 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['osd.3', 'osd.4', 'osd.5', 'client.0'] 2023-01-25T04:28:41.833 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T04:28:41.933 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7a30db1670>, signals=[15]) 2023-01-25T04:28:41.934 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T04:28:41.941 INFO:teuthology.task.internal:Opening connections... 2023-01-25T04:28:41.941 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:28:41.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:28:42.012 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:28:42.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:28:42.081 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T04:28:42.088 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-01-25T04:28:42.107 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-01-25T04:28:42.107 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-01-25T04:28:42.164 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2023-01-25T04:28:42.165 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8" 2023-01-25T04:28:42.165 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2023-01-25T04:28:42.165 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2023-01-25T04:28:42.165 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8" 2023-01-25T04:28:42.166 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8" 2023-01-25T04:28:42.166 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T04:28:42.166 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2023-01-25T04:28:42.166 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T04:28:42.166 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2023-01-25T04:28:42.167 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T04:28:42.167 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T04:28:42.167 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T04:28:42.168 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-01-25T04:28:42.187 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-01-25T04:28:42.207 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-01-25T04:28:42.207 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-01-25T04:28:42.267 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="CentOS Stream" 2023-01-25T04:28:42.267 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8" 2023-01-25T04:28:42.268 INFO:teuthology.orchestra.run.smithi116.stdout:ID="centos" 2023-01-25T04:28:42.268 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="rhel fedora" 2023-01-25T04:28:42.268 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8" 2023-01-25T04:28:42.268 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-01-25T04:28:42.268 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T04:28:42.269 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-01-25T04:28:42.269 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T04:28:42.269 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://centos.org/" 2023-01-25T04:28:42.269 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T04:28:42.269 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T04:28:42.270 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T04:28:42.270 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-01-25T04:28:42.286 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T04:28:42.296 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T04:28:42.337 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T04:28:42.337 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-01-25T04:28:42.339 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2023-01-25T04:28:42.358 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T04:28:42.370 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T04:28:42.371 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-01-25T04:28:42.397 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2023-01-25T04:28:42.426 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T04:28:42.497 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T04:28:42.514 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T04:28:42.514 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T04:28:42.515 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T04:28:42.516 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T04:28:42.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:28:42.532 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-01-25T04:28:42.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:28:42.534 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-01-25T04:28:42.589 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-408.el8.x86_64 2023-01-25T04:28:42.590 INFO:teuthology.task.kernel:Running kernel on smithi073: 4.18.0-408.el8.x86_64 2023-01-25T04:28:42.590 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2023-01-25T04:28:42.593 INFO:teuthology.orchestra.run.smithi116.stdout:4.18.0-408.el8.x86_64 2023-01-25T04:28:42.594 INFO:teuthology.task.kernel:Running kernel on smithi116: 4.18.0-408.el8.x86_64 2023-01-25T04:28:42.594 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum install -y kernel 2023-01-25T04:28:46.371 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - AppStream 28 MB/s | 27 MB 00:00 2023-01-25T04:28:46.426 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - AppStream 27 MB/s | 27 MB 00:01 2023-01-25T04:28:52.096 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - BaseOS 37 MB/s | 27 MB 00:00 2023-01-25T04:28:52.393 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - BaseOS 28 MB/s | 27 MB 00:00 2023-01-25T04:28:56.420 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Extras 130 kB/s | 18 kB 00:00 2023-01-25T04:28:56.742 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Extras 83 kB/s | 18 kB 00:00 2023-01-25T04:28:57.364 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - PowerTools 6.9 MB/s | 5.6 MB 00:00 2023-01-25T04:28:57.485 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - PowerTools 9.2 MB/s | 5.6 MB 00:00 2023-01-25T04:28:58.693 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-01-25T04:28:58.772 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-01-25T04:28:59.785 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-25T04:28:59.880 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-25T04:29:03.127 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 291 kB/s | 24 kB 00:00 2023-01-25T04:29:03.164 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 429 kB/s | 24 kB 00:00 2023-01-25T04:29:06.254 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T04:29:06.254 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T04:29:06.292 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T04:29:06.292 INFO:teuthology.orchestra.run.smithi116.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T04:29:06.429 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:29:06.430 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:29:06.430 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:29:06.431 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:29:06.431 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:29:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T04:29:06.431 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T04:29:06.432 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T04:29:06.432 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:06.432 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:29:06.432 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:29:06.432 INFO:teuthology.orchestra.run.smithi073.stdout:Install 3 Packages 2023-01-25T04:29:06.433 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:06.433 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 85 M 2023-01-25T04:29:06.433 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 94 M 2023-01-25T04:29:06.433 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:29:06.470 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:29:06.470 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:29:06.471 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:29:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:29:06.471 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:29:06.471 INFO:teuthology.orchestra.run.smithi116.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T04:29:06.472 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T04:29:06.472 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T04:29:06.472 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:06.472 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:29:06.473 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:29:06.473 INFO:teuthology.orchestra.run.smithi116.stdout:Install 3 Packages 2023-01-25T04:29:06.473 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:06.474 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 85 M 2023-01-25T04:29:06.474 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 94 M 2023-01-25T04:29:06.474 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:29:07.016 INFO:teuthology.orchestra.run.smithi073.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 16 MB/s | 9.2 MB 00:00 2023-01-25T04:29:07.345 INFO:teuthology.orchestra.run.smithi116.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 11 MB/s | 9.2 MB 00:00 2023-01-25T04:29:08.299 INFO:teuthology.orchestra.run.smithi073.stdout:(2/3): kernel-core-4.18.0-448.el8.x86_64.rpm 22 MB/s | 41 MB 00:01 2023-01-25T04:29:09.000 INFO:teuthology.orchestra.run.smithi073.stdout:(3/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 13 MB/s | 34 MB 00:02 2023-01-25T04:29:09.003 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:29:09.004 INFO:teuthology.orchestra.run.smithi073.stdout:Total 33 MB/s | 85 MB 00:02 2023-01-25T04:29:09.262 INFO:teuthology.orchestra.run.smithi116.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 12 MB/s | 34 MB 00:02 2023-01-25T04:29:09.631 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:29:09.662 INFO:teuthology.orchestra.run.smithi116.stdout:(3/3): kernel-core-4.18.0-448.el8.x86_64.rpm 13 MB/s | 41 MB 00:03 2023-01-25T04:29:09.665 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:29:09.665 INFO:teuthology.orchestra.run.smithi116.stdout:Total 26 MB/s | 85 MB 00:03 2023-01-25T04:29:10.016 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:29:10.016 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:29:10.302 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:29:10.683 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:29:10.683 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:29:12.077 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:29:12.118 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:29:12.760 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:29:12.797 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:29:14.831 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:29:15.411 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:15.506 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:29:16.053 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:19.221 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:19.852 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:19.947 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:20.361 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:23.219 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:23.594 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:23.674 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:23.920 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.279 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.305 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.906 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.932 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.941 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:45.941 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:45.941 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:46.475 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:46.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:46.476 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:29:46.476 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T04:29:46.476 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T04:29:46.476 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:46.477 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:29:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T04:29:46.532 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T04:29:46.584 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel --last | head -n 1 2023-01-25T04:29:46.822 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:29:23 AM UTC 2023-01-25T04:29:46.823 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:29:46.824 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T04:29:46.824 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T04:29:46.824 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T04:29:46.824 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T04:29:46.825 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T04:29:46.825 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel --last | head -n 1 2023-01-25T04:29:47.012 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:29:23 AM UTC 2023-01-25T04:29:47.014 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.015 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2023-01-25T04:29:47.048 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2023-01-25T04:29:47.048 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2023-01-25T04:29:47.048 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.02 2023-01-25T04:29:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 129.el8 2023-01-25T04:29:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2023-01-25T04:29:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T04:29:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:Group : System Environment/Base 2023-01-25T04:29:47.049 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 9265586 2023-01-25T04:29:47.050 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2023-01-25T04:29:47.050 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T04:29:47.050 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T04:29:47.050 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T04:29:47.050 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T04:29:47.051 INFO:teuthology.orchestra.run.smithi073.stdout:Relocations : (not relocatable) 2023-01-25T04:29:47.051 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : CentOS BuildSystem 2023-01-25T04:29:47.051 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2023-01-25T04:29:47.051 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T04:29:47.051 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2023-01-25T04:29:47.052 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2023-01-25T04:29:47.052 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:47.052 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T04:29:47.052 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T04:29:47.052 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T04:29:47.053 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2023-01-25T04:29:47.053 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:29:47.053 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T04:29:47.054 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T04:29:47.054 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.055 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T04:29:47.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T04:29:47.135 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:47.135 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:29:47.136 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T04:29:47.136 INFO:teuthology.orchestra.run.smithi116.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T04:29:47.136 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:47.136 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:29:47.240 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel --last | head -n 1 2023-01-25T04:29:47.435 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:29:23 AM UTC 2023-01-25T04:29:47.436 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.436 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.437 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T04:29:47.437 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T04:29:47.437 INFO:teuthology.task.kernel:Installing distro kernel on osd.3... 2023-01-25T04:29:47.437 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi116.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T04:29:47.438 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q kernel --last | head -n 1 2023-01-25T04:29:47.625 INFO:teuthology.orchestra.run.smithi116.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 04:29:23 AM UTC 2023-01-25T04:29:47.627 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.627 DEBUG:teuthology.orchestra.run.smithi116:> sudo rpm -qi grub2-tools 2023-01-25T04:29:47.660 INFO:teuthology.orchestra.run.smithi116.stdout:Name : grub2-tools 2023-01-25T04:29:47.660 INFO:teuthology.orchestra.run.smithi116.stdout:Epoch : 1 2023-01-25T04:29:47.660 INFO:teuthology.orchestra.run.smithi116.stdout:Version : 2.02 2023-01-25T04:29:47.661 INFO:teuthology.orchestra.run.smithi116.stdout:Release : 129.el8 2023-01-25T04:29:47.661 INFO:teuthology.orchestra.run.smithi116.stdout:Architecture: x86_64 2023-01-25T04:29:47.662 INFO:teuthology.orchestra.run.smithi116.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T04:29:47.662 INFO:teuthology.orchestra.run.smithi116.stdout:Group : System Environment/Base 2023-01-25T04:29:47.662 INFO:teuthology.orchestra.run.smithi116.stdout:Size : 9265586 2023-01-25T04:29:47.662 INFO:teuthology.orchestra.run.smithi116.stdout:License : GPLv3+ 2023-01-25T04:29:47.663 INFO:teuthology.orchestra.run.smithi116.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T04:29:47.663 INFO:teuthology.orchestra.run.smithi116.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T04:29:47.663 INFO:teuthology.orchestra.run.smithi116.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T04:29:47.663 INFO:teuthology.orchestra.run.smithi116.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T04:29:47.663 INFO:teuthology.orchestra.run.smithi116.stdout:Relocations : (not relocatable) 2023-01-25T04:29:47.664 INFO:teuthology.orchestra.run.smithi116.stdout:Packager : CentOS BuildSystem 2023-01-25T04:29:47.664 INFO:teuthology.orchestra.run.smithi116.stdout:Vendor : CentOS 2023-01-25T04:29:47.664 INFO:teuthology.orchestra.run.smithi116.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T04:29:47.665 INFO:teuthology.orchestra.run.smithi116.stdout:Summary : Support tools for GRUB. 2023-01-25T04:29:47.666 INFO:teuthology.orchestra.run.smithi116.stdout:Description : 2023-01-25T04:29:47.666 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:47.666 INFO:teuthology.orchestra.run.smithi116.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T04:29:47.666 INFO:teuthology.orchestra.run.smithi116.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T04:29:47.666 INFO:teuthology.orchestra.run.smithi116.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T04:29:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:hardware devices. 2023-01-25T04:29:47.667 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:29:47.667 INFO:teuthology.orchestra.run.smithi116.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T04:29:47.668 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T04:29:47.668 INFO:teuthology.task.kernel:Updating grub on smithi116 to boot 4.18.0-448.el8.x86_64 2023-01-25T04:29:47.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T04:29:48.393 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-01-25T04:29:48.956 INFO:teuthology.orchestra.run.smithi116.stderr:Generating grub configuration file ... 2023-01-25T04:29:50.134 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-01-25T04:29:50.136 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-01-25T04:29:50.161 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.vN5okZYoSe 2023-01-25T04:29:50.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vN5okZYoSe 2023-01-25T04:29:50.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.vN5okZYoSe 2023-01-25T04:29:50.390 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.vN5okZYoSe is 6KB 2023-01-25T04:29:50.439 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.vN5okZYoSe 2023-01-25T04:29:50.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T04:29:50.521 INFO:teuthology.orchestra.run.smithi073.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T04:29:50.521 INFO:teuthology.orchestra.run.smithi073.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T04:29:50.521 INFO:teuthology.orchestra.run.smithi073.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T04:29:50.522 INFO:teuthology.orchestra.run.smithi073.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T04:29:50.523 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T04:29:50.675 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2023-01-25T04:29:50.763 INFO:teuthology.orchestra.run.smithi116.stderr:done 2023-01-25T04:29:50.764 DEBUG:teuthology.orchestra.run.smithi116:> mktemp 2023-01-25T04:29:50.805 INFO:teuthology.orchestra.run.smithi116.stdout:/tmp/tmp.IcZcAVVtpg 2023-01-25T04:29:50.806 DEBUG:teuthology.orchestra.run.smithi116:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.IcZcAVVtpg 2023-01-25T04:29:50.878 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0666 /tmp/tmp.IcZcAVVtpg 2023-01-25T04:29:51.027 DEBUG:teuthology.orchestra.remote:smithi116:/tmp/tmp.IcZcAVVtpg is 6KB 2023-01-25T04:29:51.076 DEBUG:teuthology.orchestra.run.smithi116:> rm -fr /tmp/tmp.IcZcAVVtpg 2023-01-25T04:29:51.093 DEBUG:teuthology.orchestra.run.smithi116:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T04:29:51.159 INFO:teuthology.orchestra.run.smithi116.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T04:29:51.159 INFO:teuthology.orchestra.run.smithi116.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T04:29:51.159 INFO:teuthology.orchestra.run.smithi116.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T04:29:51.160 INFO:teuthology.orchestra.run.smithi116.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T04:29:51.161 DEBUG:teuthology.orchestra.run.smithi116:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T04:29:51.308 DEBUG:teuthology.orchestra.run.smithi116:> sudo shutdown -r now 2023-01-25T04:30:20.706 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T04:30:20.706 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-25T04:30:20.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:30:21.311 INFO:teuthology.task.kernel:Checking client osd.3 for new kernel version... 2023-01-25T04:30:21.312 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-01-25T04:30:21.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:30:55.848 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.116 2023-01-25T04:31:20.732 DEBUG:teuthology.orchestra.remote:timed out 2023-01-25T04:31:25.852 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-01-25T04:31:25.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:31:33.583 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-01-25T04:31:33.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-01-25T04:31:33.920 INFO:teuthology.task.kernel:Checking kernel version of osd.3, want "4.18.0-448.el8.x86_64"... 2023-01-25T04:31:33.921 DEBUG:teuthology.orchestra.run.smithi116:> uname -r 2023-01-25T04:31:33.938 INFO:teuthology.orchestra.run.smithi116.stdout:4.18.0-448.el8.x86_64 2023-01-25T04:31:33.939 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T04:31:33.939 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T04:31:33.939 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T04:31:34.941 INFO:teuthology.task.kernel:Enabling kdb on osd.3... 2023-01-25T04:31:34.941 DEBUG:teuthology.orchestra.run.smithi116:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T04:31:35.037 INFO:teuthology.orchestra.run.smithi116.stdout:ttyS1 2023-01-25T04:31:35.062 DEBUG:teuthology.parallel:result is None 2023-01-25T04:31:50.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-25T04:31:50.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:31:51.028 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-01-25T04:31:51.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-25T04:31:51.279 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-448.el8.x86_64"... 2023-01-25T04:31:51.279 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-01-25T04:31:51.300 INFO:teuthology.orchestra.run.smithi073.stdout:4.18.0-448.el8.x86_64 2023-01-25T04:31:51.300 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T04:31:51.300 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T04:31:51.301 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T04:31:52.302 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T04:31:52.302 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T04:31:52.402 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2023-01-25T04:31:52.416 DEBUG:teuthology.parallel:result is None 2023-01-25T04:31:52.417 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T04:31:52.430 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T04:31:52.431 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T04:31:52.434 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T04:31:52.457 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T04:31:52.466 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T04:31:52.498 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T04:31:52.499 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T04:31:52.501 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T04:31:52.536 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T04:31:52.546 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T04:31:52.547 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T04:31:52.571 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T04:31:52.605 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:31:52.607 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:31:52.616 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:31:52.619 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T04:31:52.620 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T04:31:52.630 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T04:31:52.630 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T04:31:52.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T04:31:52.690 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T04:31:52.699 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T04:31:52.700 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T04:31:52.732 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T04:31:52.751 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:31:52.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:31:52.895 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:31:52.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:31:52.983 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:31:52.983 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T04:31:53.050 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:31:53.100 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T04:31:53.147 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:31:53.232 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T04:31:53.275 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:31:53.275 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T04:31:53.343 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-01-25T04:31:53.345 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2023-01-25T04:31:53.407 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T04:31:53.449 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T04:31:53.820 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T04:31:53.830 INFO:teuthology.task.internal:Starting timer... 2023-01-25T04:31:53.830 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T04:31:53.910 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T04:31:53.934 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T04:31:53.935 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2023-01-25T04:31:54.054 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2023-01-25T04:31:54.057 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2023-01-25T04:31:54.129 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2023-01-25T04:31:54.131 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T04:31:54.131 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2023-01-25T04:31:54.168 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2023-01-25T04:31:54.169 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2023-01-25T04:31:54.192 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2023-01-25T04:31:54.193 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi073.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2023-01-25T04:31:54.193 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T04:31:54.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:31:54.237 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T04:31:54.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T04:31:54.266 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T04:31:54.266 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2023-01-25T04:31:54.314 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2023-01-25T04:31:54.354 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T04:31:54.365 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T04:31:54.365 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T04:31:54.382 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T04:31:54.384 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi073.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T04:38:17.897 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi073.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2023-01-25T04:38:17.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-01-25T04:38:17.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:38:17.969 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-01-25T04:38:18.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-01-25T04:38:18.041 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T04:38:18.109 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-01-25T04:38:18.182 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T04:38:18.196 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T04:38:18.196 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T04:38:18.197 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T04:38:18.201 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T04:38:18.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T04:38:18.232 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T04:38:18.246 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T04:38:18.254 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T04:38:18.268 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T04:38:18.313 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2023-01-25T04:38:18.322 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2023-01-25T04:38:18.336 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T04:38:18.338 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2023-01-25T04:38:18.349 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T04:38:18.350 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2023-01-25T04:38:18.364 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T04:38:18.378 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T04:38:18.422 INFO:teuthology.orchestra.run.smithi073.stderr:bash: ntpq: command not found 2023-01-25T04:38:18.426 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T04:38:18.427 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2023-01-25T04:38:18.427 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.428 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.428 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.428 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.446 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2023-01-25T04:38:18.449 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T04:38:18.450 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2023-01-25T04:38:18.450 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.450 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.450 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.451 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T04:38:18.451 INFO:teuthology.run_tasks:Running task install... 2023-01-25T04:38:18.462 DEBUG:teuthology.task.install:project ceph 2023-01-25T04:38:18.462 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}} 2023-01-25T04:38:18.463 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'} 2023-01-25T04:38:18.463 INFO:teuthology.task.install:Using flavor: default 2023-01-25T04:38:18.470 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T04:38:18.470 INFO:teuthology.task.install:extra packages: [] 2023-01-25T04:38:18.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2023-01-25T04:38:18.508 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2023-01-25T04:38:18.509 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:38:18.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2023-01-25T04:38:18.510 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'tag': None, 'wait_for_package': False} 2023-01-25T04:38:18.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2023-01-25T04:38:18.548 INFO:teuthology.orchestra.run.smithi116.stdout:CentOSStream 2023-01-25T04:38:18.549 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:38:18.550 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'tag': None, 'wait_for_package': False} 2023-01-25T04:38:18.550 DEBUG:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2023-01-25T04:38:18.586 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2023-01-25T04:38:18.587 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:38:18.588 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:38:18.626 INFO:teuthology.orchestra.run.smithi116.stdout:CentOSStream 2023-01-25T04:38:18.628 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:38:18.628 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:38:18.737 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/ 2023-01-25T04:38:18.737 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1959.gb0d25925 2023-01-25T04:38:18.783 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/ 2023-01-25T04:38:18.783 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1959.gb0d25925 2023-01-25T04:38:18.858 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T04:38:18.858 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:38:18.859 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T04:38:18.886 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T04:38:18.886 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0d2592529629ab4f86fed5991e556a87dcda563/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T04:38:18.904 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-01-23-0926/b0d2592529629ab4f86fed5991e556a87dcda563/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T04:38:18.904 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:38:18.905 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T04:38:18.932 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T04:38:18.932 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b0d2592529629ab4f86fed5991e556a87dcda563/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T04:38:18.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T04:38:18.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T04:38:19.032 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T04:38:19.077 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T04:38:19.099 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2023-01-25T04:38:19.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2023-01-25T04:38:19.143 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2023-01-25T04:38:19.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2023-01-25T04:38:19.358 INFO:teuthology.orchestra.run.smithi073.stdout:61 files removed 2023-01-25T04:38:19.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw 2023-01-25T04:38:19.399 INFO:teuthology.orchestra.run.smithi116.stdout:61 files removed 2023-01-25T04:38:19.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw 2023-01-25T04:38:20.076 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 284 kB/s | 80 kB 00:00 2023-01-25T04:38:20.113 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 289 kB/s | 80 kB 00:00 2023-01-25T04:38:20.360 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 38 kB/s | 9.3 kB 00:00 2023-01-25T04:38:20.397 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 38 kB/s | 9.3 kB 00:00 2023-01-25T04:38:20.644 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2023-01-25T04:38:20.673 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-01-25T04:38:21.396 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - AppStream 38 MB/s | 27 MB 00:00 2023-01-25T04:38:21.559 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - AppStream 32 MB/s | 27 MB 00:00 2023-01-25T04:38:27.180 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - BaseOS 37 MB/s | 27 MB 00:00 2023-01-25T04:38:27.401 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - BaseOS 33 MB/s | 27 MB 00:00 2023-01-25T04:38:31.496 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - Extras 115 kB/s | 18 kB 00:00 2023-01-25T04:38:31.691 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - Extras 155 kB/s | 18 kB 00:00 2023-01-25T04:38:31.881 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS-8 - PowerTools 22 MB/s | 5.6 MB 00:00 2023-01-25T04:38:32.085 INFO:teuthology.orchestra.run.smithi116.stdout:CentOS-8 - PowerTools 21 MB/s | 5.6 MB 00:00 2023-01-25T04:38:33.326 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-01-25T04:38:33.347 INFO:teuthology.orchestra.run.smithi073.stdout:Copr repo for python3-asyncssh owned by ceph 9.3 kB/s | 3.5 kB 00:00 2023-01-25T04:38:34.377 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 15 MB/s | 13 MB 00:00 2023-01-25T04:38:34.431 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2023-01-25T04:38:37.718 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 310 kB/s | 24 kB 00:00 2023-01-25T04:38:37.790 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 171 kB/s | 24 kB 00:00 2023-01-25T04:38:41.158 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:38:41.161 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:38:41.161 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:38:41.161 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:38:41.162 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:38:41.162 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 13 M 2023-01-25T04:38:41.162 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2023-01-25T04:38:41.162 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:38:41.163 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:38:41.163 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:38:41.163 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 5.2 M 2023-01-25T04:38:41.163 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 M 2023-01-25T04:38:41.163 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 k 2023-01-25T04:38:41.164 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T04:38:41.164 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 768 k 2023-01-25T04:38:41.164 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T04:38:41.164 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T04:38:41.164 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 474 k 2023-01-25T04:38:41.165 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T04:38:41.165 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.5 M 2023-01-25T04:38:41.165 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T04:38:41.165 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T04:38:41.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse 2023-01-25T04:38:41.166 INFO:teuthology.orchestra.run.smithi116.stdout: x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 45 k 2023-01-25T04:38:41.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 115 k 2023-01-25T04:38:41.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 190 k 2023-01-25T04:38:41.166 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 372 k 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 364 k 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 107 k 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:38:41.167 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:38:41.168 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:38:41.168 INFO:teuthology.orchestra.run.smithi116.stdout:Install 21 Packages 2023-01-25T04:38:41.168 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 2 Packages 2023-01-25T04:38:41.168 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:38:41.169 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 62 M 2023-01-25T04:38:41.171 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:38:41.398 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:38:41.401 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:38:41.401 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:38:41.402 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:38:41.402 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:38:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 13 M 2023-01-25T04:38:41.402 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2023-01-25T04:38:41.402 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:38:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.6 M 2023-01-25T04:38:41.403 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:38:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 5.2 M 2023-01-25T04:38:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 M 2023-01-25T04:38:41.403 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 24 k 2023-01-25T04:38:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T04:38:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 768 k 2023-01-25T04:38:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T04:38:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T04:38:41.404 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 474 k 2023-01-25T04:38:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T04:38:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.5 M 2023-01-25T04:38:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T04:38:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T04:38:41.405 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse 2023-01-25T04:38:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 45 k 2023-01-25T04:38:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 115 k 2023-01-25T04:38:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 190 k 2023-01-25T04:38:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T04:38:41.406 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 372 k 2023-01-25T04:38:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 364 k 2023-01-25T04:38:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 107 k 2023-01-25T04:38:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T04:38:41.407 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:38:41.408 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:38:41.408 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:38:41.408 INFO:teuthology.orchestra.run.smithi073.stdout:Install 21 Packages 2023-01-25T04:38:41.408 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 2 Packages 2023-01-25T04:38:41.408 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:38:41.409 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 62 M 2023-01-25T04:38:41.409 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:38:41.811 INFO:teuthology.orchestra.run.smithi116.stdout:(1/23): ceph-base-18.0.0-1959.gb0d25925.el8.x86 8.1 MB/s | 5.2 MB 00:00 2023-01-25T04:38:41.878 INFO:teuthology.orchestra.run.smithi116.stdout:(2/23): ceph-selinux-18.0.0-1959.gb0d25925.el8. 365 kB/s | 24 kB 00:00 2023-01-25T04:38:42.353 INFO:teuthology.orchestra.run.smithi116.stdout:(3/23): libcephfs2-18.0.0-1959.gb0d25925.el8.x8 1.6 MB/s | 768 kB 00:00 2023-01-25T04:38:42.470 INFO:teuthology.orchestra.run.smithi116.stdout:(4/23): libradosstriper1-18.0.0-1959.gb0d25925. 4.0 MB/s | 474 kB 00:00 2023-01-25T04:38:43.170 INFO:teuthology.orchestra.run.smithi116.stdout:(5/23): ceph-radosgw-18.0.0-1959.gb0d25925.el8. 6.5 MB/s | 13 MB 00:02 2023-01-25T04:38:43.246 INFO:teuthology.orchestra.run.smithi116.stdout:(6/23): python3-ceph-argparse-18.0.0-1959.gb0d2 595 kB/s | 45 kB 00:00 2023-01-25T04:38:43.329 INFO:teuthology.orchestra.run.smithi116.stdout:(7/23): python3-ceph-common-18.0.0-1959.gb0d259 1.3 MB/s | 115 kB 00:00 2023-01-25T04:38:43.446 INFO:teuthology.orchestra.run.smithi116.stdout:(8/23): librgw2-18.0.0-1959.gb0d25925.el8.x86_6 6.6 MB/s | 6.5 MB 00:00 2023-01-25T04:38:43.471 INFO:teuthology.orchestra.run.smithi116.stdout:(9/23): python3-cephfs-18.0.0-1959.gb0d25925.el 1.3 MB/s | 190 kB 00:00 2023-01-25T04:38:43.522 INFO:teuthology.orchestra.run.smithi116.stdout:(10/23): python3-rados-18.0.0-1959.gb0d25925.el 4.8 MB/s | 372 kB 00:00 2023-01-25T04:38:43.564 INFO:teuthology.orchestra.run.smithi116.stdout:(11/23): python3-rbd-18.0.0-1959.gb0d25925.el8. 3.9 MB/s | 364 kB 00:00 2023-01-25T04:38:43.589 INFO:teuthology.orchestra.run.smithi116.stdout:(12/23): python3-rgw-18.0.0-1959.gb0d25925.el8. 1.6 MB/s | 107 kB 00:00 2023-01-25T04:38:43.647 INFO:teuthology.orchestra.run.smithi116.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-01-25T04:38:43.673 INFO:teuthology.orchestra.run.smithi116.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.2 MB/s | 259 kB 00:00 2023-01-25T04:38:43.698 INFO:teuthology.orchestra.run.smithi116.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 866 kB/s | 44 kB 00:00 2023-01-25T04:38:43.723 INFO:teuthology.orchestra.run.smithi116.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 926 kB/s | 47 kB 00:00 2023-01-25T04:38:43.866 INFO:teuthology.orchestra.run.smithi116.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2023-01-25T04:38:43.924 INFO:teuthology.orchestra.run.smithi116.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-01-25T04:38:43.950 INFO:teuthology.orchestra.run.smithi116.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2023-01-25T04:38:43.957 INFO:teuthology.orchestra.run.smithi073.stdout:(1/23): ceph-base-18.0.0-1959.gb0d25925.el8.x86 2.0 MB/s | 5.2 MB 00:02 2023-01-25T04:38:44.024 INFO:teuthology.orchestra.run.smithi073.stdout:(2/23): ceph-selinux-18.0.0-1959.gb0d25925.el8. 365 kB/s | 24 kB 00:00 2023-01-25T04:38:44.133 INFO:teuthology.orchestra.run.smithi116.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-01-25T04:38:44.425 INFO:teuthology.orchestra.run.smithi073.stdout:(3/23): libcephfs2-18.0.0-1959.gb0d25925.el8.x8 1.9 MB/s | 768 kB 00:00 2023-01-25T04:38:44.442 INFO:teuthology.orchestra.run.smithi116.stdout:(21/23): librados2-18.0.0-1959.gb0d25925.el8.x8 7.4 MB/s | 3.6 MB 00:00 2023-01-25T04:38:44.667 INFO:teuthology.orchestra.run.smithi073.stdout:(4/23): libradosstriper1-18.0.0-1959.gb0d25925. 1.9 MB/s | 474 kB 00:00 2023-01-25T04:38:44.800 INFO:teuthology.orchestra.run.smithi116.stdout:(22/23): librbd1-18.0.0-1959.gb0d25925.el8.x86_ 5.3 MB/s | 3.6 MB 00:00 2023-01-25T04:38:45.034 INFO:teuthology.orchestra.run.smithi116.stdout:(23/23): ceph-common-18.0.0-1959.gb0d25925.el8. 6.3 MB/s | 24 MB 00:03 2023-01-25T04:38:45.037 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:38:45.038 INFO:teuthology.orchestra.run.smithi116.stdout:Total 16 MB/s | 62 MB 00:03 2023-01-25T04:38:45.077 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:38:45.121 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:38:45.122 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:38:45.717 INFO:teuthology.orchestra.run.smithi073.stdout:(5/23): ceph-radosgw-18.0.0-1959.gb0d25925.el8. 3.0 MB/s | 13 MB 00:04 2023-01-25T04:38:45.766 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:38:45.767 INFO:teuthology.orchestra.run.smithi073.stdout:(6/23): python3-ceph-argparse-18.0.0-1959.gb0d2 896 kB/s | 45 kB 00:00 2023-01-25T04:38:45.769 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:38:45.825 INFO:teuthology.orchestra.run.smithi073.stdout:(7/23): python3-ceph-common-18.0.0-1959.gb0d259 1.9 MB/s | 115 kB 00:00 2023-01-25T04:38:45.901 INFO:teuthology.orchestra.run.smithi073.stdout:(8/23): python3-cephfs-18.0.0-1959.gb0d25925.el 2.5 MB/s | 190 kB 00:00 2023-01-25T04:38:46.001 INFO:teuthology.orchestra.run.smithi073.stdout:(9/23): librgw2-18.0.0-1959.gb0d25925.el8.x86_6 4.9 MB/s | 6.5 MB 00:01 2023-01-25T04:38:46.060 INFO:teuthology.orchestra.run.smithi073.stdout:(10/23): python3-rados-18.0.0-1959.gb0d25925.el 2.3 MB/s | 372 kB 00:00 2023-01-25T04:38:46.110 INFO:teuthology.orchestra.run.smithi073.stdout:(11/23): python3-rgw-18.0.0-1959.gb0d25925.el8. 2.1 MB/s | 107 kB 00:00 2023-01-25T04:38:46.136 INFO:teuthology.orchestra.run.smithi073.stdout:(12/23): python3-rbd-18.0.0-1959.gb0d25925.el8. 2.7 MB/s | 364 kB 00:00 2023-01-25T04:38:46.194 INFO:teuthology.orchestra.run.smithi073.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-01-25T04:38:46.228 INFO:teuthology.orchestra.run.smithi073.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.3 MB/s | 44 kB 00:00 2023-01-25T04:38:46.254 INFO:teuthology.orchestra.run.smithi073.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-01-25T04:38:46.278 INFO:teuthology.orchestra.run.smithi073.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 930 kB/s | 47 kB 00:00 2023-01-25T04:38:46.404 INFO:teuthology.orchestra.run.smithi073.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-01-25T04:38:46.471 INFO:teuthology.orchestra.run.smithi073.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-01-25T04:38:46.496 INFO:teuthology.orchestra.run.smithi073.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 817 kB/s | 75 kB 00:00 2023-01-25T04:38:46.663 INFO:teuthology.orchestra.run.smithi073.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 9.0 MB/s | 1.7 MB 00:00 2023-01-25T04:38:47.089 INFO:teuthology.orchestra.run.smithi073.stdout:(21/23): librados2-18.0.0-1959.gb0d25925.el8.x8 6.1 MB/s | 3.6 MB 00:00 2023-01-25T04:38:47.269 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:38:47.289 INFO:teuthology.orchestra.run.smithi073.stdout:(22/23): librbd1-18.0.0-1959.gb0d25925.el8.x86_ 5.7 MB/s | 3.6 MB 00:00 2023-01-25T04:38:47.471 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T04:38:47.681 INFO:teuthology.orchestra.run.smithi073.stdout:(23/23): ceph-common-18.0.0-1959.gb0d25925.el8. 3.9 MB/s | 24 MB 00:06 2023-01-25T04:38:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:38:47.684 INFO:teuthology.orchestra.run.smithi073.stdout:Total 9.8 MB/s | 62 MB 00:06 2023-01-25T04:38:47.717 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T04:38:47.724 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:38:47.769 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:38:47.769 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:38:47.914 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:38:48.300 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:38:48.398 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:38:48.402 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:38:48.514 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:38:48.592 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:38:48.870 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:38:49.056 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:38:49.451 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:38:49.601 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:38:49.631 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:38:49.697 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:38:49.783 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T04:38:49.862 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T04:38:49.997 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T04:38:50.016 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:38:50.117 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:38:50.167 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:38:50.258 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 10/25 2023-01-25T04:38:50.499 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:38:50.562 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T04:38:50.766 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:38:50.790 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:38:50.872 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:38:50.955 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:38:51.023 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:38:51.114 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:38:51.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T04:38:51.317 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:38:51.713 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 6/25 2023-01-25T04:38:51.892 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:38:51.953 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:38:52.082 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T04:38:52.131 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T04:38:52.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:38:52.280 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 16/25 2023-01-25T04:38:52.331 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T04:38:52.353 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 16/25 2023-01-25T04:38:52.469 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 10/25 2023-01-25T04:38:52.554 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:38:52.693 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:38:52.763 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T04:38:52.942 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:38:52.964 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 19/25 2023-01-25T04:38:53.100 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:38:53.170 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 13/25 2023-01-25T04:38:53.367 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T04:38:54.158 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T04:38:54.316 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 16/25 2023-01-25T04:38:54.385 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 16/25 2023-01-25T04:38:54.574 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 17/25 2023-01-25T04:38:54.742 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T04:38:54.950 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 19/25 2023-01-25T04:38:56.692 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:57.147 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:57.760 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:58.119 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:38:58.208 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:38:58.396 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:38:58.909 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:59.133 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:59.720 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 20/25 2023-01-25T04:38:59.995 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:39:00.090 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 21/25 2023-01-25T04:39:00.275 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:39:17.752 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:39:17.753 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2023-01-25T04:39:17.753 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2023-01-25T04:39:17.753 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-01-25T04:39:17.753 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /run 2023-01-25T04:39:17.753 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2023-01-25T04:39:17.754 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2023-01-25T04:39:17.754 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2023-01-25T04:39:17.754 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2023-01-25T04:39:17.754 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-01-25T04:39:17.754 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:19.183 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:39:19.183 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2023-01-25T04:39:19.183 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2023-01-25T04:39:19.184 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-01-25T04:39:19.184 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /run 2023-01-25T04:39:19.184 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2023-01-25T04:39:19.184 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2023-01-25T04:39:19.185 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2023-01-25T04:39:19.185 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2023-01-25T04:39:19.185 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /dev 2023-01-25T04:39:19.185 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:19.208 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:39:19.228 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:39:19.228 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:39:19.429 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:39:19.429 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:20.132 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 1/25 2023-01-25T04:39:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2/25 2023-01-25T04:39:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:39:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:39:20.133 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:39:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 6/25 2023-01-25T04:39:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:39:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 8/25 2023-01-25T04:39:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 9/25 2023-01-25T04:39:20.134 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 10/25 2023-01-25T04:39:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:39:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:39:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 13/25 2023-01-25T04:39:20.135 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T04:39:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T04:39:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T04:39:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T04:39:20.136 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T04:39:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T04:39:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T04:39:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T04:39:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:39:20.137 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T04:39:20.138 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 24/25 2023-01-25T04:39:20.575 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:39:20.596 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 23/25 2023-01-25T04:39:20.596 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:39:20.798 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T04:39:20.799 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:20.968 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:20.969 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:20.969 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2023-01-25T04:39:20.969 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.969 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.970 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:39:20.970 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.970 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.970 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.970 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.971 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T04:39:20.971 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.971 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T04:39:20.971 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T04:39:20.971 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.972 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T04:39:20.972 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.972 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T04:39:20.972 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T04:39:20.972 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.973 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.973 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.973 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T04:39:20.973 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.973 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.974 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:20.974 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T04:39:20.974 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:20.974 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:39:21.266 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-test 2023-01-25T04:39:21.504 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 1/25 2023-01-25T04:39:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2/25 2023-01-25T04:39:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 3/25 2023-01-25T04:39:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 4/25 2023-01-25T04:39:21.505 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 5/25 2023-01-25T04:39:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_6 6/25 2023-01-25T04:39:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 7/25 2023-01-25T04:39:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8. 8/25 2023-01-25T04:39:21.506 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x8 9/25 2023-01-25T04:39:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 10/25 2023-01-25T04:39:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 11/25 2023-01-25T04:39:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 12/25 2023-01-25T04:39:21.507 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 13/25 2023-01-25T04:39:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T04:39:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T04:39:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T04:39:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T04:39:21.508 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 22/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T04:39:21.509 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 24/25 2023-01-25T04:39:21.998 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:44 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T04:39:22.364 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:22.365 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2023-01-25T04:39:22.365 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.366 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:39:22.366 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.367 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T04:39:22.368 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T04:39:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T04:39:22.369 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T04:39:22.370 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T04:39:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T04:39:22.371 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.372 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T04:39:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.373 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T04:39:22.374 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:22.375 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:39:22.707 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-test 2023-01-25T04:39:23.145 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:39:23.146 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:39:23.147 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:23.147 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:39:23.147 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 47 M 2023-01-25T04:39:23.147 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:39:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T04:39:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 137 k 2023-01-25T04:39:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T04:39:23.148 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2023-01-25T04:39:23.149 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:23.150 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 48 M 2023-01-25T04:39:23.150 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 218 M 2023-01-25T04:39:23.150 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:39:23.212 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 3.1 MB/s | 202 kB 00:00 2023-01-25T04:39:23.238 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2023-01-25T04:39:23.271 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T04:39:23.305 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-01-25T04:39:23.347 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): libcephsqlite-18.0.0-1959.gb0d25925.el8. 693 kB/s | 137 kB 00:00 2023-01-25T04:39:23.435 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:00:46 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:24.552 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:39:24.553 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:39:24.554 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:39:24.554 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:39:24.554 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:39:24.554 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 47 M 2023-01-25T04:39:24.555 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:39:24.555 INFO:teuthology.orchestra.run.smithi073.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T04:39:24.555 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 137 k 2023-01-25T04:39:24.555 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T04:39:24.555 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T04:39:24.556 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T04:39:24.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:24.556 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:39:24.556 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:39:24.556 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2023-01-25T04:39:24.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:24.557 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 48 M 2023-01-25T04:39:24.557 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 218 M 2023-01-25T04:39:24.558 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:39:24.615 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-01-25T04:39:24.649 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2023-01-25T04:39:24.674 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 13 MB/s | 323 kB 00:00 2023-01-25T04:39:24.699 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-01-25T04:39:25.149 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): libcephsqlite-18.0.0-1959.gb0d25925.el8. 231 kB/s | 137 kB 00:00 2023-01-25T04:39:25.589 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): ceph-test-18.0.0-1959.gb0d25925.el8.x86_ 19 MB/s | 47 MB 00:02 2023-01-25T04:39:25.591 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:39:25.592 INFO:teuthology.orchestra.run.smithi116.stdout:Total 20 MB/s | 48 MB 00:02 2023-01-25T04:39:25.635 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:39:25.655 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:39:25.656 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:39:25.960 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:39:25.964 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:39:26.420 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:39:26.682 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T04:39:26.911 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T04:39:27.133 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:39:27.210 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:39:27.420 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T04:39:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:39:32.260 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:39:32.507 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): ceph-test-18.0.0-1959.gb0d25925.el8.x86_ 6.0 MB/s | 47 MB 00:07 2023-01-25T04:39:32.510 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:39:32.510 INFO:teuthology.orchestra.run.smithi073.stdout:Total 6.1 MB/s | 48 MB 00:07 2023-01-25T04:39:32.552 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:39:32.573 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:39:32.573 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:39:32.587 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:39:32.863 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:39:32.866 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:39:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:39:32.881 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 1/6 2023-01-25T04:39:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2/6 2023-01-25T04:39:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T04:39:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T04:39:32.882 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T04:39:33.324 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:39:33.424 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T04:39:33.424 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:33.424 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:39:33.425 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:33.425 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-6.el8.x86_64 2023-01-25T04:39:33.425 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:33.425 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T04:39:33.425 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T04:39:33.426 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T04:39:33.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:33.426 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:39:33.575 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T04:39:33.646 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph 2023-01-25T04:39:33.776 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T04:39:33.927 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:39:34.021 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T04:39:34.197 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T04:39:34.335 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:39:34.382 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:00:57 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:35.522 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:39:35.525 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-01-25T04:39:35.525 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:39:35.526 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-01-25T04:39:35.526 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:39:35.526 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.4 k 2023-01-25T04:39:35.526 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:39:35.527 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 2.3 M 2023-01-25T04:39:35.527 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 1.5 M 2023-01-25T04:39:35.527 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 236 k 2023-01-25T04:39:35.527 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.9 M 2023-01-25T04:39:35.527 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 17 M 2023-01-25T04:39:35.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T04:39:35.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T04:39:35.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T04:39:35.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T04:39:35.528 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T04:39:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T04:39:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T04:39:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T04:39:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T04:39:35.529 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T04:39:35.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T04:39:35.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T04:39:35.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T04:39:35.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T04:39:35.530 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T04:39:35.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T04:39:35.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T04:39:35.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T04:39:35.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T04:39:35.531 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T04:39:35.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T04:39:35.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T04:39:35.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T04:39:35.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T04:39:35.532 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T04:39:35.533 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T04:39:35.533 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:35.533 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:39:35.533 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================= 2023-01-25T04:39:35.533 INFO:teuthology.orchestra.run.smithi116.stdout:Install 32 Packages 2023-01-25T04:39:35.534 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:35.534 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 28 M 2023-01-25T04:39:35.535 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 110 M 2023-01-25T04:39:35.535 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:39:35.657 INFO:teuthology.orchestra.run.smithi116.stdout:(1/32): ceph-18.0.0-1959.gb0d25925.el8.x86_64.r 51 kB/s | 6.4 kB 00:00 2023-01-25T04:39:35.924 INFO:teuthology.orchestra.run.smithi116.stdout:(2/32): ceph-mgr-18.0.0-1959.gb0d25925.el8.x86_ 3.9 MB/s | 1.5 MB 00:00 2023-01-25T04:39:36.000 INFO:teuthology.orchestra.run.smithi116.stdout:(3/32): ceph-mds-18.0.0-1959.gb0d25925.el8.x86_ 4.8 MB/s | 2.3 MB 00:00 2023-01-25T04:39:36.058 INFO:teuthology.orchestra.run.smithi116.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1959.gb0d2 3.9 MB/s | 236 kB 00:00 2023-01-25T04:39:36.134 INFO:teuthology.orchestra.run.smithi116.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-01-25T04:39:36.158 INFO:teuthology.orchestra.run.smithi116.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T04:39:36.184 INFO:teuthology.orchestra.run.smithi116.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T04:39:36.243 INFO:teuthology.orchestra.run.smithi116.stdout:(8/32): ceph-mon-18.0.0-1959.gb0d25925.el8.x86_ 6.6 MB/s | 3.9 MB 00:00 2023-01-25T04:39:36.268 INFO:teuthology.orchestra.run.smithi116.stdout:(9/32): python3-pytz-2017.2-9.el8.noarch.rpm 645 kB/s | 54 kB 00:00 2023-01-25T04:39:36.335 INFO:teuthology.orchestra.run.smithi116.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.7 MB/s | 237 kB 00:00 2023-01-25T04:39:36.377 INFO:teuthology.orchestra.run.smithi116.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.3 MB/s | 457 kB 00:00 2023-01-25T04:39:36.419 INFO:teuthology.orchestra.run.smithi116.stdout:(12/32): python3-cryptography-3.2.1-5.el8.x86_6 6.5 MB/s | 559 kB 00:00 2023-01-25T04:39:36.444 INFO:teuthology.orchestra.run.smithi116.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 1.6 MB/s | 109 kB 00:00 2023-01-25T04:39:36.587 INFO:teuthology.orchestra.run.smithi116.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2023-01-25T04:39:36.612 INFO:teuthology.orchestra.run.smithi116.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2023-01-25T04:39:36.695 INFO:teuthology.orchestra.run.smithi116.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.5 MB/s | 384 kB 00:00 2023-01-25T04:39:36.720 INFO:teuthology.orchestra.run.smithi116.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2023-01-25T04:39:36.746 INFO:teuthology.orchestra.run.smithi116.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-01-25T04:39:36.771 INFO:teuthology.orchestra.run.smithi116.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 348 kB/s | 18 kB 00:00 2023-01-25T04:39:36.796 INFO:teuthology.orchestra.run.smithi116.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 968 kB/s | 49 kB 00:00 2023-01-25T04:39:36.822 INFO:teuthology.orchestra.run.smithi116.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-01-25T04:39:36.872 INFO:teuthology.orchestra.run.smithi116.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-01-25T04:39:36.898 INFO:teuthology.orchestra.run.smithi116.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2023-01-25T04:39:36.922 INFO:teuthology.orchestra.run.smithi116.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 373 kB/s | 19 kB 00:00 2023-01-25T04:39:36.948 INFO:teuthology.orchestra.run.smithi116.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 473 kB/s | 24 kB 00:00 2023-01-25T04:39:36.973 INFO:teuthology.orchestra.run.smithi116.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 578 kB/s | 29 kB 00:00 2023-01-25T04:39:36.999 INFO:teuthology.orchestra.run.smithi116.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 546 kB/s | 27 kB 00:00 2023-01-25T04:39:37.174 INFO:teuthology.orchestra.run.smithi116.stdout:(28/32): ceph-osd-18.0.0-1959.gb0d25925.el8.x86 14 MB/s | 17 MB 00:01 2023-01-25T04:39:37.199 INFO:teuthology.orchestra.run.smithi116.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.0 MB/s | 241 kB 00:00 2023-01-25T04:39:37.225 INFO:teuthology.orchestra.run.smithi116.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.1 MB/s | 251 kB 00:00 2023-01-25T04:39:37.250 INFO:teuthology.orchestra.run.smithi116.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 457 kB/s | 23 kB 00:00 2023-01-25T04:39:37.333 INFO:teuthology.orchestra.run.smithi116.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 538 kB/s | 85 kB 00:00 2023-01-25T04:39:37.337 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:39:37.337 INFO:teuthology.orchestra.run.smithi116.stdout:Total 16 MB/s | 28 MB 00:01 2023-01-25T04:39:37.414 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:39:37.451 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:39:37.451 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:39:37.827 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:39:37.830 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:39:38.954 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 5/6 2023-01-25T04:39:39.051 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:39:39.240 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:39:39.303 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T04:39:39.536 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 6/6 2023-01-25T04:39:39.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 1/6 2023-01-25T04:39:39.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2/6 2023-01-25T04:39:39.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T04:39:39.537 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T04:39:39.538 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T04:39:39.572 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T04:39:39.820 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T04:39:40.064 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T04:39:40.064 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:40.064 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:39:40.065 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:40.065 INFO:teuthology.orchestra.run.smithi073.stdout: jq-1.6-6.el8.x86_64 2023-01-25T04:39:40.065 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:40.065 INFO:teuthology.orchestra.run.smithi073.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T04:39:40.065 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T04:39:40.066 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T04:39:40.066 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:40.066 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:39:40.154 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T04:39:40.305 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph 2023-01-25T04:39:40.360 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T04:39:40.557 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T04:39:40.792 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T04:39:40.987 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T04:39:41.034 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:04 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:41.210 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T04:39:41.523 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T04:39:41.785 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T04:39:42.008 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T04:39:42.190 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:39:42.193 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2023-01-25T04:39:42.193 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:39:42.194 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2023-01-25T04:39:42.194 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:39:42.194 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 6.4 k 2023-01-25T04:39:42.194 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:39:42.194 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 2.3 M 2023-01-25T04:39:42.195 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 1.5 M 2023-01-25T04:39:42.195 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 236 k 2023-01-25T04:39:42.195 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.9 M 2023-01-25T04:39:42.195 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 17 M 2023-01-25T04:39:42.195 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T04:39:42.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T04:39:42.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T04:39:42.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T04:39:42.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T04:39:42.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T04:39:42.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T04:39:42.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T04:39:42.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T04:39:42.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T04:39:42.197 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T04:39:42.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T04:39:42.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T04:39:42.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T04:39:42.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T04:39:42.198 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T04:39:42.199 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T04:39:42.200 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T04:39:42.200 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T04:39:42.200 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T04:39:42.200 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T04:39:42.200 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:42.201 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:39:42.201 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2023-01-25T04:39:42.201 INFO:teuthology.orchestra.run.smithi073.stdout:Install 32 Packages 2023-01-25T04:39:42.201 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:42.202 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 28 M 2023-01-25T04:39:42.202 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 110 M 2023-01-25T04:39:42.202 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:39:42.326 INFO:teuthology.orchestra.run.smithi073.stdout:(1/32): ceph-18.0.0-1959.gb0d25925.el8.x86_64.r 50 kB/s | 6.4 kB 00:00 2023-01-25T04:39:42.405 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T04:39:42.568 INFO:teuthology.orchestra.run.smithi073.stdout:(2/32): ceph-mds-18.0.0-1959.gb0d25925.el8.x86_ 6.1 MB/s | 2.3 MB 00:00 2023-01-25T04:39:42.602 INFO:teuthology.orchestra.run.smithi073.stdout:(3/32): ceph-mgr-18.0.0-1959.gb0d25925.el8.x86_ 3.8 MB/s | 1.5 MB 00:00 2023-01-25T04:39:42.686 INFO:teuthology.orchestra.run.smithi073.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1959.gb0d2 2.8 MB/s | 236 kB 00:00 2023-01-25T04:39:42.692 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T04:39:42.761 INFO:teuthology.orchestra.run.smithi073.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.0 MB/s | 157 kB 00:00 2023-01-25T04:39:42.786 INFO:teuthology.orchestra.run.smithi073.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T04:39:42.836 INFO:teuthology.orchestra.run.smithi073.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.0 MB/s | 103 kB 00:00 2023-01-25T04:39:42.879 INFO:teuthology.orchestra.run.smithi073.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-01-25T04:39:42.898 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T04:39:42.946 INFO:teuthology.orchestra.run.smithi073.stdout:(9/32): ceph-mon-18.0.0-1959.gb0d25925.el8.x86_ 6.3 MB/s | 3.9 MB 00:00 2023-01-25T04:39:42.988 INFO:teuthology.orchestra.run.smithi073.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.1 MB/s | 457 kB 00:00 2023-01-25T04:39:43.047 INFO:teuthology.orchestra.run.smithi073.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 9.3 MB/s | 559 kB 00:00 2023-01-25T04:39:43.088 INFO:teuthology.orchestra.run.smithi073.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.6 MB/s | 109 kB 00:00 2023-01-25T04:39:43.113 INFO:teuthology.orchestra.run.smithi073.stdout:(13/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.4 MB/s | 237 kB 00:00 2023-01-25T04:39:43.138 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T04:39:43.256 INFO:teuthology.orchestra.run.smithi073.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2023-01-25T04:39:43.281 INFO:teuthology.orchestra.run.smithi073.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.1 MB/s | 185 kB 00:00 2023-01-25T04:39:43.398 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:39:43.448 INFO:teuthology.orchestra.run.smithi073.stdout:(16/32): ceph-osd-18.0.0-1959.gb0d25925.el8.x86 19 MB/s | 17 MB 00:00 2023-01-25T04:39:43.474 INFO:teuthology.orchestra.run.smithi073.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 793 kB/s | 173 kB 00:00 2023-01-25T04:39:43.507 INFO:teuthology.orchestra.run.smithi073.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.7 MB/s | 384 kB 00:00 2023-01-25T04:39:43.533 INFO:teuthology.orchestra.run.smithi073.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 299 kB/s | 18 kB 00:00 2023-01-25T04:39:43.558 INFO:teuthology.orchestra.run.smithi073.stdout:(20/32): python3-jaraco-6.2-6.el8.noarch.rpm 101 kB/s | 11 kB 00:00 2023-01-25T04:39:43.583 INFO:teuthology.orchestra.run.smithi073.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 644 kB/s | 49 kB 00:00 2023-01-25T04:39:43.609 INFO:teuthology.orchestra.run.smithi073.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 777 kB/s | 59 kB 00:00 2023-01-25T04:39:43.634 INFO:teuthology.orchestra.run.smithi073.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 309 kB/s | 16 kB 00:00 2023-01-25T04:39:43.659 INFO:teuthology.orchestra.run.smithi073.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 371 kB/s | 19 kB 00:00 2023-01-25T04:39:43.684 INFO:teuthology.orchestra.run.smithi073.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 475 kB/s | 24 kB 00:00 2023-01-25T04:39:43.699 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T04:39:43.709 INFO:teuthology.orchestra.run.smithi073.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-01-25T04:39:43.727 INFO:teuthology.orchestra.run.smithi073.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 434 kB/s | 29 kB 00:00 2023-01-25T04:39:43.743 INFO:teuthology.orchestra.run.smithi073.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 466 kB/s | 27 kB 00:00 2023-01-25T04:39:43.786 INFO:teuthology.orchestra.run.smithi073.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2023-01-25T04:39:43.811 INFO:teuthology.orchestra.run.smithi073.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.9 MB/s | 251 kB 00:00 2023-01-25T04:39:43.836 INFO:teuthology.orchestra.run.smithi073.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 927 kB/s | 85 kB 00:00 2023-01-25T04:39:43.853 INFO:teuthology.orchestra.run.smithi073.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2023-01-25T04:39:43.856 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:39:43.856 INFO:teuthology.orchestra.run.smithi073.stdout:Total 17 MB/s | 28 MB 00:01 2023-01-25T04:39:43.933 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:39:43.961 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T04:39:43.970 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:39:43.970 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:39:44.166 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T04:39:44.351 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:39:44.354 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:39:44.394 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T04:39:44.679 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T04:39:44.935 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T04:39:45.199 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T04:39:45.547 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T04:39:45.581 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:39:45.848 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T04:39:45.919 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T04:39:46.083 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T04:39:46.303 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 27/32 2023-01-25T04:39:46.364 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T04:39:46.540 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:39:46.640 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T04:39:46.821 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T04:39:46.984 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T04:39:47.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T04:39:47.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T04:39:47.545 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T04:39:47.833 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T04:39:48.037 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:39:48.063 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T04:39:48.256 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:39:48.276 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T04:39:48.643 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:39:48.674 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T04:39:48.830 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:39:48.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T04:39:49.045 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:39:49.157 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T04:39:49.222 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:39:49.240 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:39:49.394 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:39:49.406 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T04:39:49.617 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:39:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:39:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 1/32 2023-01-25T04:39:49.812 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2/32 2023-01-25T04:39:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 3/32 2023-01-25T04:39:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 4/32 2023-01-25T04:39:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 5/32 2023-01-25T04:39:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 6/32 2023-01-25T04:39:49.813 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T04:39:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T04:39:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T04:39:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T04:39:49.814 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T04:39:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T04:39:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T04:39:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T04:39:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T04:39:49.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T04:39:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:39:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T04:39:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T04:39:49.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T04:39:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T04:39:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T04:39:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T04:39:49.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T04:39:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T04:39:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T04:39:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T04:39:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T04:39:49.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T04:39:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T04:39:49.819 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T04:39:49.908 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T04:39:50.130 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T04:39:50.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T04:39:50.554 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T04:39:50.771 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T04:39:50.808 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T04:39:50.809 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:50.809 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:39:50.809 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:50.809 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:50.809 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:50.810 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:39:50.810 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:50.810 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:50.810 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T04:39:50.810 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T04:39:50.811 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T04:39:50.811 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T04:39:50.811 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T04:39:50.811 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T04:39:50.811 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T04:39:50.812 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T04:39:50.812 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T04:39:50.812 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T04:39:50.812 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T04:39:50.812 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T04:39:50.813 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T04:39:50.813 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T04:39:50.813 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T04:39:50.813 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T04:39:50.813 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T04:39:50.814 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T04:39:50.814 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T04:39:50.814 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T04:39:50.814 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T04:39:50.814 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T04:39:50.815 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T04:39:50.815 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T04:39:50.815 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T04:39:50.815 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T04:39:50.815 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:50.816 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:39:51.017 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-base 2023-01-25T04:39:51.028 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T04:39:51.243 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T04:39:51.570 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T04:39:51.734 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:14 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:51.904 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T04:39:52.259 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 27/32 2023-01-25T04:39:52.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:39:52.759 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:39:52.859 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:39:52.860 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:39:52.860 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:39:53.332 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install cephadm 2023-01-25T04:39:53.968 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 28/32 2023-01-25T04:39:54.041 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:17 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:54.642 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:39:55.048 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 29/32 2023-01-25T04:39:55.167 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:39:55.168 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:55.168 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:39:55.168 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:55.169 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:39:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 82 k 2023-01-25T04:39:55.169 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:55.169 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:39:55.170 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:55.170 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:39:55.170 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:55.170 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 82 k 2023-01-25T04:39:55.170 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 374 k 2023-01-25T04:39:55.171 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:39:55.216 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:39:55.346 INFO:teuthology.orchestra.run.smithi116.stdout:cephadm-18.0.0-1959.gb0d25925.el8.noarch.rpm 464 kB/s | 82 kB 00:00 2023-01-25T04:39:55.347 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:39:55.347 INFO:teuthology.orchestra.run.smithi116.stdout:Total 461 kB/s | 82 kB 00:00 2023-01-25T04:39:55.348 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:39:55.355 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:39:55.356 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:39:55.357 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:39:55.360 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:39:55.420 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:39:55.430 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 30/32 2023-01-25T04:39:55.599 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:39:55.617 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 31/32 2023-01-25T04:39:55.714 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:39:56.153 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 32/32 2023-01-25T04:39:56.153 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 1/32 2023-01-25T04:39:56.153 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2/32 2023-01-25T04:39:56.154 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 3/32 2023-01-25T04:39:56.154 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 4/32 2023-01-25T04:39:56.154 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 5/32 2023-01-25T04:39:56.154 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8. 6/32 2023-01-25T04:39:56.154 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T04:39:56.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T04:39:56.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T04:39:56.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T04:39:56.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T04:39:56.155 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T04:39:56.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T04:39:56.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T04:39:56.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T04:39:56.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T04:39:56.156 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T04:39:56.157 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T04:39:56.158 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T04:39:56.158 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T04:39:56.158 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T04:39:56.158 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T04:39:56.159 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T04:39:56.159 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T04:39:56.159 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T04:39:56.159 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T04:39:56.974 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:39:57.069 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T04:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:57.070 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:57.071 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:39:57.071 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:57.071 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:39:57.071 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T04:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T04:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T04:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T04:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T04:39:57.072 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T04:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T04:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T04:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T04:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T04:39:57.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T04:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T04:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T04:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T04:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T04:39:57.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T04:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T04:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T04:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T04:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T04:39:57.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T04:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T04:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T04:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T04:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T04:39:57.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T04:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:39:57.077 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:39:57.146 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:39:57.277 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-base 2023-01-25T04:39:57.383 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:39:57.852 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:39:57.852 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:57.853 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:39:57.853 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:39:57.853 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:57.853 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:39:58.004 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:21 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:58.069 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T04:39:58.805 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:21 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:59.049 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-base-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:39:59.148 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:39:59.148 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:39:59.149 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:39:59.232 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install cephadm 2023-01-25T04:39:59.943 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:22 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:39:59.955 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:39:59.956 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2023-01-25T04:39:59.956 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:59.956 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:39:59.956 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 166 k 2023-01-25T04:39:59.957 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:59.957 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:39:59.957 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:39:59.957 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:39:59.958 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:39:59.958 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 166 k 2023-01-25T04:39:59.958 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 503 k 2023-01-25T04:39:59.959 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:00.152 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-immutable-object-cache-18.0.0-1959.gb0d259 851 kB/s | 166 kB 00:00 2023-01-25T04:40:00.152 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:00.153 INFO:teuthology.orchestra.run.smithi116.stdout:Total 846 kB/s | 166 kB 00:00 2023-01-25T04:40:00.153 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:00.164 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:00.164 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:00.216 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:00.220 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:00.341 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:00.545 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:00.975 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:01.089 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:01.089 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:01.090 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:01.090 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:01.090 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:01.090 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 82 k 2023-01-25T04:40:01.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:01.091 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:01.091 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:01.091 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:40:01.091 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:01.092 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 82 k 2023-01-25T04:40:01.092 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 374 k 2023-01-25T04:40:01.092 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:01.268 INFO:teuthology.orchestra.run.smithi073.stdout:cephadm-18.0.0-1959.gb0d25925.el8.noarch.rpm 466 kB/s | 82 kB 00:00 2023-01-25T04:40:01.268 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:01.269 INFO:teuthology.orchestra.run.smithi073.stdout:Total 462 kB/s | 82 kB 00:00 2023-01-25T04:40:01.269 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:01.276 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:01.277 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:01.278 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:01.281 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:01.332 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:01.430 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:01.430 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:01.431 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:01.431 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:01.431 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:01.431 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:01.613 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr 2023-01-25T04:40:02.341 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:02.868 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:03.031 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:03.270 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:03.376 INFO:teuthology.orchestra.run.smithi116.stdout:Package ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:03.477 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:03.478 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:40:03.478 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:03.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T04:40:03.740 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:03.740 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:03.740 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:03.741 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:03.741 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:03.741 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:04.027 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T04:40:04.279 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:27 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:04.762 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:27 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:05.422 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:05.423 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:05.423 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:05.424 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:05.424 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:05.424 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 1.7 M 2023-01-25T04:40:05.424 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:40:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 23 k 2023-01-25T04:40:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 15 k 2023-01-25T04:40:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T04:40:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T04:40:05.425 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T04:40:05.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:05.426 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:05.426 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:05.426 INFO:teuthology.orchestra.run.smithi116.stdout:Install 6 Packages 2023-01-25T04:40:05.426 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:05.427 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 2.0 M 2023-01-25T04:40:05.427 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 8.2 M 2023-01-25T04:40:05.427 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:05.643 INFO:teuthology.orchestra.run.smithi116.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1959.gb0d 106 kB/s | 23 kB 00:00 2023-01-25T04:40:05.669 INFO:teuthology.orchestra.run.smithi116.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1959.gb0d2 60 kB/s | 15 kB 00:00 2023-01-25T04:40:05.727 INFO:teuthology.orchestra.run.smithi116.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 509 kB/s | 43 kB 00:00 2023-01-25T04:40:05.803 INFO:teuthology.orchestra.run.smithi116.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1959.gb0d25925 4.6 MB/s | 1.7 MB 00:00 2023-01-25T04:40:05.862 INFO:teuthology.orchestra.run.smithi116.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 174 kB/s | 34 kB 00:00 2023-01-25T04:40:05.911 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:05.911 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2023-01-25T04:40:05.912 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:05.912 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:05.912 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 166 k 2023-01-25T04:40:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:05.913 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:05.913 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:05.913 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:40:05.913 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:05.914 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 166 k 2023-01-25T04:40:05.914 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 503 k 2023-01-25T04:40:05.914 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:05.969 INFO:teuthology.orchestra.run.smithi116.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 811 kB/s | 196 kB 00:00 2023-01-25T04:40:05.971 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:05.972 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.7 MB/s | 2.0 MB 00:00 2023-01-25T04:40:05.981 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:05.990 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:05.991 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:06.072 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:06.076 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:06.115 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-immutable-object-cache-18.0.0-1959.gb0d259 819 kB/s | 166 kB 00:00 2023-01-25T04:40:06.115 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:06.116 INFO:teuthology.orchestra.run.smithi073.stdout:Total 815 kB/s | 166 kB 00:00 2023-01-25T04:40:06.116 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:06.127 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:06.127 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:06.175 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:06.179 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:06.334 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:06.340 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:06.481 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:06.616 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T04:40:06.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T04:40:06.917 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:07.021 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T04:40:07.167 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 4/6 2023-01-25T04:40:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925. 1/1 2023-01-25T04:40:07.415 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:07.416 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:07.416 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:07.416 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:07.539 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 5/6 2023-01-25T04:40:07.609 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr 2023-01-25T04:40:07.786 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:40:08.078 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 1/6 2023-01-25T04:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 2/6 2023-01-25T04:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 3/6 2023-01-25T04:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T04:40:08.079 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T04:40:08.333 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:08.549 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T04:40:08.550 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:08.550 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:08.550 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:08.550 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:08.551 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:08.551 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T04:40:08.551 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T04:40:08.551 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T04:40:08.551 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:08.552 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:08.660 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T04:40:09.355 INFO:teuthology.orchestra.run.smithi073.stdout:Package ceph-mgr-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:09.375 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:09.455 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:09.456 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:40:09.456 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:09.542 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T04:40:10.261 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:10.523 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:10.524 INFO:teuthology.orchestra.run.smithi116.stdout:===================================================================================================== 2023-01-25T04:40:10.524 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:10.524 INFO:teuthology.orchestra.run.smithi116.stdout:===================================================================================================== 2023-01-25T04:40:10.524 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:10.525 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 7.4 M 2023-01-25T04:40:10.525 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:40:10.525 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T04:40:10.525 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T04:40:10.525 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T04:40:10.526 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T04:40:10.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T04:40:10.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T04:40:10.526 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T04:40:10.526 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:10.527 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:10.527 INFO:teuthology.orchestra.run.smithi116.stdout:===================================================================================================== 2023-01-25T04:40:10.527 INFO:teuthology.orchestra.run.smithi116.stdout:Install 8 Packages 2023-01-25T04:40:10.527 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:10.528 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 35 M 2023-01-25T04:40:10.528 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 210 M 2023-01-25T04:40:10.528 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:10.741 INFO:teuthology.orchestra.run.smithi116.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 22 MB/s | 4.7 MB 00:00 2023-01-25T04:40:10.809 INFO:teuthology.orchestra.run.smithi116.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2023-01-25T04:40:10.842 INFO:teuthology.orchestra.run.smithi116.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T04:40:10.926 INFO:teuthology.orchestra.run.smithi116.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 20 MB/s | 3.7 MB 00:00 2023-01-25T04:40:10.976 INFO:teuthology.orchestra.run.smithi116.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-01-25T04:40:11.010 INFO:teuthology.orchestra.run.smithi116.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-01-25T04:40:11.185 INFO:teuthology.orchestra.run.smithi116.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-195 11 MB/s | 7.4 MB 00:00 2023-01-25T04:40:11.327 INFO:teuthology.orchestra.run.smithi116.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 28 MB/s | 14 MB 00:00 2023-01-25T04:40:11.330 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:11.330 INFO:teuthology.orchestra.run.smithi116.stdout:Total 44 MB/s | 35 MB 00:00 2023-01-25T04:40:11.392 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:11.393 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:11.393 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:11.394 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:11.394 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:11.394 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 1.7 M 2023-01-25T04:40:11.394 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:40:11.394 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 23 k 2023-01-25T04:40:11.395 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 15 k 2023-01-25T04:40:11.395 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T04:40:11.395 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T04:40:11.395 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T04:40:11.395 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:11.396 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:11.396 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:11.396 INFO:teuthology.orchestra.run.smithi073.stdout:Install 6 Packages 2023-01-25T04:40:11.402 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:11.403 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 2.0 M 2023-01-25T04:40:11.403 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 8.2 M 2023-01-25T04:40:11.404 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:11.560 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:11.578 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:11.578 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:11.970 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:11.973 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:12.018 INFO:teuthology.orchestra.run.smithi073.stdout:(1/6): ceph-prometheus-alerts-18.0.0-1959.gb0d2 23 kB/s | 15 kB 00:00 2023-01-25T04:40:12.044 INFO:teuthology.orchestra.run.smithi073.stdout:(2/6): ceph-grafana-dashboards-18.0.0-1959.gb0d 35 kB/s | 23 kB 00:00 2023-01-25T04:40:12.102 INFO:teuthology.orchestra.run.smithi073.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 511 kB/s | 43 kB 00:00 2023-01-25T04:40:12.153 INFO:teuthology.orchestra.run.smithi073.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 310 kB/s | 34 kB 00:00 2023-01-25T04:40:12.195 INFO:teuthology.orchestra.run.smithi073.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1959.gb0d25925 2.2 MB/s | 1.7 MB 00:00 2023-01-25T04:40:12.295 INFO:teuthology.orchestra.run.smithi073.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-01-25T04:40:12.297 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:12.298 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.2 MB/s | 2.0 MB 00:00 2023-01-25T04:40:12.309 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:12.318 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:12.318 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:12.403 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:12.407 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:12.559 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:12.707 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:12.709 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:40:12.847 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:40:12.920 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T04:40:12.984 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:40:13.097 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T04:40:13.249 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T04:40:13.369 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 4/6 2023-01-25T04:40:13.585 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:40:13.734 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 5/6 2023-01-25T04:40:13.809 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:13.921 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:40:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 6/6 2023-01-25T04:40:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8. 1/6 2023-01-25T04:40:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarc 2/6 2023-01-25T04:40:14.223 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.n 3/6 2023-01-25T04:40:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T04:40:14.224 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T04:40:14.429 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:14.609 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:40:14.710 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T04:40:14.711 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:14.712 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:14.712 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T04:40:14.713 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T04:40:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T04:40:14.714 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:14.715 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:14.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T04:40:15.320 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:40:15.526 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:38 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:15.923 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:40:16.184 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:40:16.655 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:16.656 INFO:teuthology.orchestra.run.smithi073.stdout:===================================================================================================== 2023-01-25T04:40:16.656 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:16.656 INFO:teuthology.orchestra.run.smithi073.stdout:===================================================================================================== 2023-01-25T04:40:16.657 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:16.657 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 7.4 M 2023-01-25T04:40:16.657 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:40:16.657 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T04:40:16.657 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T04:40:16.658 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T04:40:16.658 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T04:40:16.658 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T04:40:16.658 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T04:40:16.658 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T04:40:16.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:16.659 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:16.659 INFO:teuthology.orchestra.run.smithi073.stdout:===================================================================================================== 2023-01-25T04:40:16.659 INFO:teuthology.orchestra.run.smithi073.stdout:Install 8 Packages 2023-01-25T04:40:16.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:16.660 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 35 M 2023-01-25T04:40:16.660 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 210 M 2023-01-25T04:40:16.660 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:16.854 INFO:teuthology.orchestra.run.smithi073.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 24 MB/s | 4.7 MB 00:00 2023-01-25T04:40:16.913 INFO:teuthology.orchestra.run.smithi073.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2023-01-25T04:40:16.946 INFO:teuthology.orchestra.run.smithi073.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T04:40:17.063 INFO:teuthology.orchestra.run.smithi073.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 18 MB/s | 3.7 MB 00:00 2023-01-25T04:40:17.105 INFO:teuthology.orchestra.run.smithi073.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-01-25T04:40:17.132 INFO:teuthology.orchestra.run.smithi073.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2023-01-25T04:40:17.331 INFO:teuthology.orchestra.run.smithi073.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-195 11 MB/s | 7.4 MB 00:00 2023-01-25T04:40:17.532 INFO:teuthology.orchestra.run.smithi073.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 23 MB/s | 14 MB 00:00 2023-01-25T04:40:17.534 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:17.535 INFO:teuthology.orchestra.run.smithi073.stdout:Total 40 MB/s | 35 MB 00:00 2023-01-25T04:40:17.766 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:17.784 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:17.785 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:17.958 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:40:18.173 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:18.177 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:18.757 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:18.920 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:40:19.050 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T04:40:19.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:40:19.209 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T04:40:19.467 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:40:19.771 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T04:40:19.815 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:40:19.815 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 1/8 2023-01-25T04:40:19.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T04:40:19.816 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:19.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T04:40:19.817 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:40:19.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T04:40:19.818 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T04:40:19.937 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T04:40:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:20.309 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:20.309 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T04:40:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T04:40:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T04:40:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T04:40:20.310 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T04:40:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T04:40:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T04:40:20.311 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:20.311 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:20.410 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-rook 2023-01-25T04:40:20.549 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:20.711 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:40:21.136 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:44 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:21.406 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T04:40:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:40:22.011 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:40:22.275 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:22.277 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================== 2023-01-25T04:40:22.277 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:22.277 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================== 2023-01-25T04:40:22.277 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 47 k 2023-01-25T04:40:22.278 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:40:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T04:40:22.278 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T04:40:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T04:40:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T04:40:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T04:40:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T04:40:22.279 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T04:40:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T04:40:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T04:40:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T04:40:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T04:40:22.280 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T04:40:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:22.281 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:22.281 INFO:teuthology.orchestra.run.smithi116.stdout:======================================================================================== 2023-01-25T04:40:22.281 INFO:teuthology.orchestra.run.smithi116.stdout:Install 13 Packages 2023-01-25T04:40:22.281 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:22.282 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 1.9 M 2023-01-25T04:40:22.282 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 25 M 2023-01-25T04:40:22.283 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:22.352 INFO:teuthology.orchestra.run.smithi116.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 372 kB/s | 27 kB 00:00 2023-01-25T04:40:22.377 INFO:teuthology.orchestra.run.smithi116.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 207 kB/s | 20 kB 00:00 2023-01-25T04:40:22.403 INFO:teuthology.orchestra.run.smithi116.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-01-25T04:40:22.428 INFO:teuthology.orchestra.run.smithi116.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T04:40:22.454 INFO:teuthology.orchestra.run.smithi116.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2023-01-25T04:40:22.478 INFO:teuthology.orchestra.run.smithi116.stdout:(6/13): ceph-mgr-rook-18.0.0-1959.gb0d25925.el8 239 kB/s | 47 kB 00:00 2023-01-25T04:40:22.504 INFO:teuthology.orchestra.run.smithi116.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 565 kB/s | 43 kB 00:00 2023-01-25T04:40:22.588 INFO:teuthology.orchestra.run.smithi116.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2023-01-25T04:40:22.613 INFO:teuthology.orchestra.run.smithi116.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 121 kB/s | 16 kB 00:00 2023-01-25T04:40:22.638 INFO:teuthology.orchestra.run.smithi116.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 606 kB/s | 81 kB 00:00 2023-01-25T04:40:22.688 INFO:teuthology.orchestra.run.smithi116.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-01-25T04:40:22.713 INFO:teuthology.orchestra.run.smithi116.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 613 kB/s | 61 kB 00:00 2023-01-25T04:40:22.789 INFO:teuthology.orchestra.run.smithi116.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.8 MB/s | 1.2 MB 00:00 2023-01-25T04:40:22.790 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:22.791 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.8 MB/s | 1.9 MB 00:00 2023-01-25T04:40:22.842 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:22.856 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:22.856 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:22.953 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:22.957 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:23.473 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:23.785 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T04:40:23.788 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T04:40:24.000 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T04:40:24.244 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T04:40:24.531 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T04:40:24.721 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T04:40:24.960 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T04:40:25.042 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T04:40:25.244 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:40:25.276 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T04:40:25.537 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T04:40:25.585 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 8/8 2023-01-25T04:40:25.585 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d2592 1/8 2023-01-25T04:40:25.585 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T04:40:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T04:40:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T04:40:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T04:40:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T04:40:25.586 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T04:40:26.104 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T04:40:26.104 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:26.104 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:26.105 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:26.105 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T04:40:26.105 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T04:40:26.105 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T04:40:26.105 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T04:40:26.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T04:40:26.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T04:40:26.106 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T04:40:26.106 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:26.106 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:26.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-rook 2023-01-25T04:40:26.655 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T04:40:26.934 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:49 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T04:40:27.932 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T04:40:28.070 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:28.071 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================== 2023-01-25T04:40:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:28.072 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================== 2023-01-25T04:40:28.072 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:28.072 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 47 k 2023-01-25T04:40:28.073 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:40:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T04:40:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T04:40:28.073 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T04:40:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T04:40:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T04:40:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T04:40:28.074 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T04:40:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T04:40:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T04:40:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T04:40:28.075 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T04:40:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T04:40:28.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:28.076 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:28.076 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================== 2023-01-25T04:40:28.076 INFO:teuthology.orchestra.run.smithi073.stdout:Install 13 Packages 2023-01-25T04:40:28.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:28.077 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 1.9 M 2023-01-25T04:40:28.078 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 25 M 2023-01-25T04:40:28.078 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:28.160 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T04:40:28.357 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:40:28.373 INFO:teuthology.orchestra.run.smithi073.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 89 kB/s | 27 kB 00:00 2023-01-25T04:40:28.607 INFO:teuthology.orchestra.run.smithi073.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 37 kB/s | 20 kB 00:00 2023-01-25T04:40:28.633 INFO:teuthology.orchestra.run.smithi073.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 489 kB/s | 126 kB 00:00 2023-01-25T04:40:28.658 INFO:teuthology.orchestra.run.smithi073.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T04:40:28.683 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:40:28.683 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 1/13 2023-01-25T04:40:28.683 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T04:40:28.684 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T04:40:28.684 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T04:40:28.684 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T04:40:28.685 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T04:40:28.685 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T04:40:28.685 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T04:40:28.685 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T04:40:28.685 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T04:40:28.686 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T04:40:28.686 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T04:40:28.686 INFO:teuthology.orchestra.run.smithi073.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.7 MB/s | 43 kB 00:00 2023-01-25T04:40:28.708 INFO:teuthology.orchestra.run.smithi073.stdout:(6/13): ceph-mgr-rook-18.0.0-1959.gb0d25925.el8 75 kB/s | 47 kB 00:00 2023-01-25T04:40:28.734 INFO:teuthology.orchestra.run.smithi073.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.5 MB/s | 155 kB 00:00 2023-01-25T04:40:28.818 INFO:teuthology.orchestra.run.smithi073.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 246 kB/s | 33 kB 00:00 2023-01-25T04:40:28.843 INFO:teuthology.orchestra.run.smithi073.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-25T04:40:28.868 INFO:teuthology.orchestra.run.smithi073.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 606 kB/s | 81 kB 00:00 2023-01-25T04:40:28.918 INFO:teuthology.orchestra.run.smithi073.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2023-01-25T04:40:28.944 INFO:teuthology.orchestra.run.smithi073.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 613 kB/s | 61 kB 00:00 2023-01-25T04:40:29.027 INFO:teuthology.orchestra.run.smithi073.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.6 MB/s | 1.2 MB 00:00 2023-01-25T04:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:29.029 INFO:teuthology.orchestra.run.smithi073.stdout:Total 2.0 MB/s | 1.9 MB 00:00 2023-01-25T04:40:29.084 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:29.100 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:29.198 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:29.201 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:29.257 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T04:40:29.257 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:29.257 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:29.257 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:29.258 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T04:40:29.258 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T04:40:29.258 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T04:40:29.258 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T04:40:29.258 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T04:40:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T04:40:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T04:40:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T04:40:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T04:40:29.259 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T04:40:29.260 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T04:40:29.260 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T04:40:29.260 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:29.260 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:29.373 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T04:40:29.724 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:29.987 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T04:40:30.088 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:53 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:30.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T04:40:30.362 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T04:40:30.558 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T04:40:30.740 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T04:40:30.980 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T04:40:31.221 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:31.222 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:31.222 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:31.223 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:31.223 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:31.223 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 120 k 2023-01-25T04:40:31.223 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:40:31.223 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T04:40:31.224 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T04:40:31.224 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T04:40:31.224 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T04:40:31.224 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:31.225 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:31.225 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:31.225 INFO:teuthology.orchestra.run.smithi116.stdout:Install 5 Packages 2023-01-25T04:40:31.225 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:31.226 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 6.0 M 2023-01-25T04:40:31.226 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 26 M 2023-01-25T04:40:31.226 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:31.254 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T04:40:31.305 INFO:teuthology.orchestra.run.smithi116.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.6 MB/s | 538 kB 00:00 2023-01-25T04:40:31.413 INFO:teuthology.orchestra.run.smithi116.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-01-25T04:40:31.463 INFO:teuthology.orchestra.run.smithi116.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1959.gb0d25925.e 504 kB/s | 120 kB 00:00 2023-01-25T04:40:31.481 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T04:40:31.547 INFO:teuthology.orchestra.run.smithi116.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.9 MB/s | 476 kB 00:00 2023-01-25T04:40:31.595 INFO:teuthology.orchestra.run.smithi116.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 332 kB/s | 60 kB 00:00 2023-01-25T04:40:31.597 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:31.597 INFO:teuthology.orchestra.run.smithi116.stdout:Total 16 MB/s | 6.0 MB 00:00 2023-01-25T04:40:31.648 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:31.658 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:31.659 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:31.793 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:31.797 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:32.084 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:32.429 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T04:40:32.540 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T04:40:32.816 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T04:40:33.000 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T04:40:33.177 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T04:40:33.351 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:40:33.391 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T04:40:33.641 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 13/13 2023-01-25T04:40:33.642 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 1/13 2023-01-25T04:40:33.642 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T04:40:33.642 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T04:40:33.642 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T04:40:33.643 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T04:40:33.643 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T04:40:33.643 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T04:40:33.643 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T04:40:33.643 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T04:40:33.644 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T04:40:33.644 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T04:40:33.644 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T04:40:33.810 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T04:40:34.068 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T04:40:34.191 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T04:40:34.192 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:34.192 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:34.192 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:34.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T04:40:34.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T04:40:34.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T04:40:34.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T04:40:34.194 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T04:40:34.194 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T04:40:34.194 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T04:40:34.195 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T04:40:34.195 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T04:40:34.195 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T04:40:34.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T04:40:34.196 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T04:40:34.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:34.197 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:34.290 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:40:34.506 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T04:40:34.594 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:40:34.594 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/5 2023-01-25T04:40:34.594 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T04:40:34.595 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T04:40:34.595 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T04:40:35.113 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T04:40:35.113 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:35.113 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:35.114 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:35.114 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T04:40:35.114 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T04:40:35.114 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T04:40:35.115 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T04:40:35.115 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:35.115 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:35.220 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-fuse 2023-01-25T04:40:35.221 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:35.946 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:58 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:36.368 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:36.369 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:36.369 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:36.369 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:36.370 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:36.370 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 120 k 2023-01-25T04:40:36.370 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:40:36.370 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T04:40:36.371 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T04:40:36.371 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T04:40:36.372 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T04:40:36.372 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:36.373 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:36.373 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:36.373 INFO:teuthology.orchestra.run.smithi073.stdout:Install 5 Packages 2023-01-25T04:40:36.373 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:36.374 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 6.0 M 2023-01-25T04:40:36.374 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 26 M 2023-01-25T04:40:36.374 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:36.459 INFO:teuthology.orchestra.run.smithi073.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.0 MB/s | 538 kB 00:00 2023-01-25T04:40:36.560 INFO:teuthology.orchestra.run.smithi073.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 25 MB/s | 4.8 MB 00:00 2023-01-25T04:40:36.610 INFO:teuthology.orchestra.run.smithi073.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1959.gb0d25925.e 504 kB/s | 120 kB 00:00 2023-01-25T04:40:36.685 INFO:teuthology.orchestra.run.smithi073.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.1 MB/s | 476 kB 00:00 2023-01-25T04:40:36.711 INFO:teuthology.orchestra.run.smithi073.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 400 kB/s | 60 kB 00:00 2023-01-25T04:40:36.712 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:36.713 INFO:teuthology.orchestra.run.smithi073.stdout:Total 17 MB/s | 6.0 MB 00:00 2023-01-25T04:40:36.763 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:36.774 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:36.775 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:36.920 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:36.924 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:37.076 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:37.077 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:37.077 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:37.077 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:37.077 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 845 k 2023-01-25T04:40:37.078 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-01-25T04:40:37.078 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T04:40:37.079 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:37.079 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:37.079 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:37.080 INFO:teuthology.orchestra.run.smithi116.stdout:Install 2 Packages 2023-01-25T04:40:37.080 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:37.081 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 928 k 2023-01-25T04:40:37.081 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 2.9 M 2023-01-25T04:40:37.081 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:37.162 INFO:teuthology.orchestra.run.smithi116.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 986 kB/s | 83 kB 00:00 2023-01-25T04:40:37.225 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:37.379 INFO:teuthology.orchestra.run.smithi116.stdout:(2/2): ceph-fuse-18.0.0-1959.gb0d25925.el8.x86_ 2.7 MB/s | 845 kB 00:00 2023-01-25T04:40:37.380 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:37.381 INFO:teuthology.orchestra.run.smithi116.stdout:Total 3.0 MB/s | 928 kB 00:00 2023-01-25T04:40:37.391 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:37.412 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:37.412 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:37.504 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:37.506 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T04:40:37.508 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:37.694 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:37.954 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T04:40:38.362 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:40:38.437 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T04:40:38.777 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:40:38.778 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/2 2023-01-25T04:40:38.830 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T04:40:39.079 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T04:40:39.267 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:40:39.306 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T04:40:39.306 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:39.306 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:39.307 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T04:40:39.307 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:39.307 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:39.525 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-volume 2023-01-25T04:40:39.577 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 5/5 2023-01-25T04:40:39.577 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 1/5 2023-01-25T04:40:39.578 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T04:40:39.578 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T04:40:39.578 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T04:40:40.078 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T04:40:40.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:40.079 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:40.079 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:40.079 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T04:40:40.079 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T04:40:40.080 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T04:40:40.080 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T04:40:40.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:40.080 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:40.206 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-fuse 2023-01-25T04:40:40.263 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:03 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:40.933 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:03 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:41.412 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:41.413 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:41.414 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-01-25T04:40:41.414 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:41.414 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 263 k 2023-01-25T04:40:41.415 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:41.416 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:41.416 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:41.416 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:40:41.417 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:41.417 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 263 k 2023-01-25T04:40:41.417 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 1.3 M 2023-01-25T04:40:41.418 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:41.984 INFO:teuthology.orchestra.run.smithi116.stdout:ceph-volume-18.0.0-1959.gb0d25925.el8.noarch.rp 461 kB/s | 263 kB 00:00 2023-01-25T04:40:41.986 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:41.986 INFO:teuthology.orchestra.run.smithi116.stdout:Total 460 kB/s | 263 kB 00:00 2023-01-25T04:40:41.986 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:41.995 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:41.995 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:42.080 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:42.081 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:42.081 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:42.081 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:42.081 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 845 k 2023-01-25T04:40:42.081 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2023-01-25T04:40:42.082 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T04:40:42.082 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:42.082 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:42.082 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:42.082 INFO:teuthology.orchestra.run.smithi073.stdout:Install 2 Packages 2023-01-25T04:40:42.083 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:42.083 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 928 k 2023-01-25T04:40:42.083 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 2.9 M 2023-01-25T04:40:42.084 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:42.092 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:42.095 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:42.151 INFO:teuthology.orchestra.run.smithi073.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-01-25T04:40:42.280 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:42.605 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:42.818 INFO:teuthology.orchestra.run.smithi073.stdout:(2/2): ceph-fuse-18.0.0-1959.gb0d25925.el8.x86_ 1.1 MB/s | 845 kB 00:00 2023-01-25T04:40:42.819 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:42.820 INFO:teuthology.orchestra.run.smithi073.stdout:Total 1.2 MB/s | 928 kB 00:00 2023-01-25T04:40:42.829 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:42.851 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:42.851 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:42.946 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:42.949 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:43.026 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:43.165 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:43.416 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T04:40:43.478 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:43.478 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:43.478 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:43.478 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:43.479 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:43.479 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:43.608 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:40:43.678 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados-devel 2023-01-25T04:40:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2/2 2023-01-25T04:40:44.006 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/2 2023-01-25T04:40:44.407 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:07 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T04:40:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:44.513 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:44.513 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T04:40:44.514 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:44.514 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:44.764 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-volume 2023-01-25T04:40:45.509 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:08 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:45.548 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:45.551 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:45.551 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2023-01-25T04:40:45.552 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:45.552 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:45.552 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 139 k 2023-01-25T04:40:45.553 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:45.553 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:45.553 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:45.554 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:40:45.554 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:45.555 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 139 k 2023-01-25T04:40:45.555 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 512 k 2023-01-25T04:40:45.555 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:46.130 INFO:teuthology.orchestra.run.smithi116.stdout:librados-devel-18.0.0-1959.gb0d25925.el8.x86_64 240 kB/s | 139 kB 00:00 2023-01-25T04:40:46.131 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:46.131 INFO:teuthology.orchestra.run.smithi116.stdout:Total 239 kB/s | 139 kB 00:00 2023-01-25T04:40:46.132 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:46.137 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:46.137 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:46.189 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:46.193 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:46.313 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:46.502 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:46.654 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:46.654 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2023-01-25T04:40:46.655 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:46.655 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:46.655 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:18.0.0-1959.gb0d25925.el8 ceph-noarch 263 k 2023-01-25T04:40:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:46.656 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:46.656 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:46.656 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:40:46.656 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:46.657 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 263 k 2023-01-25T04:40:46.657 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 1.3 M 2023-01-25T04:40:46.657 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:46.807 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:46.950 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-volume-18.0.0-1959.gb0d25925.el8.noarch.rp 892 kB/s | 263 kB 00:00 2023-01-25T04:40:46.951 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:46.951 INFO:teuthology.orchestra.run.smithi073.stdout:Total 888 kB/s | 263 kB 00:00 2023-01-25T04:40:46.952 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:46.961 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:46.962 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:47.068 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:47.072 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:47.256 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:47.292 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:47.292 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:47.293 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:47.293 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:47.293 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:47.293 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:47.487 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs2 2023-01-25T04:40:47.516 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:47.957 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:48.221 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:11 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 1/1 2023-01-25T04:40:48.453 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:48.454 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:18.0.0-1959.gb0d25925.el8.noarch 2023-01-25T04:40:48.454 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:48.454 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:48.651 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados-devel 2023-01-25T04:40:49.251 INFO:teuthology.orchestra.run.smithi116.stdout:Package libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:49.353 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:49.354 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:40:49.354 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:49.379 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:12 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:49.567 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install libcephfs-devel 2023-01-25T04:40:50.291 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:13 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:50.525 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:50.526 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:50.526 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2023-01-25T04:40:50.526 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:50.526 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:50.526 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 139 k 2023-01-25T04:40:50.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:50.527 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:50.527 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:50.527 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:40:50.527 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:50.528 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 139 k 2023-01-25T04:40:50.529 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 512 k 2023-01-25T04:40:50.529 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:50.722 INFO:teuthology.orchestra.run.smithi073.stdout:librados-devel-18.0.0-1959.gb0d25925.el8.x86_64 714 kB/s | 139 kB 00:00 2023-01-25T04:40:50.723 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:50.724 INFO:teuthology.orchestra.run.smithi073.stdout:Total 709 kB/s | 139 kB 00:00 2023-01-25T04:40:50.724 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:50.728 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:50.729 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:50.780 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:50.783 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:50.922 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:51.104 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:51.412 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:51.430 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:51.431 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:51.431 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2023-01-25T04:40:51.431 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:51.432 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:40:51.432 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 30 k 2023-01-25T04:40:51.432 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:51.432 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:40:51.432 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:40:51.433 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:40:51.433 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:51.433 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 30 k 2023-01-25T04:40:51.433 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 137 k 2023-01-25T04:40:51.433 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:40:51.595 INFO:teuthology.orchestra.run.smithi116.stdout:libcephfs-devel-18.0.0-1959.gb0d25925.el8.x86_6 187 kB/s | 30 kB 00:00 2023-01-25T04:40:51.596 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:51.597 INFO:teuthology.orchestra.run.smithi116.stdout:Total 186 kB/s | 30 kB 00:00 2023-01-25T04:40:51.597 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:40:51.599 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:40:51.599 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:40:51.620 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:40:51.623 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:40:51.685 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:40:51.876 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:51.909 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:51.909 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:51.909 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:51.910 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:51.910 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:51.910 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:52.141 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs2 2023-01-25T04:40:52.149 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:52.604 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:52.605 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:52.605 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:40:52.606 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:52.606 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:40:52.606 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:52.742 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librados2 2023-01-25T04:40:52.879 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:15 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:53.460 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:16 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:53.919 INFO:teuthology.orchestra.run.smithi073.stdout:Package libcephfs2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:54.020 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:54.021 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:40:54.021 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:54.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install libcephfs-devel 2023-01-25T04:40:54.510 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:54.610 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:54.611 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:40:54.611 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:54.700 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install librbd1 2023-01-25T04:40:54.843 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:17 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:55.424 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:55.993 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:40:55.994 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:55.994 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2023-01-25T04:40:55.994 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:55.994 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:40:55.995 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 30 k 2023-01-25T04:40:55.995 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:55.995 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:40:55.995 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:40:55.995 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:40:55.996 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:55.996 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 30 k 2023-01-25T04:40:55.996 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 137 k 2023-01-25T04:40:55.996 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:40:56.466 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:56.567 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:56.568 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:40:56.569 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:56.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rados 2023-01-25T04:40:56.697 INFO:teuthology.orchestra.run.smithi073.stdout:libcephfs-devel-18.0.0-1959.gb0d25925.el8.x86_6 43 kB/s | 30 kB 00:00 2023-01-25T04:40:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:40:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:Total 43 kB/s | 30 kB 00:00 2023-01-25T04:40:56.698 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:40:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:40:56.702 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:40:56.925 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:40:56.929 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:40:57.288 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:40:57.371 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:57.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:57.737 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:40:58.193 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:58.193 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:40:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:40:58.194 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:40:58.194 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:40:58.303 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librados2 2023-01-25T04:40:58.414 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:40:58.516 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:40:58.517 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:40:58.518 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:40:58.603 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rgw 2023-01-25T04:40:59.034 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:40:59.325 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:00.076 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:00.176 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:00.177 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:00.177 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:00.282 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install librbd1 2023-01-25T04:41:00.364 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:00.464 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:00.465 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:41:00.465 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:00.546 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-cephfs 2023-01-25T04:41:01.004 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:01.277 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:02.041 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:02.141 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:02.142 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:02.142 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:02.268 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rados 2023-01-25T04:41:02.323 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:02.423 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:02.424 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:41:02.424 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:02.509 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install python3-rbd 2023-01-25T04:41:02.989 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:25 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:03.236 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:04.028 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rados-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:04.129 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:04.130 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:04.130 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:04.236 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rgw 2023-01-25T04:41:04.279 INFO:teuthology.orchestra.run.smithi116.stdout:Package python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:04.378 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:04.379 INFO:teuthology.orchestra.run.smithi116.stdout:Nothing to do. 2023-01-25T04:41:04.380 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:04.465 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-fuse 2023-01-25T04:41:04.959 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:27 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:05.183 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:28 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:05.998 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rgw-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:06.097 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:06.098 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:06.099 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:06.207 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-cephfs 2023-01-25T04:41:06.321 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:06.322 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:06.323 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2023-01-25T04:41:06.323 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:06.323 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:41:06.323 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 94 k 2023-01-25T04:41:06.323 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:06.324 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:41:06.324 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:06.324 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:41:06.324 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:06.324 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 94 k 2023-01-25T04:41:06.325 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 280 k 2023-01-25T04:41:06.325 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:41:06.585 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-fuse-18.0.0-1959.gb0d25925.el8.x86_64.rpm 360 kB/s | 94 kB 00:00 2023-01-25T04:41:06.586 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:06.586 INFO:teuthology.orchestra.run.smithi116.stdout:Total 358 kB/s | 94 kB 00:00 2023-01-25T04:41:06.586 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:41:06.596 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:41:06.597 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:41:06.647 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:41:06.651 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:41:06.761 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:41:06.923 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:29 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:06.974 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:07.311 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:07.840 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:07.841 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:41:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:07.841 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:07.842 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:07.963 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-cephfs-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:08.008 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-mirror 2023-01-25T04:41:08.064 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:08.065 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:08.065 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:08.169 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install python3-rbd 2023-01-25T04:41:08.733 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:31 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:08.895 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:31 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:09.873 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:09.874 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repo Size 2023-01-25T04:41:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:09.875 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:41:09.875 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.4 M 2023-01-25T04:41:09.876 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:09.876 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:41:09.876 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:09.876 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:41:09.877 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:09.877 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 3.4 M 2023-01-25T04:41:09.877 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 16 M 2023-01-25T04:41:09.877 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:41:09.938 INFO:teuthology.orchestra.run.smithi073.stdout:Package python3-rbd-2:18.0.0-1959.gb0d25925.el8.x86_64 is already installed. 2023-01-25T04:41:10.038 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:10.039 INFO:teuthology.orchestra.run.smithi073.stdout:Nothing to do. 2023-01-25T04:41:10.039 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:10.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-fuse 2023-01-25T04:41:10.346 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-mirror-18.0.0-1959.gb0d25925.el8.x86_64.rpm 7.3 MB/s | 3.4 MB 00:00 2023-01-25T04:41:10.346 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:10.347 INFO:teuthology.orchestra.run.smithi116.stdout:Total 7.3 MB/s | 3.4 MB 00:00 2023-01-25T04:41:10.347 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:41:10.359 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:41:10.359 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:41:10.422 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:41:10.425 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:41:10.864 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:33 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:10.868 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:41:11.051 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:11.491 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:12.003 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:12.003 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:12.003 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2023-01-25T04:41:12.004 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:12.004 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:41:12.004 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 94 k 2023-01-25T04:41:12.004 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:12.004 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:41:12.005 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:12.005 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:41:12.005 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:12.005 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 94 k 2023-01-25T04:41:12.005 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 280 k 2023-01-25T04:41:12.006 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:41:12.008 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:12.008 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:12.009 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:41:12.009 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:12.009 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:12.009 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:12.211 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-fuse-18.0.0-1959.gb0d25925.el8.x86_64.rpm 455 kB/s | 94 kB 00:00 2023-01-25T04:41:12.212 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:12.212 INFO:teuthology.orchestra.run.smithi073.stdout:Total 452 kB/s | 94 kB 00:00 2023-01-25T04:41:12.212 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:41:12.215 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install rbd-nbd 2023-01-25T04:41:12.222 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:41:12.223 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:41:12.276 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:41:12.279 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:41:12.429 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:41:12.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:12.889 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:12.953 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:02:35 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:13.422 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:13.422 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:13.422 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:41:13.423 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:13.423 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:13.423 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:13.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-mirror 2023-01-25T04:41:14.092 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-01-25T04:41:14.093 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:14.093 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2023-01-25T04:41:14.093 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:14.094 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-01-25T04:41:14.094 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 179 k 2023-01-25T04:41:14.094 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:14.094 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-01-25T04:41:14.094 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-01-25T04:41:14.095 INFO:teuthology.orchestra.run.smithi116.stdout:Install 1 Package 2023-01-25T04:41:14.095 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:14.095 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 179 k 2023-01-25T04:41:14.096 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 568 k 2023-01-25T04:41:14.096 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-01-25T04:41:14.300 INFO:teuthology.orchestra.run.smithi116.stdout:rbd-nbd-18.0.0-1959.gb0d25925.el8.x86_64.rpm 874 kB/s | 179 kB 00:00 2023-01-25T04:41:14.300 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:14.301 INFO:teuthology.orchestra.run.smithi116.stdout:Total 869 kB/s | 179 kB 00:00 2023-01-25T04:41:14.301 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-01-25T04:41:14.312 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-01-25T04:41:14.312 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-01-25T04:41:14.363 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-01-25T04:41:14.366 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-01-25T04:41:14.368 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:37 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:14.487 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-01-25T04:41:14.673 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:14.972 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:15.454 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:15.454 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:15.454 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-01-25T04:41:15.455 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:15.455 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:15.455 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-01-25T04:41:15.508 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:15.509 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:15.509 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repo Size 2023-01-25T04:41:15.509 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:15.509 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:41:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 3.4 M 2023-01-25T04:41:15.510 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:15.510 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:41:15.510 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:15.510 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:41:15.511 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:15.511 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 3.4 M 2023-01-25T04:41:15.511 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 16 M 2023-01-25T04:41:15.511 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:41:15.653 DEBUG:teuthology.parallel:result is None 2023-01-25T04:41:16.091 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-mirror-18.0.0-1959.gb0d25925.el8.x86_64.rpm 5.9 MB/s | 3.4 MB 00:00 2023-01-25T04:41:16.092 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:16.092 INFO:teuthology.orchestra.run.smithi073.stdout:Total 5.9 MB/s | 3.4 MB 00:00 2023-01-25T04:41:16.092 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:41:16.104 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:41:16.104 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:41:16.167 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:41:16.170 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:41:16.612 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:41:16.787 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:17.215 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:17.718 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:17.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:17.718 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:41:17.719 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:17.719 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:17.719 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:17.942 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install rbd-nbd 2023-01-25T04:41:18.681 INFO:teuthology.orchestra.run.smithi073.stdout:Last metadata expiration check: 0:02:41 ago on Wed 25 Jan 2023 04:38:37 AM UTC. 2023-01-25T04:41:19.813 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2023-01-25T04:41:19.814 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:19.815 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2023-01-25T04:41:19.815 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:19.815 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2023-01-25T04:41:19.815 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:18.0.0-1959.gb0d25925.el8 ceph 179 k 2023-01-25T04:41:19.815 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:19.816 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2023-01-25T04:41:19.816 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2023-01-25T04:41:19.816 INFO:teuthology.orchestra.run.smithi073.stdout:Install 1 Package 2023-01-25T04:41:19.816 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:19.816 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 179 k 2023-01-25T04:41:19.817 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 568 k 2023-01-25T04:41:19.817 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2023-01-25T04:41:20.020 INFO:teuthology.orchestra.run.smithi073.stdout:rbd-nbd-18.0.0-1959.gb0d25925.el8.x86_64.rpm 875 kB/s | 179 kB 00:00 2023-01-25T04:41:20.021 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2023-01-25T04:41:20.022 INFO:teuthology.orchestra.run.smithi073.stdout:Total 870 kB/s | 179 kB 00:00 2023-01-25T04:41:20.022 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2023-01-25T04:41:20.032 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2023-01-25T04:41:20.033 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2023-01-25T04:41:20.084 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2023-01-25T04:41:20.087 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2023-01-25T04:41:20.237 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2023-01-25T04:41:20.392 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:20.703 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:21.195 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 1/1 2023-01-25T04:41:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:21.196 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2023-01-25T04:41:21.196 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:18.0.0-1959.gb0d25925.el8.x86_64 2023-01-25T04:41:21.197 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:21.197 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2023-01-25T04:41:21.386 DEBUG:teuthology.parallel:result is None 2023-01-25T04:41:21.386 DEBUG:teuthology.orchestra.run.smithi073:> sudo lsb_release -is 2023-01-25T04:41:21.424 INFO:teuthology.orchestra.run.smithi073.stdout:CentOSStream 2023-01-25T04:41:21.425 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:41:21.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:41:21.582 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T04:41:21.605 INFO:teuthology.orchestra.run.smithi073.stdout:18.0.0-1959.gb0d25925.el8 2023-01-25T04:41:21.606 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1959.gb0d25925.el8 2023-01-25T04:41:21.606 INFO:teuthology.task.install:The correct ceph version 18.0.0-1959.gb0d25925 is installed. 2023-01-25T04:41:21.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo lsb_release -is 2023-01-25T04:41:21.649 INFO:teuthology.orchestra.run.smithi116.stdout:CentOSStream 2023-01-25T04:41:21.650 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T04:41:21.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b0d2592529629ab4f86fed5991e556a87dcda563 2023-01-25T04:41:21.802 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T04:41:21.827 INFO:teuthology.orchestra.run.smithi116.stdout:18.0.0-1959.gb0d25925.el8 2023-01-25T04:41:21.828 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1959.gb0d25925.el8 2023-01-25T04:41:21.828 INFO:teuthology.task.install:The correct ceph version 18.0.0-1959.gb0d25925 is installed. 2023-01-25T04:41:21.829 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T04:41:21.829 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:21.829 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T04:41:21.857 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:21.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T04:41:21.897 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T04:41:21.897 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:21.898 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T04:41:21.924 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T04:41:21.991 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:21.992 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T04:41:22.023 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T04:41:22.093 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T04:41:22.094 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:22.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T04:41:22.121 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T04:41:22.188 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:22.189 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T04:41:22.218 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T04:41:22.286 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T04:41:22.358 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T04:41:22.358 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-01-25T04:41:22.361 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /var/log/ceph 2023-01-25T04:41:22.387 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T04:41:22.388 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T04:41:22.428 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T04:41:22.455 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T04:41:22.456 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T04:41:22.497 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T04:41:22.540 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T04:41:22.540 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'slow request', 'overall HEALTH_', '\\(CACHE_POOL_', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T04:41:22.541 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi/7136760', 'branch': 'wip-yuri-testing-2023-01-23-0926', 'description': 'rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7136760', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:20:59-rados-wip-yuri-testing-2023-01-23-0926-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-01-23-0926'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-01-23-0926', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2'], ['osd.3', 'osd.4', 'osd.5', 'client.0']], 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri-testing-2023-01-23-0926', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_b0d2592529629ab4f86fed5991e556a87dcda563/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'targets': {'smithi073.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSKBKA9036Qhn2C354OVRNKzxqQ+w28M0QBPYUC5mRg8CEKlb9fHuhV1UKhyewZRtsRqABAr6VzLQhiarxmP+EFlXjN+KLXKJvi3zTPSavgs4lNRYoHfryvDe308Cocb+fcXYW+TOZ+LnUEiFGAYVPRyCew0GjRzBZn0rGHS4mOmK4U7xalU6zhl8jdUvIA/b0ov26PdpLrE5HSr9DSd+Erf+cB2BEQzG2AkXn2o7MqaF/lIgH9NqyWjs0C5p57s/Ie8U4s9gnjQ6eTQXavJLnRzNFNYOE8KkcF7rLLYxT63ztt4ahZlLJ9mHvpya7q2dup9Zvw6pDkPQGpidSI8L2RpmbvzZwbAfNFfo6G+otmw2FwP8bWR86CvizuatOziJ859Tki/VvuFd3KuoWaUYbPMF327gytGpG8fD0ZpcKZvfyHXjvlzX2MmrOY8jS2GAVHMcnDyLlDui+34vq1OfGfD5/lY9UcQI0gYG+vDnhXCq36tcJsLk17KoWugd7Lq0=', 'smithi116.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+U7ZRiceaF5WRuH54Uwk2WT1/5oyO5nLjqrIQtin2Lf++jeYt53+lVaAxoHg7LnfCzhgYI2mvMuFCz4WkyLELPpCqT/p8yJKj4Z5rvRsDwWG2K/TOTs/obL5d9Bko7K7DZDpH/bJvZooExZ1IY5wdVal/GxALbCvsazgyScsPLxJsaQv8CKwHNOE0skPWxgHinaw48BufP9pN+rJxfklSZkOLceAvfeno32eMC5HqDQurlDdTKeRX/vAvDg7AXzZovh1c38qEtk2GMAxqKCr9NNvcJUf/aI6sn57jDDgAN2QTeqV1AgPTXZRWH0LEthuNeCQCCCL4M+FHgacRnc99qtlhT/ZmEPKfNosBDjHS9fzdSNL77j9oHjhRnyseP9FyI3gWzzdwuPHmfaI1I+6jIVn5mcm3tk2luWZPG5+FMirgVqKLlyEpWhWuXnw/t7jh0PGekzoqR/4o2T/1O73ZyBSBDujCCyrke4SldhVZQ292SM+Wb8av8LiD9CzUiec='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['but it is still running', 'slow request', 'overall HEALTH_', '\\(CACHE_POOL_', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', '\\(MON_DOWN\\)'], 'pre-mgr-commands': ['sudo ceph config set mgr mgr_pool false --force'], 'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'b0d2592529629ab4f86fed5991e556a87dcda563', 'cluster': 'ceph'}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 500']}}, {'background_exec': {'mon.a': ['while true', 'do sleep 30', 'sudo ceph osd pool set cache cache_target_full_ratio .001', 'echo cache-try-flush-evict-all', 'rados -p cache cache-try-flush-evict-all', 'sleep 5', 'echo cache-flush-evict-all', 'rados -p cache cache-flush-evict-all', 'sleep 5', 'echo remove overlay', 'sudo ceph osd tier remove-overlay base', 'sleep 20', 'done']}}, {'rados': {'clients': ['client.0'], 'max_seconds': 600, 'objects': 10000, 'op_weights': {'copy_from': 50, 'delete': 50, 'read': 100, 'write': 100}, 'ops': 400000, 'pools': ['base'], 'size': 1024}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:20:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T04:41:22.542 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T04:41:22.564 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T04:41:22.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T04:41:22.624 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T04:41:22.652 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:22.652 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T04:41:22.707 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T04:41:22.708 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-01-25T04:41:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T04:41:22.766 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:22.766 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 360435 Links: 1 2023-01-25T04:41:22.767 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:22.768 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:22.769 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-01-25 04:41:16.953563811 +0000 2023-01-25T04:41:22.769 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-01-25 04:37:51.532590943 +0000 2023-01-25T04:41:22.769 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-01-25 04:37:51.532590943 +0000 2023-01-25T04:41:22.769 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-01-25T04:41:22.770 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T04:41:22.832 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-01-25T04:41:22.832 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-01-25T04:41:22.832 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000234475 s, 2.2 MB/s 2023-01-25T04:41:22.833 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T04:41:22.893 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-01-25T04:41:22.952 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T04:41:22.953 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 377892 Links: 1 2023-01-25T04:41:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:22.953 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-01-25 04:41:16.953563811 +0000 2023-01-25T04:41:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-01-25 04:37:52.036579183 +0000 2023-01-25T04:41:22.954 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-01-25 04:37:52.036579183 +0000 2023-01-25T04:41:22.954 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-01-25T04:41:22.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T04:41:23.019 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-01-25T04:41:23.020 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-01-25T04:41:23.020 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000215289 s, 2.4 MB/s 2023-01-25T04:41:23.021 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T04:41:23.079 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-01-25T04:41:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T04:41:23.138 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:23.138 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 373983 Links: 1 2023-01-25T04:41:23.139 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:23.139 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:23.139 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-01-25 04:41:16.953563811 +0000 2023-01-25T04:41:23.139 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-01-25 04:37:52.552567143 +0000 2023-01-25T04:41:23.140 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-01-25 04:37:52.552567143 +0000 2023-01-25T04:41:23.140 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-01-25T04:41:23.140 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T04:41:23.203 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-01-25T04:41:23.204 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-01-25T04:41:23.204 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000196079 s, 2.6 MB/s 2023-01-25T04:41:23.205 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T04:41:23.263 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-01-25T04:41:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T04:41:23.322 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 6h/6d Inode: 374044 Links: 1 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-01-25 04:41:16.953563811 +0000 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-01-25 04:37:53.058555335 +0000 2023-01-25T04:41:23.323 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-01-25 04:37:53.058555335 +0000 2023-01-25T04:41:23.324 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-01-25T04:41:23.324 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T04:41:23.388 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-01-25T04:41:23.388 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-01-25T04:41:23.388 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000241875 s, 2.1 MB/s 2023-01-25T04:41:23.390 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T04:41:23.449 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:23.449 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:23.449 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T04:41:23.469 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T04:41:23.470 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2023-01-25T04:41:23.529 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T04:41:23.530 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:23.530 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 373963 Links: 1 2023-01-25T04:41:23.530 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:23.530 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:23.530 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-01-25 04:41:11.229009202 +0000 2023-01-25T04:41:23.531 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-01-25 04:37:51.421840874 +0000 2023-01-25T04:41:23.531 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-01-25 04:37:51.421840874 +0000 2023-01-25T04:41:23.531 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-01-25T04:41:23.531 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T04:41:23.597 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-01-25T04:41:23.600 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-01-25T04:41:23.600 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000231763 s, 2.2 MB/s 2023-01-25T04:41:23.602 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T04:41:23.661 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2023-01-25T04:41:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T04:41:23.720 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:23.720 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 370481 Links: 1 2023-01-25T04:41:23.721 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:23.721 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:23.721 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-01-25 04:41:11.230009184 +0000 2023-01-25T04:41:23.721 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-01-25 04:37:51.924832236 +0000 2023-01-25T04:41:23.721 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-01-25 04:37:51.924832236 +0000 2023-01-25T04:41:23.722 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-01-25T04:41:23.722 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T04:41:23.787 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-01-25T04:41:23.787 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-01-25T04:41:23.788 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000188835 s, 2.7 MB/s 2023-01-25T04:41:23.789 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T04:41:23.848 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2023-01-25T04:41:23.906 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T04:41:23.908 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:23.908 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 377042 Links: 1 2023-01-25T04:41:23.908 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:23.909 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:23.909 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-01-25 04:41:11.230009184 +0000 2023-01-25T04:41:23.909 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-01-25 04:37:52.427823597 +0000 2023-01-25T04:41:23.910 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-01-25 04:37:52.427823597 +0000 2023-01-25T04:41:23.910 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-01-25T04:41:23.910 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T04:41:23.973 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-01-25T04:41:23.974 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-01-25T04:41:23.974 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000189728 s, 2.7 MB/s 2023-01-25T04:41:23.976 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T04:41:24.035 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2023-01-25T04:41:24.092 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T04:41:24.093 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T04:41:24.093 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 373172 Links: 1 2023-01-25T04:41:24.093 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T04:41:24.093 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T04:41:24.094 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-01-25 04:41:11.230009184 +0000 2023-01-25T04:41:24.094 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-01-25 04:37:52.941814770 +0000 2023-01-25T04:41:24.094 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-01-25 04:37:52.941814770 +0000 2023-01-25T04:41:24.094 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-01-25T04:41:24.095 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T04:41:24.159 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-01-25T04:41:24.159 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-01-25T04:41:24.159 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.00026467 s, 1.9 MB/s 2023-01-25T04:41:24.160 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T04:41:24.219 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:24.220 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2023-01-25T04:41:24.220 INFO:tasks.ceph:Generating config... 2023-01-25T04:41:24.221 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T04:41:24.222 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-25T04:41:24.222 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-01-25T04:41:24.222 INFO:tasks.ceph:[global] ms type = async 2023-01-25T04:41:24.223 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T04:41:24.223 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T04:41:24.223 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T04:41:24.223 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T04:41:24.224 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T04:41:24.224 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T04:41:24.224 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-25T04:41:24.224 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-25T04:41:24.225 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-01-25T04:41:24.225 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T04:41:24.225 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T04:41:24.226 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T04:41:24.226 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T04:41:24.227 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T04:41:24.227 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T04:41:24.227 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T04:41:24.227 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T04:41:24.228 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T04:41:24.228 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T04:41:24.228 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T04:41:24.228 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T04:41:24.229 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T04:41:24.229 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T04:41:24.229 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T04:41:24.230 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T04:41:24.230 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T04:41:24.230 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T04:41:24.230 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T04:41:24.231 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T04:41:24.288 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T04:41:24.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T04:41:24.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:41:24.363 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.73')] 2023-01-25T04:41:24.364 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.73', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}} 2023-01-25T04:41:24.365 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:24.365 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T04:41:24.421 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.73 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:24.503 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:24.504 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: generated fsid d6d96f12-c813-4803-b909-703b72cf3701 2023-01-25T04:41:24.504 INFO:teuthology.orchestra.run.smithi073.stdout:setting min_mon_release = pacific 2023-01-25T04:41:24.504 INFO:teuthology.orchestra.run.smithi073.stdout:epoch 0 2023-01-25T04:41:24.504 INFO:teuthology.orchestra.run.smithi073.stdout:fsid d6d96f12-c813-4803-b909-703b72cf3701 2023-01-25T04:41:24.505 INFO:teuthology.orchestra.run.smithi073.stdout:last_changed 2023-01-25T04:41:24.503462+0000 2023-01-25T04:41:24.505 INFO:teuthology.orchestra.run.smithi073.stdout:created 2023-01-25T04:41:24.503462+0000 2023-01-25T04:41:24.505 INFO:teuthology.orchestra.run.smithi073.stdout:min_mon_release 16 (pacific) 2023-01-25T04:41:24.505 INFO:teuthology.orchestra.run.smithi073.stdout:election_strategy: 1 2023-01-25T04:41:24.505 INFO:teuthology.orchestra.run.smithi073.stdout:0: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.a 2023-01-25T04:41:24.506 INFO:teuthology.orchestra.run.smithi073.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-01-25T04:41:24.507 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T04:41:24.565 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d6d96f12-c813-4803-b909-703b72cf3701... 2023-01-25T04:41:24.566 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T04:41:24.607 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T04:41:24.650 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-01-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-01-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-01-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.651 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-01-25T04:41:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-01-25T04:41:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-01-25T04:41:24.652 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-01-25T04:41:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-01-25T04:41:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-01-25T04:41:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.653 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T04:41:24.654 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-01-25T04:41:24.654 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.654 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T04:41:24.654 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T04:41:24.654 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.655 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-01-25T04:41:24.655 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.655 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-01-25T04:41:24.655 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-01-25T04:41:24.655 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-01-25T04:41:24.656 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-01-25T04:41:24.656 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-01-25T04:41:24.656 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-01-25T04:41:24.656 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-01-25T04:41:24.656 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T04:41:24.657 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T04:41:24.658 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-01-25T04:41:24.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.658 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T04:41:24.658 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-01-25T04:41:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-01-25T04:41:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.659 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-01-25T04:41:24.660 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-01-25T04:41:24.660 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-01-25T04:41:24.660 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = 172.21.15.73 2023-01-25T04:41:24.660 INFO:teuthology.orchestra.run.smithi073.stdout: mon client directed command retry = 5 2023-01-25T04:41:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: mon election default strategy = 1 2023-01-25T04:41:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: ms inject socket failures = 5000 2023-01-25T04:41:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: ms type = async 2023-01-25T04:41:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = d6d96f12-c813-4803-b909-703b72cf3701 2023-01-25T04:41:24.661 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-01-25T04:41:24.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.663 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-01-25T04:41:24.663 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-01-25T04:41:24.663 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.663 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-01-25T04:41:24.663 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-01-25T04:41:24.664 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-01-25T04:41:24.664 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.664 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-01-25T04:41:24.664 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-01-25T04:41:24.665 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.665 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-01-25T04:41:24.665 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.665 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-01-25T04:41:24.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.666 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-01-25T04:41:24.666 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.667 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-01-25T04:41:24.667 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-01-25T04:41:24.668 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.668 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-01-25T04:41:24.668 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-01-25T04:41:24.668 INFO:teuthology.orchestra.run.smithi073.stdout: bdev async discard = True 2023-01-25T04:41:24.669 INFO:teuthology.orchestra.run.smithi073.stdout: bdev enable discard = True 2023-01-25T04:41:24.669 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore allocator = stupid 2023-01-25T04:41:24.669 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-01-25T04:41:24.669 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-01-25T04:41:24.669 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore zero block detection = True 2023-01-25T04:41:24.670 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-01-25T04:41:24.670 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-01-25T04:41:24.670 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-01-25T04:41:24.670 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-01-25T04:41:24.670 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-01-25T04:41:24.671 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T04:41:24.671 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-01-25T04:41:24.671 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-01-25T04:41:24.671 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify cached snaps = True 2023-01-25T04:41:24.671 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify missing on start = True 2023-01-25T04:41:24.672 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-01-25T04:41:24.673 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock override recovery settings = True 2023-01-25T04:41:24.673 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-01-25T04:41:24.673 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue = debug_random 2023-01-25T04:41:24.673 INFO:teuthology.orchestra.run.smithi073.stdout: osd op queue cut off = debug_random 2023-01-25T04:41:24.673 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.674 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-01-25T04:41:24.674 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-01-25T04:41:24.674 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-01-25T04:41:24.674 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-01-25T04:41:24.674 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-01-25T04:41:24.675 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:41:24.675 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:41:24.675 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-01-25T04:41:24.675 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.675 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-01-25T04:41:24.676 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-01-25T04:41:24.676 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-01-25T04:41:24.676 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-01-25T04:41:24.676 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-01-25T04:41:24.676 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-01-25T04:41:24.677 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-01-25T04:41:24.677 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:41:24.677 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-01-25T04:41:24.677 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-01-25T04:41:24.677 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:41:24.678 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.678 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T04:41:24.678 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T04:41:24.678 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T04:41:24.678 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-01-25T04:41:24.679 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-01-25T04:41:24.680 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.680 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-01-25T04:41:24.680 INFO:teuthology.orchestra.run.smithi073.stdout: mon scrub interval = 300 2023-01-25T04:41:24.680 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T04:41:24.681 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T04:41:24.682 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-01-25T04:41:24.683 INFO:teuthology.orchestra.run.smithi116.stdout:[global] 2023-01-25T04:41:24.684 INFO:teuthology.orchestra.run.smithi116.stdout: chdir = "" 2023-01-25T04:41:24.684 INFO:teuthology.orchestra.run.smithi116.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T04:41:24.684 INFO:teuthology.orchestra.run.smithi116.stdout: auth supported = cephx 2023-01-25T04:41:24.684 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.684 INFO:teuthology.orchestra.run.smithi116.stdout: filestore xattr use omap = true 2023-01-25T04:41:24.685 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.685 INFO:teuthology.orchestra.run.smithi116.stdout: mon clock drift allowed = 1.000 2023-01-25T04:41:24.685 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.685 INFO:teuthology.orchestra.run.smithi116.stdout: osd crush chooseleaf type = 0 2023-01-25T04:41:24.685 INFO:teuthology.orchestra.run.smithi116.stdout: auth debug = true 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on old message = true 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: ms die on bug = true 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T04:41:24.686 INFO:teuthology.orchestra.run.smithi116.stdout: mon pg warn max object skew = 0 2023-01-25T04:41:24.687 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.687 INFO:teuthology.orchestra.run.smithi116.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T04:41:24.687 INFO:teuthology.orchestra.run.smithi116.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T04:41:24.687 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.687 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default size = 2 2023-01-25T04:41:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow primary affinity = true 2023-01-25T04:41:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd allow pg remap = true 2023-01-25T04:41:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on legacy crush tunables = false 2023-01-25T04:41:24.688 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on crush straw calc version zero = false 2023-01-25T04:41:24.689 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on no sortbitwise = false 2023-01-25T04:41:24.689 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on osd down out interval zero = false 2023-01-25T04:41:24.689 INFO:teuthology.orchestra.run.smithi116.stdout: mon warn on too few osds = false 2023-01-25T04:41:24.689 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T04:41:24.689 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T04:41:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: mon_allow_pool_size_one = true 2023-01-25T04:41:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T04:41:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.690 INFO:teuthology.orchestra.run.smithi116.stdout: osd default data pool replay window = 5 2023-01-25T04:41:24.691 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.691 INFO:teuthology.orchestra.run.smithi116.stdout: mon allow pool delete = true 2023-01-25T04:41:24.691 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.691 INFO:teuthology.orchestra.run.smithi116.stdout: mon cluster log file level = debug 2023-01-25T04:41:24.691 INFO:teuthology.orchestra.run.smithi116.stdout: debug asserts on shutdown = true 2023-01-25T04:41:24.692 INFO:teuthology.orchestra.run.smithi116.stdout: mon health detail to clog = false 2023-01-25T04:41:24.692 INFO:teuthology.orchestra.run.smithi116.stdout: mon host = 172.21.15.73 2023-01-25T04:41:24.692 INFO:teuthology.orchestra.run.smithi116.stdout: mon client directed command retry = 5 2023-01-25T04:41:24.692 INFO:teuthology.orchestra.run.smithi116.stdout: mon election default strategy = 1 2023-01-25T04:41:24.692 INFO:teuthology.orchestra.run.smithi116.stdout: ms inject socket failures = 5000 2023-01-25T04:41:24.693 INFO:teuthology.orchestra.run.smithi116.stdout: ms type = async 2023-01-25T04:41:24.693 INFO:teuthology.orchestra.run.smithi116.stdout: fsid = d6d96f12-c813-4803-b909-703b72cf3701 2023-01-25T04:41:24.693 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.693 INFO:teuthology.orchestra.run.smithi116.stdout:[osd] 2023-01-25T04:41:24.693 INFO:teuthology.orchestra.run.smithi116.stdout: osd journal size = 100 2023-01-25T04:41:24.694 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.694 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub load threshold = 5.0 2023-01-25T04:41:24.694 INFO:teuthology.orchestra.run.smithi116.stdout: osd scrub max interval = 600 2023-01-25T04:41:24.694 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.694 INFO:teuthology.orchestra.run.smithi116.stdout: osd recover clone overlap = true 2023-01-25T04:41:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: osd recovery max chunk = 1048576 2023-01-25T04:41:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug shutdown = true 2023-01-25T04:41:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug op order = true 2023-01-25T04:41:24.695 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify stray on activate = true 2023-01-25T04:41:24.696 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.696 INFO:teuthology.orchestra.run.smithi116.stdout: osd open classes on start = true 2023-01-25T04:41:24.696 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug pg log writeout = true 2023-01-25T04:41:24.696 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.696 INFO:teuthology.orchestra.run.smithi116.stdout: osd deep scrub update digest min age = 30 2023-01-25T04:41:24.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.697 INFO:teuthology.orchestra.run.smithi116.stdout: osd map max advance = 10 2023-01-25T04:41:24.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.697 INFO:teuthology.orchestra.run.smithi116.stdout: journal zero on create = true 2023-01-25T04:41:24.697 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: filestore ondisk finisher threads = 3 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: filestore apply finisher threads = 3 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: bdev debug aio = true 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug misdirected ops = true 2023-01-25T04:41:24.698 INFO:teuthology.orchestra.run.smithi116.stdout: bdev async discard = True 2023-01-25T04:41:24.699 INFO:teuthology.orchestra.run.smithi116.stdout: bdev enable discard = True 2023-01-25T04:41:24.699 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore allocator = stupid 2023-01-25T04:41:24.699 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore block size = 96636764160 2023-01-25T04:41:24.699 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore fsck on mount = True 2023-01-25T04:41:24.699 INFO:teuthology.orchestra.run.smithi116.stdout: bluestore zero block detection = True 2023-01-25T04:41:24.700 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluefs = 20 2023-01-25T04:41:24.700 INFO:teuthology.orchestra.run.smithi116.stdout: debug bluestore = 20 2023-01-25T04:41:24.700 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-01-25T04:41:24.700 INFO:teuthology.orchestra.run.smithi116.stdout: debug osd = 20 2023-01-25T04:41:24.700 INFO:teuthology.orchestra.run.smithi116.stdout: debug rocksdb = 10 2023-01-25T04:41:24.701 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T04:41:24.701 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd full ratio = 0.9 2023-01-25T04:41:24.701 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd nearfull ratio = 0.8 2023-01-25T04:41:24.701 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify cached snaps = True 2023-01-25T04:41:24.701 INFO:teuthology.orchestra.run.smithi116.stdout: osd debug verify missing on start = True 2023-01-25T04:41:24.702 INFO:teuthology.orchestra.run.smithi116.stdout: osd failsafe full ratio = 0.95 2023-01-25T04:41:24.702 INFO:teuthology.orchestra.run.smithi116.stdout: osd mclock override recovery settings = True 2023-01-25T04:41:24.702 INFO:teuthology.orchestra.run.smithi116.stdout: osd objectstore = bluestore 2023-01-25T04:41:24.702 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue = debug_random 2023-01-25T04:41:24.702 INFO:teuthology.orchestra.run.smithi116.stdout: osd op queue cut off = debug_random 2023-01-25T04:41:24.703 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.703 INFO:teuthology.orchestra.run.smithi116.stdout:[mgr] 2023-01-25T04:41:24.703 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-01-25T04:41:24.703 INFO:teuthology.orchestra.run.smithi116.stdout: debug mgr = 20 2023-01-25T04:41:24.703 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-01-25T04:41:24.704 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-01-25T04:41:24.704 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:41:24.704 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:41:24.704 INFO:teuthology.orchestra.run.smithi116.stdout: mgr/telemetry/nag = false 2023-01-25T04:41:24.704 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout:[mon] 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout: debug ms = 1 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout: debug mon = 20 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout: debug paxos = 20 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout: debug auth = 20 2023-01-25T04:41:24.705 INFO:teuthology.orchestra.run.smithi116.stdout: mon data avail warn = 5 2023-01-25T04:41:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: mon mgr mkfs grace = 240 2023-01-25T04:41:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min pgs per osd = 4 2023-01-25T04:41:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd reporter subtree level = osd 2023-01-25T04:41:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: mon osd prime pg temp = true 2023-01-25T04:41:24.706 INFO:teuthology.orchestra.run.smithi116.stdout: mon reweight min bytes per osd = 10 2023-01-25T04:41:24.707 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.707 INFO:teuthology.orchestra.run.smithi116.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T04:41:24.707 INFO:teuthology.orchestra.run.smithi116.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T04:41:24.707 INFO:teuthology.orchestra.run.smithi116.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T04:41:24.707 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.708 INFO:teuthology.orchestra.run.smithi116.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T04:41:24.708 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T04:41:24.708 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T04:41:24.708 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.708 INFO:teuthology.orchestra.run.smithi116.stdout: # 1m isn't quite enough 2023-01-25T04:41:24.709 INFO:teuthology.orchestra.run.smithi116.stdout: mon_down_mkfs_grace = 2m 2023-01-25T04:41:24.709 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.709 INFO:teuthology.orchestra.run.smithi116.stdout: mon_warn_on_filestore_osds = false 2023-01-25T04:41:24.709 INFO:teuthology.orchestra.run.smithi116.stdout: mon scrub interval = 300 2023-01-25T04:41:24.709 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-01-25T04:41:24.710 INFO:teuthology.orchestra.run.smithi116.stdout:[client] 2023-01-25T04:41:24.710 INFO:teuthology.orchestra.run.smithi116.stdout: rgw cache enabled = true 2023-01-25T04:41:24.710 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable ops log = true 2023-01-25T04:41:24.710 INFO:teuthology.orchestra.run.smithi116.stdout: rgw enable usage log = true 2023-01-25T04:41:24.710 INFO:teuthology.orchestra.run.smithi116.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T04:41:24.711 INFO:teuthology.orchestra.run.smithi116.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T04:41:24.711 INFO:teuthology.orchestra.run.smithi116.stdout:[mon.a] 2023-01-25T04:41:24.711 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T04:41:24.712 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T04:41:24.781 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T04:41:24.782 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:24.782 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T04:41:24.800 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:24.801 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T04:41:24.859 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:41:24.859 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:24.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T04:41:24.860 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:41:24.935 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:24.936 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:24.994 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:41:24.994 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:24.994 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T04:41:24.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T04:41:25.033 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:25.033 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:25.091 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T04:41:25.092 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T04:41:25.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T04:41:25.146 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T04:41:25.149 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T04:41:25.149 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T04:41:25.150 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T04:41:25.206 INFO:teuthology.orchestra.run.smithi116.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T04:41:25.219 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T04:41:25.220 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi116.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2023-01-25T04:41:25.220 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T04:41:25.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:25.249 INFO:tasks.ceph:role: osd.0 2023-01-25T04:41:25.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:41:25.250 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T04:41:25.322 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:25.323 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:25.323 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:25.324 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:25.324 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:25.324 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:25.324 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:25.743 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-01-25T04:41:25.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-01-25T04:41:25.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T04:41:25.920 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T04:41:25.956 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T04:41:26.024 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:26.025 INFO:tasks.ceph:role: osd.1 2023-01-25T04:41:26.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:41:26.025 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T04:41:26.100 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:26.100 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:26.100 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:26.100 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:26.101 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:26.101 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:26.101 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:26.101 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:26.101 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:26.102 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:26.526 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-01-25T04:41:26.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-01-25T04:41:26.528 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T04:41:26.633 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T04:41:26.666 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T04:41:26.733 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:26.733 INFO:tasks.ceph:role: osd.2 2023-01-25T04:41:26.733 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:41:26.734 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T04:41:26.807 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:26.808 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:26.808 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:26.808 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:26.808 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:26.809 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:26.809 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:26.809 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:26.809 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:26.809 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:27.256 INFO:teuthology.orchestra.run.smithi073.stdout:Discarding blocks...Done. 2023-01-25T04:41:27.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-01-25T04:41:27.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T04:41:27.405 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T04:41:27.437 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:27.555 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.553+0000 7f8f7b6b95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T04:41:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.556+0000 7f8f7b6b95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T04:41:27.560 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.556+0000 7f8f7b6b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:41:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.556+0000 7f8f7b6b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:41:27.561 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.556+0000 7f8f7b6b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T04:41:27.562 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:27.561+0000 7f8f7b6b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T04:41:28.090 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:28.089+0000 7f8f7b6b95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:28.855 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:28.854+0000 7f8f7b6b95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:29.617 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:29.616+0000 7f8f7b6b95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:30.409 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T04:41:30.438 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:30.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T04:41:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T04:41:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:41:30.526 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:41:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T04:41:30.527 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:30.524+0000 7f4a334985c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T04:41:31.051 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:31.050+0000 7f4a334985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:31.813 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:31.812+0000 7f4a334985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:32.576 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:32.575+0000 7f4a334985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:33.367 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T04:41:33.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:33.485 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.484+0000 7f40661725c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T04:41:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.484+0000 7f40661725c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T04:41:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.484+0000 7f40661725c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:41:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.484+0000 7f40661725c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:41:33.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.484+0000 7f40661725c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T04:41:33.487 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:33.485+0000 7f40661725c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T04:41:34.007 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:34.006+0000 7f40661725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:34.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:34.771+0000 7f40661725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:35.535 INFO:teuthology.orchestra.run.smithi073.stderr:2023-01-25T04:41:35.534+0000 7f40661725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:36.331 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T04:41:36.366 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T04:41:36.397 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:36.398 INFO:tasks.ceph:role: osd.3 2023-01-25T04:41:36.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:41:36.399 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T04:41:36.474 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:36.474 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:36.474 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:36.475 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:36.475 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:36.475 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:36.475 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:36.475 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:36.476 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:36.476 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:36.902 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-01-25T04:41:36.904 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-01-25T04:41:36.904 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2023-01-25T04:41:37.054 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T04:41:37.092 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T04:41:37.161 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:37.162 INFO:tasks.ceph:role: osd.4 2023-01-25T04:41:37.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:41:37.163 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T04:41:37.236 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:37.237 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:37.237 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:37.238 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:37.238 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:37.238 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:37.238 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:37.661 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-01-25T04:41:37.662 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-01-25T04:41:37.663 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2023-01-25T04:41:37.774 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T04:41:37.805 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T04:41:37.872 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2023-01-25T04:41:37.873 INFO:tasks.ceph:role: osd.5 2023-01-25T04:41:37.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:41:37.874 DEBUG:teuthology.orchestra.run.smithi116:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T04:41:37.947 INFO:teuthology.orchestra.run.smithi116.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T04:41:37.948 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T04:41:37.948 INFO:teuthology.orchestra.run.smithi116.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T04:41:37.948 INFO:teuthology.orchestra.run.smithi116.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T04:41:37.949 INFO:teuthology.orchestra.run.smithi116.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T04:41:37.949 INFO:teuthology.orchestra.run.smithi116.stdout: = sunit=0 swidth=0 blks 2023-01-25T04:41:37.949 INFO:teuthology.orchestra.run.smithi116.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T04:41:37.949 INFO:teuthology.orchestra.run.smithi116.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T04:41:37.950 INFO:teuthology.orchestra.run.smithi116.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T04:41:37.950 INFO:teuthology.orchestra.run.smithi116.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T04:41:38.394 INFO:teuthology.orchestra.run.smithi116.stdout:Discarding blocks...Done. 2023-01-25T04:41:38.396 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi116.front.sepia.ceph.com -o noatime 2023-01-25T04:41:38.396 DEBUG:teuthology.orchestra.run.smithi116:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2023-01-25T04:41:38.562 DEBUG:teuthology.orchestra.run.smithi116:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T04:41:38.595 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:38.691 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.689+0000 7f73350645c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T04:41:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.692+0000 7f73350645c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T04:41:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.692+0000 7f73350645c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:41:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.692+0000 7f73350645c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:41:38.694 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.692+0000 7f73350645c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T04:41:38.697 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:38.695+0000 7f73350645c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T04:41:39.220 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:39.219+0000 7f73350645c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:39.981 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:39.979+0000 7f73350645c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:40.743 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:40.742+0000 7f73350645c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:41.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T04:41:41.564 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:41.653 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.651+0000 7fcb347015c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T04:41:41.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.651+0000 7fcb347015c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T04:41:41.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.651+0000 7fcb347015c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:41:41.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.651+0000 7fcb347015c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:41:41.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.651+0000 7fcb347015c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T04:41:41.654 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:41.652+0000 7fcb347015c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T04:41:42.177 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:42.175+0000 7fcb347015c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:42.940 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:42.939+0000 7fcb347015c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:43.707 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:43.705+0000 7fcb347015c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:44.505 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T04:41:44.538 DEBUG:teuthology.orchestra.run.smithi116:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:44.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.629+0000 7fe25cc715c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T04:41:44.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.630+0000 7fe25cc715c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T04:41:44.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.630+0000 7fe25cc715c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:41:44.632 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.630+0000 7fe25cc715c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:41:44.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.630+0000 7fe25cc715c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T04:41:44.633 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:44.630+0000 7fe25cc715c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T04:41:45.159 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:45.157+0000 7fe25cc715c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:45.924 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:45.923+0000 7fe25cc715c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:46.693 INFO:teuthology.orchestra.run.smithi116.stderr:2023-01-25T04:41:46.691+0000 7fe25cc715c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T04:41:47.484 DEBUG:teuthology.orchestra.run.smithi116:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T04:41:47.515 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T04:41:47.515 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:47.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T04:41:47.545 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:47.545 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T04:41:47.613 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:47.613 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T04:41:47.680 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:47.681 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T04:41:47.748 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:47.749 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T04:41:47.781 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:47.781 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T04:41:47.852 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:47.852 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T04:41:47.920 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:47.920 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T04:41:47.979 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T04:41:47.979 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T04:41:48.005 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-01-25T04:41:48.006 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD1stBjcNK6CBAAWJrcqKT/OQwErb30/kleQA== 2023-01-25T04:41:48.006 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-01-25T04:41:48.006 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD3stBj+ZgPIRAA7yJWJ1DqtE+uO1B49BlLMQ== 2023-01-25T04:41:48.006 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-01-25T04:41:48.007 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD6stBjYxJJHxAAt/WAmHmCGqP8XCQMkLVMJQ== 2023-01-25T04:41:48.007 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-01-25T04:41:48.007 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD9stBjOAzsHBAAVNw8KctbPGg0hxxZqjg/nw== 2023-01-25T04:41:48.007 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-01-25T04:41:48.008 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQACs9BjkgA0KRAA+2rY057n4d/1MnUGgJmyEg== 2023-01-25T04:41:48.008 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-01-25T04:41:48.008 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAFs9BjSYnqJhAAgmJ7JpwnFQ3KAqdrOFCmEA== 2023-01-25T04:41:48.008 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-01-25T04:41:48.008 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAIs9BjdEKfJRAABUiuETVRUPSPj8/UAiIYUQ== 2023-01-25T04:41:48.009 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-01-25T04:41:48.009 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD1stBjqPtPDBAA0f5I3NhuK1LpIjJ6/tR/3A== 2023-01-25T04:41:48.010 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T04:41:48.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.156 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.263 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.316 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.370 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T04:41:48.424 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T04:41:48.480 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T04:41:48.481 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T04:41:48.508 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T04:41:48.605 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T04:41:48.633 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T04:41:48.690 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T04:41:48.691 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T04:41:48.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T04:41:48.733 INFO:tasks.ceph.mon.a:Started 2023-01-25T04:41:48.733 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph config set mgr mgr_pool false --force 2023-01-25T04:41:48.950 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T04:41:48.951 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T04:41:48.951 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T04:41:48.953 INFO:tasks.ceph.mgr.x:Started 2023-01-25T04:41:48.954 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T04:41:48.954 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T04:41:49.163 INFO:teuthology.orchestra.run.smithi073.stderr:adjusted tunables profile to default 2023-01-25T04:41:49.174 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T04:41:49.175 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:49.175 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T04:41:49.202 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:49.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T04:41:49.270 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-01-25T04:41:49.270 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T04:41:49.338 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:49.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T04:41:49.369 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:49.370 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T04:41:49.440 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-01-25T04:41:49.441 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T04:41:49.510 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new b6c01828-e152-472c-b71e-e2fe7f488697 0 2023-01-25T04:41:49.759 INFO:teuthology.orchestra.run.smithi116.stdout:0 2023-01-25T04:41:49.772 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new fc232c4e-1e5b-4d9f-a778-6aba445cba93 1 2023-01-25T04:41:49.953 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:49.951+0000 7f22a6826200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T04:41:49.978 INFO:teuthology.orchestra.run.smithi116.stdout:1 2023-01-25T04:41:49.990 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 0f2a2a0c-6842-4f14-a063-fdd6dc7b4376 2 2023-01-25T04:41:50.023 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:50.021+0000 7f22a6826200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T04:41:50.100 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:50.098+0000 7f22a6826200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T04:41:50.195 INFO:teuthology.orchestra.run.smithi116.stdout:2 2023-01-25T04:41:50.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new c3df79ac-718d-40d3-9985-5f25177455a5 3 2023-01-25T04:41:50.284 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:50.282+0000 7f22a6826200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T04:41:50.414 INFO:teuthology.orchestra.run.smithi116.stdout:3 2023-01-25T04:41:50.427 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new ec9480dd-9be7-4085-9217-5285e74262e5 4 2023-01-25T04:41:50.835 INFO:teuthology.orchestra.run.smithi116.stdout:4 2023-01-25T04:41:50.848 DEBUG:teuthology.orchestra.run.smithi116:> sudo ceph --cluster ceph osd new 43770fd6-fdb2-4ee4-88a8-19db4fbb9044 5 2023-01-25T04:41:51.054 INFO:teuthology.orchestra.run.smithi116.stdout:5 2023-01-25T04:41:51.067 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T04:41:51.069 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T04:41:51.070 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.065+0000 7f22a6826200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T04:41:51.073 INFO:tasks.ceph.osd.0:Started 2023-01-25T04:41:51.073 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T04:41:51.074 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T04:41:51.077 INFO:tasks.ceph.osd.1:Started 2023-01-25T04:41:51.078 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T04:41:51.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T04:41:51.081 INFO:tasks.ceph.osd.2:Started 2023-01-25T04:41:51.082 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T04:41:51.082 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T04:41:51.086 INFO:tasks.ceph.osd.3:Started 2023-01-25T04:41:51.086 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T04:41:51.086 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T04:41:51.088 INFO:tasks.ceph.osd.4:Started 2023-01-25T04:41:51.089 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T04:41:51.089 DEBUG:teuthology.orchestra.run.smithi116:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T04:41:51.091 INFO:tasks.ceph.osd.5:Started 2023-01-25T04:41:51.092 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:41:51.237 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.235+0000 7f22a6826200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T04:41:51.307 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:41:51.307 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":8,"fsid":"d6d96f12-c813-4803-b909-703b72cf3701","created":"2023-01-25T04:41:48.854872+0000","modified":"2023-01-25T04:41:51.050842+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T04:41:51.050842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b6c01828-e152-472c-b71e-e2fe7f488697","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc232c4e-1e5b-4d9f-a778-6aba445cba93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0f2a2a0c-6842-4f14-a063-fdd6dc7b4376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c3df79ac-718d-40d3-9985-5f25177455a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ec9480dd-9be7-4085-9217-5285e74262e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"43770fd6-fdb2-4ee4-88a8-19db4fbb9044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:41:51.320 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T04:41:51.320 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T04:41:51.463 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.461+0000 7f22a6826200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T04:41:51.534 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.532+0000 7f22a6826200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T04:41:51.668 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.666+0000 7f22a6826200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:41:51.679 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-01-25T04:41:51.678+0000 7f32294405c0 -1 Falling back to public interface 2023-01-25T04:41:51.684 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-01-25T04:41:51.683+0000 7f1878e7a5c0 -1 Falling back to public interface 2023-01-25T04:41:51.684 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-01-25T04:41:51.683+0000 7f30cb98b5c0 -1 Falling back to public interface 2023-01-25T04:41:51.685 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-01-25T04:41:51.684+0000 7f30c2d39700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2023-01-25T04:41:51.687 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:51.685+0000 7f06924fa5c0 -1 Falling back to public interface 2023-01-25T04:41:51.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-01-25T04:41:51.685+0000 7f950724c5c0 -1 Falling back to public interface 2023-01-25T04:41:51.688 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-01-25T04:41:51.685+0000 7f94fe5fa700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-01-25T04:41:51.688 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:51.685+0000 7f06898a8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-01-25T04:41:51.689 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:51.686+0000 7f06898a8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2023-01-25T04:41:51.708 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-01-25T04:41:51.706+0000 7fe9646035c0 -1 Falling back to public interface 2023-01-25T04:41:51.926 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T04:41:51.931 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:51.929+0000 7f22a6826200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T04:41:52.121 INFO:teuthology.misc.health.smithi073.stdout: 2023-01-25T04:41:52.121 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":8,"fsid":"d6d96f12-c813-4803-b909-703b72cf3701","created":"2023-01-25T04:41:48.854872+0000","modified":"2023-01-25T04:41:51.050842+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T04:41:51.050842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b6c01828-e152-472c-b71e-e2fe7f488697","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fc232c4e-1e5b-4d9f-a778-6aba445cba93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"0f2a2a0c-6842-4f14-a063-fdd6dc7b4376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c3df79ac-718d-40d3-9985-5f25177455a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ec9480dd-9be7-4085-9217-5285e74262e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"43770fd6-fdb2-4ee4-88a8-19db4fbb9044","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:41:52.121 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.119+0000 7f22a6826200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T04:41:52.132 DEBUG:teuthology.misc:0 of 6 OSDs are up 2023-01-25T04:41:52.263 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.261+0000 7f22a6826200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T04:41:52.375 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.373+0000 7f22a6826200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T04:41:52.513 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.512+0000 7f22a6826200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T04:41:52.591 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.589+0000 7f22a6826200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T04:41:52.805 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.803+0000 7f22a6826200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T04:41:52.882 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:52.880+0000 7f22a6826200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T04:41:53.495 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:53.494+0000 7f22a6826200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T04:41:53.750 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:53.748+0000 7f22a6826200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T04:41:53.823 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:53.822+0000 7f22a6826200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T04:41:53.905 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:53.904+0000 7f22a6826200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T04:41:54.086 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:54.085+0000 7f22a6826200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T04:41:54.162 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:54.160+0000 7f22a6826200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T04:41:54.314 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:54.313+0000 7f22a6826200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T04:41:55.097 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-01-25T04:41:55.097+0000 7f32294405c0 -1 osd.4 0 log_to_monitors true 2023-01-25T04:41:55.144 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-01-25T04:41:55.144+0000 7f1878e7a5c0 -1 osd.5 0 log_to_monitors true 2023-01-25T04:41:55.186 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-01-25T04:41:55.186+0000 7f30cb98b5c0 -1 osd.3 0 log_to_monitors true 2023-01-25T04:41:55.208 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-01-25T04:41:55.207+0000 7f950724c5c0 -1 osd.1 0 log_to_monitors true 2023-01-25T04:41:55.218 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:55.217+0000 7f06924fa5c0 -1 osd.0 0 log_to_monitors true 2023-01-25T04:41:55.252 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-01-25T04:41:55.251+0000 7fe9646035c0 -1 osd.2 0 log_to_monitors true 2023-01-25T04:41:55.333 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-01-25T04:41:55.332+0000 7f226039f700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-01-25T04:41:56.839 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-01-25T04:41:56.839+0000 7f30bf532700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T04:41:56.840 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-01-25T04:41:56.839+0000 7f321cfe7700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T04:41:56.840 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-01-25T04:41:56.839+0000 7f186ca21700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T04:41:56.841 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-01-25T04:41:56.840+0000 7fe9581aa700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T04:41:56.841 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:56.841+0000 7f06860a1700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T04:41:56.842 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-01-25T04:41:56.841+0000 7f94fadf3700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T04:41:56.844 INFO:tasks.ceph.osd.4.smithi116.stderr:2023-01-25T04:41:56.843+0000 7f3218bc9700 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:56.844 INFO:tasks.ceph.osd.5.smithi116.stderr:2023-01-25T04:41:56.843+0000 7f1868603700 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:56.845 INFO:tasks.ceph.osd.3.smithi116.stderr:2023-01-25T04:41:56.844+0000 7f30bb114700 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:56.847 INFO:tasks.ceph.osd.2.smithi073.stderr:2023-01-25T04:41:56.847+0000 7fe953d8c700 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:56.848 INFO:tasks.ceph.osd.1.smithi073.stderr:2023-01-25T04:41:56.847+0000 7f94f69d5700 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:56.848 INFO:tasks.ceph.osd.0.smithi073.stderr:2023-01-25T04:41:56.847+0000 7f0681c83700 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T04:41:58.737 DEBUG:teuthology.orchestra.run.smithi073:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T04:41:59.062 INFO:teuthology.misc.health.smithi073.stdout: 2023-01-25T04:41:59.062 INFO:teuthology.misc.health.smithi073.stdout:{"epoch":12,"fsid":"d6d96f12-c813-4803-b909-703b72cf3701","created":"2023-01-25T04:41:48.854872+0000","modified":"2023-01-25T04:41:58.838471+0000","last_up_change":"2023-01-25T04:41:57.826530+0000","last_in_change":"2023-01-25T04:41:51.050842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"b6c01828-e152-472c-b71e-e2fe7f488697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":104763},{"type":"v1","addr":"172.21.15.73:6801","nonce":104763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":104763},{"type":"v1","addr":"172.21.15.73:6806","nonce":104763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":104763},{"type":"v1","addr":"172.21.15.73:6814","nonce":104763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":104763},{"type":"v1","addr":"172.21.15.73:6810","nonce":104763}]},"public_addr":"172.21.15.73:6801/104763","cluster_addr":"172.21.15.73:6806/104763","heartbeat_back_addr":"172.21.15.73:6814/104763","heartbeat_front_addr":"172.21.15.73:6810/104763","state":["exists","up"]},{"osd":1,"uuid":"fc232c4e-1e5b-4d9f-a778-6aba445cba93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":104764},{"type":"v1","addr":"172.21.15.73:6803","nonce":104764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":104764},{"type":"v1","addr":"172.21.15.73:6807","nonce":104764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":104764},{"type":"v1","addr":"172.21.15.73:6815","nonce":104764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":104764},{"type":"v1","addr":"172.21.15.73:6811","nonce":104764}]},"public_addr":"172.21.15.73:6803/104764","cluster_addr":"172.21.15.73:6807/104764","heartbeat_back_addr":"172.21.15.73:6815/104764","heartbeat_front_addr":"172.21.15.73:6811/104764","state":["exists","up"]},{"osd":2,"uuid":"0f2a2a0c-6842-4f14-a063-fdd6dc7b4376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":104787},{"type":"v1","addr":"172.21.15.73:6817","nonce":104787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":104787},{"type":"v1","addr":"172.21.15.73:6819","nonce":104787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":104787},{"type":"v1","addr":"172.21.15.73:6823","nonce":104787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":104787},{"type":"v1","addr":"172.21.15.73:6821","nonce":104787}]},"public_addr":"172.21.15.73:6817/104787","cluster_addr":"172.21.15.73:6819/104787","heartbeat_back_addr":"172.21.15.73:6823/104787","heartbeat_front_addr":"172.21.15.73:6821/104787","state":["exists","up"]},{"osd":3,"uuid":"c3df79ac-718d-40d3-9985-5f25177455a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":104203},{"type":"v1","addr":"172.21.15.116:6812","nonce":104203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":104203},{"type":"v1","addr":"172.21.15.116:6816","nonce":104203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":104203},{"type":"v1","addr":"172.21.15.116:6823","nonce":104203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":104203},{"type":"v1","addr":"172.21.15.116:6820","nonce":104203}]},"public_addr":"172.21.15.116:6812/104203","cluster_addr":"172.21.15.116:6816/104203","heartbeat_back_addr":"172.21.15.116:6823/104203","heartbeat_front_addr":"172.21.15.116:6820/104203","state":["exists","up"]},{"osd":4,"uuid":"ec9480dd-9be7-4085-9217-5285e74262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":104204},{"type":"v1","addr":"172.21.15.116:6801","nonce":104204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":104204},{"type":"v1","addr":"172.21.15.116:6803","nonce":104204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":104204},{"type":"v1","addr":"172.21.15.116:6807","nonce":104204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":104204},{"type":"v1","addr":"172.21.15.116:6805","nonce":104204}]},"public_addr":"172.21.15.116:6801/104204","cluster_addr":"172.21.15.116:6803/104204","heartbeat_back_addr":"172.21.15.116:6807/104204","heartbeat_front_addr":"172.21.15.116:6805/104204","state":["exists","up"]},{"osd":5,"uuid":"43770fd6-fdb2-4ee4-88a8-19db4fbb9044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":104205},{"type":"v1","addr":"172.21.15.116:6809","nonce":104205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":104205},{"type":"v1","addr":"172.21.15.116:6813","nonce":104205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":104205},{"type":"v1","addr":"172.21.15.116:6821","nonce":104205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":104205},{"type":"v1","addr":"172.21.15.116:6817","nonce":104205}]},"public_addr":"172.21.15.116:6809/104205","cluster_addr":"172.21.15.116:6813/104205","heartbeat_back_addr":"172.21.15.116:6821/104205","heartbeat_front_addr":"172.21.15.116:6817/104205","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.215462+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.247885+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.246213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.162787+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.113017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.188904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:41:59.075 DEBUG:teuthology.misc:6 of 6 OSDs are up 2023-01-25T04:41:59.075 INFO:tasks.ceph:Creating RBD pool 2023-01-25T04:41:59.076 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T04:41:59.849 INFO:teuthology.orchestra.run.smithi073.stderr:pool 'rbd' created 2023-01-25T04:41:59.862 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T04:42:00.857 INFO:teuthology.orchestra.run.smithi073.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T04:42:00.869 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T04:42:00.869 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T04:42:00.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T04:42:00.870 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T04:42:00.870 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T04:42:01.236 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:01.249 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":104518},{"type":"v1","addr":"172.21.15.73:6825","nonce":104518}]},"active_addr":"172.21.15.73:6825/104518","active_change":"2023-01-25T04:41:54.326708+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":3940309082}]},{"addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":1375685276}]},{"addrvec":[{"type":"v2","addr":"172.21.15.73:0","nonce":42126842}]}]}} 2023-01-25T04:42:01.251 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T04:42:01.252 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T04:42:01.253 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:42:01.563 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:01.563 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":14,"fsid":"d6d96f12-c813-4803-b909-703b72cf3701","created":"2023-01-25T04:41:48.854872+0000","modified":"2023-01-25T04:42:00.844131+0000","last_up_change":"2023-01-25T04:41:57.826530+0000","last_in_change":"2023-01-25T04:41:51.050842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T04:41:59.403931+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6c01828-e152-472c-b71e-e2fe7f488697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":104763},{"type":"v1","addr":"172.21.15.73:6801","nonce":104763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":104763},{"type":"v1","addr":"172.21.15.73:6806","nonce":104763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":104763},{"type":"v1","addr":"172.21.15.73:6814","nonce":104763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":104763},{"type":"v1","addr":"172.21.15.73:6810","nonce":104763}]},"public_addr":"172.21.15.73:6801/104763","cluster_addr":"172.21.15.73:6806/104763","heartbeat_back_addr":"172.21.15.73:6814/104763","heartbeat_front_addr":"172.21.15.73:6810/104763","state":["exists","up"]},{"osd":1,"uuid":"fc232c4e-1e5b-4d9f-a778-6aba445cba93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":104764},{"type":"v1","addr":"172.21.15.73:6803","nonce":104764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":104764},{"type":"v1","addr":"172.21.15.73:6807","nonce":104764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":104764},{"type":"v1","addr":"172.21.15.73:6815","nonce":104764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":104764},{"type":"v1","addr":"172.21.15.73:6811","nonce":104764}]},"public_addr":"172.21.15.73:6803/104764","cluster_addr":"172.21.15.73:6807/104764","heartbeat_back_addr":"172.21.15.73:6815/104764","heartbeat_front_addr":"172.21.15.73:6811/104764","state":["exists","up"]},{"osd":2,"uuid":"0f2a2a0c-6842-4f14-a063-fdd6dc7b4376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":104787},{"type":"v1","addr":"172.21.15.73:6817","nonce":104787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":104787},{"type":"v1","addr":"172.21.15.73:6819","nonce":104787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":104787},{"type":"v1","addr":"172.21.15.73:6823","nonce":104787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":104787},{"type":"v1","addr":"172.21.15.73:6821","nonce":104787}]},"public_addr":"172.21.15.73:6817/104787","cluster_addr":"172.21.15.73:6819/104787","heartbeat_back_addr":"172.21.15.73:6823/104787","heartbeat_front_addr":"172.21.15.73:6821/104787","state":["exists","up"]},{"osd":3,"uuid":"c3df79ac-718d-40d3-9985-5f25177455a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":104203},{"type":"v1","addr":"172.21.15.116:6812","nonce":104203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":104203},{"type":"v1","addr":"172.21.15.116:6816","nonce":104203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":104203},{"type":"v1","addr":"172.21.15.116:6823","nonce":104203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":104203},{"type":"v1","addr":"172.21.15.116:6820","nonce":104203}]},"public_addr":"172.21.15.116:6812/104203","cluster_addr":"172.21.15.116:6816/104203","heartbeat_back_addr":"172.21.15.116:6823/104203","heartbeat_front_addr":"172.21.15.116:6820/104203","state":["exists","up"]},{"osd":4,"uuid":"ec9480dd-9be7-4085-9217-5285e74262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":104204},{"type":"v1","addr":"172.21.15.116:6801","nonce":104204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":104204},{"type":"v1","addr":"172.21.15.116:6803","nonce":104204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":104204},{"type":"v1","addr":"172.21.15.116:6807","nonce":104204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":104204},{"type":"v1","addr":"172.21.15.116:6805","nonce":104204}]},"public_addr":"172.21.15.116:6801/104204","cluster_addr":"172.21.15.116:6803/104204","heartbeat_back_addr":"172.21.15.116:6807/104204","heartbeat_front_addr":"172.21.15.116:6805/104204","state":["exists","up"]},{"osd":5,"uuid":"43770fd6-fdb2-4ee4-88a8-19db4fbb9044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":104205},{"type":"v1","addr":"172.21.15.116:6809","nonce":104205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":104205},{"type":"v1","addr":"172.21.15.116:6813","nonce":104205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":104205},{"type":"v1","addr":"172.21.15.116:6821","nonce":104205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":104205},{"type":"v1","addr":"172.21.15.116:6817","nonce":104205}]},"public_addr":"172.21.15.116:6809/104205","cluster_addr":"172.21.15.116:6813/104205","heartbeat_back_addr":"172.21.15.116:6821/104205","heartbeat_front_addr":"172.21.15.116:6817/104205","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.215462+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.247885+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.246213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.162787+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.113017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.188904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:42:01.577 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T04:42:01.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T04:42:01.889 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:01.890 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":15,"fsid":"d6d96f12-c813-4803-b909-703b72cf3701","created":"2023-01-25T04:41:48.854872+0000","modified":"2023-01-25T04:42:01.846428+0000","last_up_change":"2023-01-25T04:41:57.826530+0000","last_in_change":"2023-01-25T04:41:51.050842+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T04:41:59.403931+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b6c01828-e152-472c-b71e-e2fe7f488697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":104763},{"type":"v1","addr":"172.21.15.73:6801","nonce":104763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":104763},{"type":"v1","addr":"172.21.15.73:6806","nonce":104763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":104763},{"type":"v1","addr":"172.21.15.73:6814","nonce":104763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":104763},{"type":"v1","addr":"172.21.15.73:6810","nonce":104763}]},"public_addr":"172.21.15.73:6801/104763","cluster_addr":"172.21.15.73:6806/104763","heartbeat_back_addr":"172.21.15.73:6814/104763","heartbeat_front_addr":"172.21.15.73:6810/104763","state":["exists","up"]},{"osd":1,"uuid":"fc232c4e-1e5b-4d9f-a778-6aba445cba93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":104764},{"type":"v1","addr":"172.21.15.73:6803","nonce":104764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":104764},{"type":"v1","addr":"172.21.15.73:6807","nonce":104764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6813","nonce":104764},{"type":"v1","addr":"172.21.15.73:6815","nonce":104764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":104764},{"type":"v1","addr":"172.21.15.73:6811","nonce":104764}]},"public_addr":"172.21.15.73:6803/104764","cluster_addr":"172.21.15.73:6807/104764","heartbeat_back_addr":"172.21.15.73:6815/104764","heartbeat_front_addr":"172.21.15.73:6811/104764","state":["exists","up"]},{"osd":2,"uuid":"0f2a2a0c-6842-4f14-a063-fdd6dc7b4376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":104787},{"type":"v1","addr":"172.21.15.73:6817","nonce":104787}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":104787},{"type":"v1","addr":"172.21.15.73:6819","nonce":104787}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":104787},{"type":"v1","addr":"172.21.15.73:6823","nonce":104787}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":104787},{"type":"v1","addr":"172.21.15.73:6821","nonce":104787}]},"public_addr":"172.21.15.73:6817/104787","cluster_addr":"172.21.15.73:6819/104787","heartbeat_back_addr":"172.21.15.73:6823/104787","heartbeat_front_addr":"172.21.15.73:6821/104787","state":["exists","up"]},{"osd":3,"uuid":"c3df79ac-718d-40d3-9985-5f25177455a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":104203},{"type":"v1","addr":"172.21.15.116:6812","nonce":104203}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":104203},{"type":"v1","addr":"172.21.15.116:6816","nonce":104203}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":104203},{"type":"v1","addr":"172.21.15.116:6823","nonce":104203}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":104203},{"type":"v1","addr":"172.21.15.116:6820","nonce":104203}]},"public_addr":"172.21.15.116:6812/104203","cluster_addr":"172.21.15.116:6816/104203","heartbeat_back_addr":"172.21.15.116:6823/104203","heartbeat_front_addr":"172.21.15.116:6820/104203","state":["exists","up"]},{"osd":4,"uuid":"ec9480dd-9be7-4085-9217-5285e74262e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":104204},{"type":"v1","addr":"172.21.15.116:6801","nonce":104204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":104204},{"type":"v1","addr":"172.21.15.116:6803","nonce":104204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":104204},{"type":"v1","addr":"172.21.15.116:6807","nonce":104204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":104204},{"type":"v1","addr":"172.21.15.116:6805","nonce":104204}]},"public_addr":"172.21.15.116:6801/104204","cluster_addr":"172.21.15.116:6803/104204","heartbeat_back_addr":"172.21.15.116:6807/104204","heartbeat_front_addr":"172.21.15.116:6805/104204","state":["exists","up"]},{"osd":5,"uuid":"43770fd6-fdb2-4ee4-88a8-19db4fbb9044","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":104205},{"type":"v1","addr":"172.21.15.116:6809","nonce":104205}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6811","nonce":104205},{"type":"v1","addr":"172.21.15.116:6813","nonce":104205}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6819","nonce":104205},{"type":"v1","addr":"172.21.15.116:6821","nonce":104205}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6815","nonce":104205},{"type":"v1","addr":"172.21.15.116:6817","nonce":104205}]},"public_addr":"172.21.15.116:6809/104205","cluster_addr":"172.21.15.116:6813/104205","heartbeat_back_addr":"172.21.15.116:6821/104205","heartbeat_front_addr":"172.21.15.116:6817/104205","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.215462+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.247885+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.246213+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.162787+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.113017+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T04:41:56.188904+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T04:42:01.903 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T04:42:01.904 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T04:42:01.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T04:42:01.905 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T04:42:01.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T04:42:01.906 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T04:42:02.102 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T04:42:02.120 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:02.120 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T04:42:02.150 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.151 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T04:42:02.158 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:02.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T04:42:02.170 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.171 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T04:42:02.173 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:02.174 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T04:42:02.580 INFO:teuthology.orchestra.run.smithi073.stdout:47244640258 2023-01-25T04:42:02.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2023-01-25T04:42:02.604 INFO:teuthology.orchestra.run.smithi073.stdout:47244640258 2023-01-25T04:42:02.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2023-01-25T04:42:02.667 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.4 2023-01-25T04:42:02.690 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.705 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.1 2023-01-25T04:42:02.761 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:02.763 INFO:teuthology.orchestra.run.smithi073.stdout:47244640258 2023-01-25T04:42:02.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640259 for osd.3 2023-01-25T04:42:02.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2023-01-25T04:42:03.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T04:42:03.620 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T04:42:03.683 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T04:42:03.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T04:42:03.777 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T04:42:03.778 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T04:42:03.994 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:04.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2023-01-25T04:42:04.030 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.105 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:04.111 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:04.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.1 2023-01-25T04:42:04.127 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.128 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.4 2023-01-25T04:42:04.129 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.155 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:04.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2023-01-25T04:42:04.170 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.217 INFO:teuthology.orchestra.run.smithi073.stdout:47244640260 2023-01-25T04:42:04.230 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640260 got 47244640260 for osd.3 2023-01-25T04:42:04.231 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.254 INFO:teuthology.orchestra.run.smithi073.stdout:47244640259 2023-01-25T04:42:04.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2023-01-25T04:42:04.269 DEBUG:teuthology.parallel:result is None 2023-01-25T04:42:04.269 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T04:42:04.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:42:04.617 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:04.619 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-01-25T04:42:04.630 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-25T04:42:04.332536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":30024,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":29248,"kb_avail":566201016,"statfs":{"total":579820584960,"available":579789840384,"internally_reserved":0,"allocated":745472,"data_stored":221896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29949952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132911+0000","last_change":"2023-01-25T04:42:00.855615+0000","last_active":"2023-01-25T04:42:02.132911+0000","last_peered":"2023-01-25T04:42:02.132911+0000","last_clean":"2023-01-25T04:42:02.132911+0000","last_became_active":"2023-01-25T04:42:00.855242+0000","last_became_peered":"2023-01-25T04:42:00.855242+0000","last_unstale":"2023-01-25T04:42:02.132911+0000","last_undegraded":"2023-01-25T04:42:02.132911+0000","last_fullsized":"2023-01-25T04:42:02.132911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T09:41:46.459356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132893+0000","last_change":"2023-01-25T04:42:00.855593+0000","last_active":"2023-01-25T04:42:02.132893+0000","last_peered":"2023-01-25T04:42:02.132893+0000","last_clean":"2023-01-25T04:42:02.132893+0000","last_became_active":"2023-01-25T04:42:00.855259+0000","last_became_peered":"2023-01-25T04:42:00.855259+0000","last_unstale":"2023-01-25T04:42:02.132893+0000","last_undegraded":"2023-01-25T04:42:02.132893+0000","last_fullsized":"2023-01-25T04:42:02.132893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T04:44:03.098726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.125095+0000","last_change":"2023-01-25T04:42:00.854531+0000","last_active":"2023-01-25T04:42:02.125095+0000","last_peered":"2023-01-25T04:42:02.125095+0000","last_clean":"2023-01-25T04:42:02.125095+0000","last_became_active":"2023-01-25T04:42:00.854274+0000","last_became_peered":"2023-01-25T04:42:00.854274+0000","last_unstale":"2023-01-25T04:42:02.125095+0000","last_undegraded":"2023-01-25T04:42:02.125095+0000","last_fullsized":"2023-01-25T04:42:02.125095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:39:33.005102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132859+0000","last_change":"2023-01-25T04:42:00.923977+0000","last_active":"2023-01-25T04:42:02.132859+0000","last_peered":"2023-01-25T04:42:02.132859+0000","last_clean":"2023-01-25T04:42:02.132859+0000","last_became_active":"2023-01-25T04:42:00.923726+0000","last_became_peered":"2023-01-25T04:42:00.923726+0000","last_unstale":"2023-01-25T04:42:02.132859+0000","last_undegraded":"2023-01-25T04:42:02.132859+0000","last_fullsized":"2023-01-25T04:42:02.132859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T16:35:52.208308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-01-25T04:42:01.858042+0000","last_change":"2023-01-25T04:42:00.855270+0000","last_active":"2023-01-25T04:42:01.858042+0000","last_peered":"2023-01-25T04:42:01.858042+0000","last_clean":"2023-01-25T04:42:01.858042+0000","last_became_active":"2023-01-25T04:42:00.854988+0000","last_became_peered":"2023-01-25T04:42:00.854988+0000","last_unstale":"2023-01-25T04:42:01.858042+0000","last_undegraded":"2023-01-25T04:42:01.858042+0000","last_fullsized":"2023-01-25T04:42:01.858042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:14:00.435228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.100961+0000","last_change":"2023-01-25T04:42:00.855919+0000","last_active":"2023-01-25T04:42:02.100961+0000","last_peered":"2023-01-25T04:42:02.100961+0000","last_clean":"2023-01-25T04:42:02.100961+0000","last_became_active":"2023-01-25T04:42:00.855607+0000","last_became_peered":"2023-01-25T04:42:00.855607+0000","last_unstale":"2023-01-25T04:42:02.100961+0000","last_undegraded":"2023-01-25T04:42:02.100961+0000","last_fullsized":"2023-01-25T04:42:02.100961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:05:48.483360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.152905+0000","last_change":"2023-01-25T04:42:00.854877+0000","last_active":"2023-01-25T04:42:02.152905+0000","last_peered":"2023-01-25T04:42:02.152905+0000","last_clean":"2023-01-25T04:42:02.152905+0000","last_became_active":"2023-01-25T04:42:00.854570+0000","last_became_peered":"2023-01-25T04:42:00.854570+0000","last_unstale":"2023-01-25T04:42:02.152905+0000","last_undegraded":"2023-01-25T04:42:02.152905+0000","last_fullsized":"2023-01-25T04:42:02.152905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T06:24:07.141097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.125112+0000","last_change":"2023-01-25T04:42:00.854329+0000","last_active":"2023-01-25T04:42:02.125112+0000","last_peered":"2023-01-25T04:42:02.125112+0000","last_clean":"2023-01-25T04:42:02.125112+0000","last_became_active":"2023-01-25T04:42:00.854015+0000","last_became_peered":"2023-01-25T04:42:00.854015+0000","last_unstale":"2023-01-25T04:42:02.125112+0000","last_undegraded":"2023-01-25T04:42:02.125112+0000","last_fullsized":"2023-01-25T04:42:02.125112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:37:29.900605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5056,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366784,"statfs":{"total":96636764160,"available":96631586816,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5000,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366840,"statfs":{"total":96636764160,"available":96631644160,"internally_reserved":0,"allocated":131072,"data_stored":40731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:42:04.631 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T04:42:04.941 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:04.943 INFO:teuthology.orchestra.run.smithi073.stderr:dumped all 2023-01-25T04:42:04.955 INFO:teuthology.orchestra.run.smithi073.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-25T04:42:04.332536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":30024,"kb_used_data":728,"kb_used_omap":0,"kb_used_meta":29248,"kb_avail":566201016,"statfs":{"total":579820584960,"available":579789840384,"internally_reserved":0,"allocated":745472,"data_stored":221896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29949952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132911+0000","last_change":"2023-01-25T04:42:00.855615+0000","last_active":"2023-01-25T04:42:02.132911+0000","last_peered":"2023-01-25T04:42:02.132911+0000","last_clean":"2023-01-25T04:42:02.132911+0000","last_became_active":"2023-01-25T04:42:00.855242+0000","last_became_peered":"2023-01-25T04:42:00.855242+0000","last_unstale":"2023-01-25T04:42:02.132911+0000","last_undegraded":"2023-01-25T04:42:02.132911+0000","last_fullsized":"2023-01-25T04:42:02.132911+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T09:41:46.459356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132893+0000","last_change":"2023-01-25T04:42:00.855593+0000","last_active":"2023-01-25T04:42:02.132893+0000","last_peered":"2023-01-25T04:42:02.132893+0000","last_clean":"2023-01-25T04:42:02.132893+0000","last_became_active":"2023-01-25T04:42:00.855259+0000","last_became_peered":"2023-01-25T04:42:00.855259+0000","last_unstale":"2023-01-25T04:42:02.132893+0000","last_undegraded":"2023-01-25T04:42:02.132893+0000","last_fullsized":"2023-01-25T04:42:02.132893+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T04:44:03.098726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.125095+0000","last_change":"2023-01-25T04:42:00.854531+0000","last_active":"2023-01-25T04:42:02.125095+0000","last_peered":"2023-01-25T04:42:02.125095+0000","last_clean":"2023-01-25T04:42:02.125095+0000","last_became_active":"2023-01-25T04:42:00.854274+0000","last_became_peered":"2023-01-25T04:42:00.854274+0000","last_unstale":"2023-01-25T04:42:02.125095+0000","last_undegraded":"2023-01-25T04:42:02.125095+0000","last_fullsized":"2023-01-25T04:42:02.125095+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:39:33.005102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.132859+0000","last_change":"2023-01-25T04:42:00.923977+0000","last_active":"2023-01-25T04:42:02.132859+0000","last_peered":"2023-01-25T04:42:02.132859+0000","last_clean":"2023-01-25T04:42:02.132859+0000","last_became_active":"2023-01-25T04:42:00.923726+0000","last_became_peered":"2023-01-25T04:42:00.923726+0000","last_unstale":"2023-01-25T04:42:02.132859+0000","last_undegraded":"2023-01-25T04:42:02.132859+0000","last_fullsized":"2023-01-25T04:42:02.132859+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T16:35:52.208308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-01-25T04:42:01.858042+0000","last_change":"2023-01-25T04:42:00.855270+0000","last_active":"2023-01-25T04:42:01.858042+0000","last_peered":"2023-01-25T04:42:01.858042+0000","last_clean":"2023-01-25T04:42:01.858042+0000","last_became_active":"2023-01-25T04:42:00.854988+0000","last_became_peered":"2023-01-25T04:42:00.854988+0000","last_unstale":"2023-01-25T04:42:01.858042+0000","last_undegraded":"2023-01-25T04:42:01.858042+0000","last_fullsized":"2023-01-25T04:42:01.858042+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:14:00.435228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.100961+0000","last_change":"2023-01-25T04:42:00.855919+0000","last_active":"2023-01-25T04:42:02.100961+0000","last_peered":"2023-01-25T04:42:02.100961+0000","last_clean":"2023-01-25T04:42:02.100961+0000","last_became_active":"2023-01-25T04:42:00.855607+0000","last_became_peered":"2023-01-25T04:42:00.855607+0000","last_unstale":"2023-01-25T04:42:02.100961+0000","last_undegraded":"2023-01-25T04:42:02.100961+0000","last_fullsized":"2023-01-25T04:42:02.100961+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:05:48.483360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.152905+0000","last_change":"2023-01-25T04:42:00.854877+0000","last_active":"2023-01-25T04:42:02.152905+0000","last_peered":"2023-01-25T04:42:02.152905+0000","last_clean":"2023-01-25T04:42:02.152905+0000","last_became_active":"2023-01-25T04:42:00.854570+0000","last_became_peered":"2023-01-25T04:42:00.854570+0000","last_unstale":"2023-01-25T04:42:02.152905+0000","last_undegraded":"2023-01-25T04:42:02.152905+0000","last_fullsized":"2023-01-25T04:42:02.152905+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T06:24:07.141097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-01-25T04:42:02.125112+0000","last_change":"2023-01-25T04:42:00.854329+0000","last_active":"2023-01-25T04:42:02.125112+0000","last_peered":"2023-01-25T04:42:02.125112+0000","last_clean":"2023-01-25T04:42:02.125112+0000","last_became_active":"2023-01-25T04:42:00.854015+0000","last_became_peered":"2023-01-25T04:42:00.854015+0000","last_unstale":"2023-01-25T04:42:02.125112+0000","last_undegraded":"2023-01-25T04:42:02.125112+0000","last_fullsized":"2023-01-25T04:42:02.125112+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T04:41:59.841398+0000","last_clean_scrub_stamp":"2023-01-25T04:41:59.841398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T05:37:29.900605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]}]},{"osd":4,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5056,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366784,"statfs":{"total":96636764160,"available":96631586816,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]}]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5000,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366840,"statfs":{"total":96636764160,"available":96631644160,"internally_reserved":0,"allocated":131072,"data_stored":40731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4992,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366848,"statfs":{"total":96636764160,"available":96631652352,"internally_reserved":0,"allocated":122880,"data_stored":36233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T04:42:04.957 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T04:42:04.958 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T04:42:04.958 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T04:42:04.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T04:42:05.310 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-01-25T04:42:05.310 INFO:teuthology.orchestra.run.smithi073.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T04:42:05.324 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T04:42:05.324 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T04:42:05.337 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T04:42:05.337 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi116.front.sepia.ceph.com 2023-01-25T04:42:05.338 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create base 4' 2023-01-25T04:42:05.885 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'base' created 2023-01-25T04:42:05.897 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool application enable base rados' 2023-01-25T04:42:06.893 INFO:teuthology.orchestra.run.smithi116.stderr:enabled application 'rados' on pool 'base' 2023-01-25T04:42:06.906 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-01-25T04:42:07.891 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cache' created 2023-01-25T04:42:07.903 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add base cache' 2023-01-25T04:42:08.899 INFO:teuthology.orchestra.run.smithi116.stderr:pool 'cache' is now (or already was) a tier of 'base' 2023-01-25T04:42:08.911 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-01-25T04:42:09.899 INFO:teuthology.orchestra.run.smithi116.stderr:set cache-mode for pool 'cache' to writeback 2023-01-25T04:42:09.912 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay base cache' 2023-01-25T04:42:10.911 INFO:teuthology.orchestra.run.smithi116.stderr:overlay for 'base' is now (or already was) 'cache' 2023-01-25T04:42:10.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-01-25T04:42:11.912 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 3 hit_set_type to bloom 2023-01-25T04:42:11.924 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-01-25T04:42:12.929 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 3 hit_set_count to 8 2023-01-25T04:42:12.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-01-25T04:42:13.929 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 3 hit_set_period to 60 2023-01-25T04:42:13.942 DEBUG:teuthology.orchestra.run.smithi116:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 500' 2023-01-25T04:42:14.945 INFO:teuthology.orchestra.run.smithi116.stderr:set pool 3 target_max_objects to 500 2023-01-25T04:42:14.958 INFO:teuthology.run_tasks:Running task background_exec... 2023-01-25T04:42:15.009 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi073.front.sepia.ceph.com 2023-01-25T04:42:15.009 DEBUG:teuthology.orchestra.run.smithi073:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while true; do sleep 30; sudo ceph osd pool set cache cache_target_full_ratio .001; echo cache-try-flush-evict-all; rados -p cache cache-try-flush-evict-all; sleep 5; echo cache-flush-evict-all; rados -p cache cache-flush-evict-all; sleep 5; echo remove overlay; sudo ceph osd tier remove-overlay base; sleep 20; done' 2023-01-25T04:42:15.013 INFO:teuthology.run_tasks:Running task rados... 2023-01-25T04:42:15.033 INFO:tasks.rados:Beginning rados... 2023-01-25T04:42:15.033 DEBUG:teuthology.run_tasks:Unwinding manager rados 2023-01-25T04:42:15.053 INFO:tasks.rados:joining rados 2023-01-25T04:42:15.054 INFO:tasks.rados:clients are ['client.0'] 2023-01-25T04:42:15.054 INFO:tasks.rados:starting run 0 out of 1 2023-01-25T04:42:15.054 DEBUG:teuthology.orchestra.run.smithi116:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base 2023-01-25T04:42:15.087 INFO:tasks.rados.rados.0.smithi116.stdout:adding op weight read -> 100 2023-01-25T04:42:15.087 INFO:tasks.rados.rados.0.smithi116.stdout:adding op weight write -> 50 2023-01-25T04:42:15.087 INFO:tasks.rados.rados.0.smithi116.stdout:adding op weight delete -> 50 2023-01-25T04:42:15.087 INFO:tasks.rados.rados.0.smithi116.stdout:adding op weight copy_from -> 50 2023-01-25T04:42:15.088 INFO:tasks.rados.rados.0.smithi116.stdout:adding op weight write_excl -> 50 2023-01-25T04:42:15.088 INFO:tasks.rados.rados.0.smithi116.stdout:ceph version 18.0.0-1959-gb0d25925 (b0d2592529629ab4f86fed5991e556a87dcda563) reef (dev) 2023-01-25T04:42:15.088 INFO:tasks.rados.rados.0.smithi116.stdout:Configuration: 2023-01-25T04:42:15.088 INFO:tasks.rados.rados.0.smithi116.stdout: Number of operations: 400000 2023-01-25T04:42:15.088 INFO:tasks.rados.rados.0.smithi116.stdout: Number of objects: 10000 2023-01-25T04:42:15.089 INFO:tasks.rados.rados.0.smithi116.stdout: Max in flight operations: 16 2023-01-25T04:42:15.089 INFO:tasks.rados.rados.0.smithi116.stdout: Object size (in bytes): 4000000 2023-01-25T04:42:15.089 INFO:tasks.rados.rados.0.smithi116.stdout: Write stride min: 400000 2023-01-25T04:42:15.089 INFO:tasks.rados.rados.0.smithi116.stdout: Write stride max: 800000 2023-01-25T04:42:15.941 INFO:tasks.rados.rados.0.smithi116.stdout:1: write initial oid 1 2023-01-25T04:42:15.942 INFO:tasks.rados.rados.0.smithi116.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2023-01-25T04:42:15.946 INFO:tasks.rados.rados.0.smithi116.stdout:1: writing smithi116107171-1 from 416807 to 892056 tid 1 2023-01-25T04:42:15.953 INFO:tasks.rados.rados.0.smithi116.stdout:1: writing smithi116107171-1 from 1542129 to 2016807 tid 2 2023-01-25T04:42:15.953 INFO:tasks.rados.rados.0.smithi116.stdout:2: write initial oid 2 2023-01-25T04:42:15.953 INFO:tasks.rados.rados.0.smithi116.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2023-01-25T04:42:15.958 INFO:tasks.rados.rados.0.smithi116.stdout:2: writing smithi116107171-2 from 416807 to 892056 tid 1 2023-01-25T04:42:15.964 INFO:tasks.rados.rados.0.smithi116.stdout:2: writing smithi116107171-2 from 1542129 to 2016807 tid 2 2023-01-25T04:42:15.964 INFO:tasks.rados.rados.0.smithi116.stdout:3: write initial oid 3 2023-01-25T04:42:15.965 INFO:tasks.rados.rados.0.smithi116.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2023-01-25T04:42:15.969 INFO:tasks.rados.rados.0.smithi116.stdout:3: writing smithi116107171-3 from 433614 to 984112 tid 1 2023-01-25T04:42:15.976 INFO:tasks.rados.rados.0.smithi116.stdout:3: writing smithi116107171-3 from 1600611 to 2033614 tid 2 2023-01-25T04:42:15.976 INFO:tasks.rados.rados.0.smithi116.stdout:4: write initial oid 4 2023-01-25T04:42:15.976 INFO:tasks.rados.rados.0.smithi116.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2023-01-25T04:42:15.982 INFO:tasks.rados.rados.0.smithi116.stdout:4: writing smithi116107171-4 from 450421 to 1076168 tid 1 2023-01-25T04:42:15.987 INFO:tasks.rados.rados.0.smithi116.stdout:4: writing smithi116107171-4 from 1659093 to 2050421 tid 2 2023-01-25T04:42:15.987 INFO:tasks.rados.rados.0.smithi116.stdout:5: write initial oid 5 2023-01-25T04:42:15.988 INFO:tasks.rados.rados.0.smithi116.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2023-01-25T04:42:15.994 INFO:tasks.rados.rados.0.smithi116.stdout:5: writing smithi116107171-5 from 467228 to 1168224 tid 1 2023-01-25T04:42:15.999 INFO:tasks.rados.rados.0.smithi116.stdout:5: writing smithi116107171-5 from 1717575 to 2067228 tid 2 2023-01-25T04:42:15.999 INFO:tasks.rados.rados.0.smithi116.stdout:6: write initial oid 6 2023-01-25T04:42:15.999 INFO:tasks.rados.rados.0.smithi116.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2023-01-25T04:42:16.006 INFO:tasks.rados.rados.0.smithi116.stdout:6: writing smithi116107171-6 from 484035 to 1260280 tid 1 2023-01-25T04:42:16.010 INFO:tasks.rados.rados.0.smithi116.stdout:6: writing smithi116107171-6 from 2059704 to 2084035 tid 2 2023-01-25T04:42:16.011 INFO:tasks.rados.rados.0.smithi116.stdout:7: write initial oid 7 2023-01-25T04:42:16.011 INFO:tasks.rados.rados.0.smithi116.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2023-01-25T04:42:16.015 INFO:tasks.rados.rados.0.smithi116.stdout:7: writing smithi116107171-7 from 500842 to 952336 tid 1 2023-01-25T04:42:16.022 INFO:tasks.rados.rados.0.smithi116.stdout:7: writing smithi116107171-7 from 1718186 to 2100842 tid 2 2023-01-25T04:42:16.022 INFO:tasks.rados.rados.0.smithi116.stdout:8: write initial oid 8 2023-01-25T04:42:16.023 INFO:tasks.rados.rados.0.smithi116.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2023-01-25T04:42:16.028 INFO:tasks.rados.rados.0.smithi116.stdout:8: writing smithi116107171-8 from 517649 to 1044392 tid 1 2023-01-25T04:42:16.034 INFO:tasks.rados.rados.0.smithi116.stdout:8: writing smithi116107171-8 from 1776668 to 2117649 tid 2 2023-01-25T04:42:16.034 INFO:tasks.rados.rados.0.smithi116.stdout:9: write initial oid 9 2023-01-25T04:42:16.035 INFO:tasks.rados.rados.0.smithi116.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2023-01-25T04:42:16.040 INFO:tasks.rados.rados.0.smithi116.stdout:9: writing smithi116107171-9 from 534456 to 1252801 tid 1 2023-01-25T04:42:16.045 INFO:tasks.rados.rados.0.smithi116.stdout:9: writing smithi116107171-9 from 1951503 to 2134456 tid 2 2023-01-25T04:42:16.046 INFO:tasks.rados.rados.0.smithi116.stdout:10: write initial oid 10 2023-01-25T04:42:16.046 INFO:tasks.rados.rados.0.smithi116.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2023-01-25T04:42:16.053 INFO:tasks.rados.rados.0.smithi116.stdout:10: writing smithi116107171-10 from 551263 to 1344857 tid 1 2023-01-25T04:42:16.057 INFO:tasks.rados.rados.0.smithi116.stdout:10: writing smithi116107171-10 from 1893632 to 2151263 tid 2 2023-01-25T04:42:16.058 INFO:tasks.rados.rados.0.smithi116.stdout:11: write initial oid 11 2023-01-25T04:42:16.058 INFO:tasks.rados.rados.0.smithi116.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2023-01-25T04:42:16.063 INFO:tasks.rados.rados.0.smithi116.stdout:11: writing smithi116107171-11 from 568070 to 1036913 tid 1 2023-01-25T04:42:16.069 INFO:tasks.rados.rados.0.smithi116.stdout:11: writing smithi116107171-11 from 1552114 to 2168070 tid 2 2023-01-25T04:42:16.069 INFO:tasks.rados.rados.0.smithi116.stdout:12: write initial oid 12 2023-01-25T04:42:16.069 INFO:tasks.rados.rados.0.smithi116.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2023-01-25T04:42:16.075 INFO:tasks.rados.rados.0.smithi116.stdout:12: writing smithi116107171-12 from 584877 to 1128969 tid 1 2023-01-25T04:42:16.082 INFO:tasks.rados.rados.0.smithi116.stdout:12: writing smithi116107171-12 from 1610596 to 2172599 tid 2 2023-01-25T04:42:16.082 INFO:tasks.rados.rados.0.smithi116.stdout:13: write initial oid 13 2023-01-25T04:42:16.082 INFO:tasks.rados.rados.0.smithi116.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2023-01-25T04:42:16.089 INFO:tasks.rados.rados.0.smithi116.stdout:13: writing smithi116107171-13 from 601684 to 1221025 tid 1 2023-01-25T04:42:16.094 INFO:tasks.rados.rados.0.smithi116.stdout:13: writing smithi116107171-13 from 1669078 to 2201684 tid 2 2023-01-25T04:42:16.094 INFO:tasks.rados.rados.0.smithi116.stdout:14: write initial oid 14 2023-01-25T04:42:16.095 INFO:tasks.rados.rados.0.smithi116.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2023-01-25T04:42:16.102 INFO:tasks.rados.rados.0.smithi116.stdout:14: writing smithi116107171-14 from 618491 to 1313081 tid 1 2023-01-25T04:42:16.107 INFO:tasks.rados.rados.0.smithi116.stdout:14: writing smithi116107171-14 from 2011207 to 2218491 tid 2 2023-01-25T04:42:16.107 INFO:tasks.rados.rados.0.smithi116.stdout:15: write initial oid 15 2023-01-25T04:42:16.107 INFO:tasks.rados.rados.0.smithi116.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2023-01-25T04:42:16.115 INFO:tasks.rados.rados.0.smithi116.stdout:15: writing smithi116107171-15 from 635298 to 1405137 tid 1 2023-01-25T04:42:16.119 INFO:tasks.rados.rados.0.smithi116.stdout:15: writing smithi116107171-15 from 2069689 to 2235298 tid 2 2023-01-25T04:42:16.119 INFO:tasks.rados.rados.0.smithi116.stdout:16: write initial oid 16 2023-01-25T04:42:16.119 INFO:tasks.rados.rados.0.smithi116.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2023-01-25T04:42:16.125 INFO:tasks.rados.rados.0.smithi116.stdout:16: writing smithi116107171-16 from 652105 to 1097193 tid 1 2023-01-25T04:42:16.135 INFO:tasks.rados.rados.0.smithi116.stdout:16: writing smithi116107171-16 from 1728171 to 2181159 tid 2 2023-01-25T04:42:16.136 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.136 INFO:tasks.rados.rados.0.smithi116.stdout:1: finishing write tid 1 to smithi116107171-1 2023-01-25T04:42:16.136 INFO:tasks.rados.rados.0.smithi116.stdout:1: finishing write tid 2 to smithi116107171-1 2023-01-25T04:42:16.136 INFO:tasks.rados.rados.0.smithi116.stdout:1: finishing write tid 3 to smithi116107171-1 2023-01-25T04:42:16.136 INFO:tasks.rados.rados.0.smithi116.stdout:1: finishing write tid 4 to smithi116107171-1 2023-01-25T04:42:16.137 INFO:tasks.rados.rados.0.smithi116.stdout:1: oid 1 updating version 0 to 1 2023-01-25T04:42:16.137 INFO:tasks.rados.rados.0.smithi116.stdout:1: oid 1 updating version 1 to 3 2023-01-25T04:42:16.137 INFO:tasks.rados.rados.0.smithi116.stdout:1: oid 1 version 3 is already newer than 2 2023-01-25T04:42:16.137 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2023-01-25T04:42:16.138 INFO:tasks.rados.rados.0.smithi116.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2023-01-25T04:42:16.138 INFO:tasks.rados.rados.0.smithi116.stdout:2: finishing write tid 1 to smithi116107171-2 2023-01-25T04:42:16.138 INFO:tasks.rados.rados.0.smithi116.stdout:2: finishing write tid 2 to smithi116107171-2 2023-01-25T04:42:16.138 INFO:tasks.rados.rados.0.smithi116.stdout:2: finishing write tid 3 to smithi116107171-2 2023-01-25T04:42:16.138 INFO:tasks.rados.rados.0.smithi116.stdout:1: done (15 left) 2023-01-25T04:42:16.139 INFO:tasks.rados.rados.0.smithi116.stdout:17: write initial oid 17 2023-01-25T04:42:16.139 INFO:tasks.rados.rados.0.smithi116.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2023-01-25T04:42:16.139 INFO:tasks.rados.rados.0.smithi116.stdout:17: writing smithi116107171-17 from 668912 to 1305602 tid 1 2023-01-25T04:42:16.145 INFO:tasks.rados.rados.0.smithi116.stdout:17: writing smithi116107171-17 from 1903006 to 2268912 tid 2 2023-01-25T04:42:16.145 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.146 INFO:tasks.rados.rados.0.smithi116.stdout:2: finishing write tid 4 to smithi116107171-2 2023-01-25T04:42:16.146 INFO:tasks.rados.rados.0.smithi116.stdout:2: oid 2 updating version 0 to 2 2023-01-25T04:42:16.146 INFO:tasks.rados.rados.0.smithi116.stdout:2: oid 2 version 2 is already newer than 1 2023-01-25T04:42:16.146 INFO:tasks.rados.rados.0.smithi116.stdout:2: oid 2 updating version 2 to 3 2023-01-25T04:42:16.147 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2023-01-25T04:42:16.147 INFO:tasks.rados.rados.0.smithi116.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2023-01-25T04:42:16.147 INFO:tasks.rados.rados.0.smithi116.stdout:3: finishing write tid 1 to smithi116107171-3 2023-01-25T04:42:16.147 INFO:tasks.rados.rados.0.smithi116.stdout:3: finishing write tid 2 to smithi116107171-3 2023-01-25T04:42:16.147 INFO:tasks.rados.rados.0.smithi116.stdout:3: finishing write tid 3 to smithi116107171-3 2023-01-25T04:42:16.148 INFO:tasks.rados.rados.0.smithi116.stdout:2: done (15 left) 2023-01-25T04:42:16.148 INFO:tasks.rados.rados.0.smithi116.stdout:18: write initial oid 18 2023-01-25T04:42:16.148 INFO:tasks.rados.rados.0.smithi116.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2023-01-25T04:42:16.152 INFO:tasks.rados.rados.0.smithi116.stdout:18: writing smithi116107171-18 from 685719 to 1397658 tid 1 2023-01-25T04:42:16.163 INFO:tasks.rados.rados.0.smithi116.stdout:18: writing smithi116107171-18 from 1845135 to 2285719 tid 2 2023-01-25T04:42:16.163 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.164 INFO:tasks.rados.rados.0.smithi116.stdout:3: finishing write tid 4 to smithi116107171-3 2023-01-25T04:42:16.164 INFO:tasks.rados.rados.0.smithi116.stdout:3: oid 3 updating version 0 to 1 2023-01-25T04:42:16.164 INFO:tasks.rados.rados.0.smithi116.stdout:3: oid 3 updating version 1 to 3 2023-01-25T04:42:16.164 INFO:tasks.rados.rados.0.smithi116.stdout:3: oid 3 version 3 is already newer than 2 2023-01-25T04:42:16.165 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2023-01-25T04:42:16.165 INFO:tasks.rados.rados.0.smithi116.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2023-01-25T04:42:16.165 INFO:tasks.rados.rados.0.smithi116.stdout:4: finishing write tid 1 to smithi116107171-4 2023-01-25T04:42:16.165 INFO:tasks.rados.rados.0.smithi116.stdout:3: done (15 left) 2023-01-25T04:42:16.165 INFO:tasks.rados.rados.0.smithi116.stdout:19: write initial oid 19 2023-01-25T04:42:16.166 INFO:tasks.rados.rados.0.smithi116.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2023-01-25T04:42:16.166 INFO:tasks.rados.rados.0.smithi116.stdout:19: writing smithi116107171-19 from 702526 to 1489714 tid 1 2023-01-25T04:42:16.170 INFO:tasks.rados.rados.0.smithi116.stdout:19: writing smithi116107171-19 from 1903617 to 2302526 tid 2 2023-01-25T04:42:16.170 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.171 INFO:tasks.rados.rados.0.smithi116.stdout:4: finishing write tid 2 to smithi116107171-4 2023-01-25T04:42:16.171 INFO:tasks.rados.rados.0.smithi116.stdout:4: finishing write tid 3 to smithi116107171-4 2023-01-25T04:42:16.171 INFO:tasks.rados.rados.0.smithi116.stdout:4: finishing write tid 4 to smithi116107171-4 2023-01-25T04:42:16.171 INFO:tasks.rados.rados.0.smithi116.stdout:4: oid 4 updating version 0 to 6 2023-01-25T04:42:16.171 INFO:tasks.rados.rados.0.smithi116.stdout:4: oid 4 version 6 is already newer than 2 2023-01-25T04:42:16.172 INFO:tasks.rados.rados.0.smithi116.stdout:4: oid 4 version 6 is already newer than 5 2023-01-25T04:42:16.172 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 4 v 6 (ObjNum 3 snap 0 seq_num 3) dirty exists 2023-01-25T04:42:16.172 INFO:tasks.rados.rados.0.smithi116.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2023-01-25T04:42:16.172 INFO:tasks.rados.rados.0.smithi116.stdout:5: finishing write tid 1 to smithi116107171-5 2023-01-25T04:42:16.172 INFO:tasks.rados.rados.0.smithi116.stdout:4: done (15 left) 2023-01-25T04:42:16.173 INFO:tasks.rados.rados.0.smithi116.stdout:20: write initial oid 20 2023-01-25T04:42:16.173 INFO:tasks.rados.rados.0.smithi116.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2023-01-25T04:42:16.177 INFO:tasks.rados.rados.0.smithi116.stdout:20: writing smithi116107171-20 from 719333 to 1181770 tid 1 2023-01-25T04:42:16.183 INFO:tasks.rados.rados.0.smithi116.stdout:20: writing smithi116107171-20 from 1962099 to 2319333 tid 2 2023-01-25T04:42:16.184 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.184 INFO:tasks.rados.rados.0.smithi116.stdout:6: finishing write tid 1 to smithi116107171-6 2023-01-25T04:42:16.184 INFO:tasks.rados.rados.0.smithi116.stdout:5: finishing write tid 2 to smithi116107171-5 2023-01-25T04:42:16.184 INFO:tasks.rados.rados.0.smithi116.stdout:5: finishing write tid 3 to smithi116107171-5 2023-01-25T04:42:16.185 INFO:tasks.rados.rados.0.smithi116.stdout:5: finishing write tid 4 to smithi116107171-5 2023-01-25T04:42:16.185 INFO:tasks.rados.rados.0.smithi116.stdout:5: oid 5 updating version 0 to 1 2023-01-25T04:42:16.185 INFO:tasks.rados.rados.0.smithi116.stdout:5: oid 5 updating version 1 to 3 2023-01-25T04:42:16.186 INFO:tasks.rados.rados.0.smithi116.stdout:5: oid 5 version 3 is already newer than 2 2023-01-25T04:42:16.186 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2023-01-25T04:42:16.186 INFO:tasks.rados.rados.0.smithi116.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2023-01-25T04:42:16.186 INFO:tasks.rados.rados.0.smithi116.stdout:7: finishing write tid 1 to smithi116107171-7 2023-01-25T04:42:16.187 INFO:tasks.rados.rados.0.smithi116.stdout:6: finishing write tid 2 to smithi116107171-6 2023-01-25T04:42:16.187 INFO:tasks.rados.rados.0.smithi116.stdout:5: done (15 left) 2023-01-25T04:42:16.187 INFO:tasks.rados.rados.0.smithi116.stdout:21: write initial oid 21 2023-01-25T04:42:16.187 INFO:tasks.rados.rados.0.smithi116.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2023-01-25T04:42:16.190 INFO:tasks.rados.rados.0.smithi116.stdout:21: writing smithi116107171-21 from 736140 to 1273826 tid 1 2023-01-25T04:42:16.197 INFO:tasks.rados.rados.0.smithi116.stdout:21: writing smithi116107171-21 from 2020581 to 2336140 tid 2 2023-01-25T04:42:16.197 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.197 INFO:tasks.rados.rados.0.smithi116.stdout:6: finishing write tid 3 to smithi116107171-6 2023-01-25T04:42:16.198 INFO:tasks.rados.rados.0.smithi116.stdout:6: finishing write tid 4 to smithi116107171-6 2023-01-25T04:42:16.198 INFO:tasks.rados.rados.0.smithi116.stdout:6: oid 6 updating version 0 to 2 2023-01-25T04:42:16.198 INFO:tasks.rados.rados.0.smithi116.stdout:6: oid 6 updating version 2 to 6 2023-01-25T04:42:16.198 INFO:tasks.rados.rados.0.smithi116.stdout:6: oid 6 version 6 is already newer than 5 2023-01-25T04:42:16.198 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 6 v 6 (ObjNum 5 snap 0 seq_num 5) dirty exists 2023-01-25T04:42:16.199 INFO:tasks.rados.rados.0.smithi116.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2023-01-25T04:42:16.199 INFO:tasks.rados.rados.0.smithi116.stdout:7: finishing write tid 2 to smithi116107171-7 2023-01-25T04:42:16.199 INFO:tasks.rados.rados.0.smithi116.stdout:7: finishing write tid 3 to smithi116107171-7 2023-01-25T04:42:16.199 INFO:tasks.rados.rados.0.smithi116.stdout:7: finishing write tid 4 to smithi116107171-7 2023-01-25T04:42:16.199 INFO:tasks.rados.rados.0.smithi116.stdout:7: oid 7 updating version 0 to 5 2023-01-25T04:42:16.200 INFO:tasks.rados.rados.0.smithi116.stdout:7: oid 7 updating version 5 to 6 2023-01-25T04:42:16.200 INFO:tasks.rados.rados.0.smithi116.stdout:7: oid 7 version 6 is already newer than 2 2023-01-25T04:42:16.200 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 7 v 6 (ObjNum 6 snap 0 seq_num 6) dirty exists 2023-01-25T04:42:16.200 INFO:tasks.rados.rados.0.smithi116.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2023-01-25T04:42:16.200 INFO:tasks.rados.rados.0.smithi116.stdout:8: finishing write tid 1 to smithi116107171-8 2023-01-25T04:42:16.201 INFO:tasks.rados.rados.0.smithi116.stdout:6: done (15 left) 2023-01-25T04:42:16.201 INFO:tasks.rados.rados.0.smithi116.stdout:7: done (14 left) 2023-01-25T04:42:16.201 INFO:tasks.rados.rados.0.smithi116.stdout:22: write initial oid 22 2023-01-25T04:42:16.201 INFO:tasks.rados.rados.0.smithi116.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2023-01-25T04:42:16.204 INFO:tasks.rados.rados.0.smithi116.stdout:22: writing smithi116107171-22 from 752947 to 1365882 tid 1 2023-01-25T04:42:16.209 INFO:tasks.rados.rados.0.smithi116.stdout:22: writing smithi116107171-22 from 1962710 to 2352947 tid 2 2023-01-25T04:42:16.210 INFO:tasks.rados.rados.0.smithi116.stdout:23: write initial oid 23 2023-01-25T04:42:16.210 INFO:tasks.rados.rados.0.smithi116.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2023-01-25T04:42:16.218 INFO:tasks.rados.rados.0.smithi116.stdout:23: writing smithi116107171-23 from 769754 to 1457938 tid 1 2023-01-25T04:42:16.224 INFO:tasks.rados.rados.0.smithi116.stdout:23: writing smithi116107171-23 from 2021192 to 2369754 tid 2 2023-01-25T04:42:16.224 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.224 INFO:tasks.rados.rados.0.smithi116.stdout:8: finishing write tid 2 to smithi116107171-8 2023-01-25T04:42:16.225 INFO:tasks.rados.rados.0.smithi116.stdout:8: finishing write tid 3 to smithi116107171-8 2023-01-25T04:42:16.225 INFO:tasks.rados.rados.0.smithi116.stdout:8: finishing write tid 4 to smithi116107171-8 2023-01-25T04:42:16.225 INFO:tasks.rados.rados.0.smithi116.stdout:8: oid 8 updating version 0 to 9 2023-01-25T04:42:16.225 INFO:tasks.rados.rados.0.smithi116.stdout:8: oid 8 version 9 is already newer than 3 2023-01-25T04:42:16.225 INFO:tasks.rados.rados.0.smithi116.stdout:8: oid 8 version 9 is already newer than 8 2023-01-25T04:42:16.226 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 8 v 9 (ObjNum 7 snap 0 seq_num 7) dirty exists 2023-01-25T04:42:16.226 INFO:tasks.rados.rados.0.smithi116.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2023-01-25T04:42:16.226 INFO:tasks.rados.rados.0.smithi116.stdout:9: finishing write tid 1 to smithi116107171-9 2023-01-25T04:42:16.226 INFO:tasks.rados.rados.0.smithi116.stdout:9: finishing write tid 2 to smithi116107171-9 2023-01-25T04:42:16.226 INFO:tasks.rados.rados.0.smithi116.stdout:9: finishing write tid 3 to smithi116107171-9 2023-01-25T04:42:16.227 INFO:tasks.rados.rados.0.smithi116.stdout:9: finishing write tid 4 to smithi116107171-9 2023-01-25T04:42:16.227 INFO:tasks.rados.rados.0.smithi116.stdout:9: oid 9 updating version 0 to 3 2023-01-25T04:42:16.227 INFO:tasks.rados.rados.0.smithi116.stdout:9: oid 9 updating version 3 to 8 2023-01-25T04:42:16.227 INFO:tasks.rados.rados.0.smithi116.stdout:9: oid 9 updating version 8 to 9 2023-01-25T04:42:16.227 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 9 v 9 (ObjNum 8 snap 0 seq_num 8) dirty exists 2023-01-25T04:42:16.228 INFO:tasks.rados.rados.0.smithi116.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2023-01-25T04:42:16.228 INFO:tasks.rados.rados.0.smithi116.stdout:8: done (15 left) 2023-01-25T04:42:16.228 INFO:tasks.rados.rados.0.smithi116.stdout:9: done (14 left) 2023-01-25T04:42:16.228 INFO:tasks.rados.rados.0.smithi116.stdout:24: write initial oid 24 2023-01-25T04:42:16.228 INFO:tasks.rados.rados.0.smithi116.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2023-01-25T04:42:16.229 INFO:tasks.rados.rados.0.smithi116.stdout:24: writing smithi116107171-24 from 786561 to 1266347 tid 1 2023-01-25T04:42:16.245 INFO:tasks.rados.rados.0.smithi116.stdout:24: writing smithi116107171-24 from 1796027 to 2263691 tid 2 2023-01-25T04:42:16.245 INFO:tasks.rados.rados.0.smithi116.stdout:25: write initial oid 25 2023-01-25T04:42:16.245 INFO:tasks.rados.rados.0.smithi116.stdout:10: finishing write tid 1 to smithi116107171-10 2023-01-25T04:42:16.246 INFO:tasks.rados.rados.0.smithi116.stdout:11: finishing write tid 1 to smithi116107171-11 2023-01-25T04:42:16.247 INFO:tasks.rados.rados.0.smithi116.stdout:10: finishing write tid 2 to smithi116107171-10 2023-01-25T04:42:16.247 INFO:tasks.rados.rados.0.smithi116.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2023-01-25T04:42:16.248 INFO:tasks.rados.rados.0.smithi116.stdout:25: writing smithi116107171-25 from 403368 to 958403 tid 1 2023-01-25T04:42:16.249 INFO:tasks.rados.rados.0.smithi116.stdout:25: writing smithi116107171-25 from 1454509 to 2182184 tid 2 2023-01-25T04:42:16.249 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.249 INFO:tasks.rados.rados.0.smithi116.stdout:10: finishing write tid 3 to smithi116107171-10 2023-01-25T04:42:16.250 INFO:tasks.rados.rados.0.smithi116.stdout:10: finishing write tid 4 to smithi116107171-10 2023-01-25T04:42:16.250 INFO:tasks.rados.rados.0.smithi116.stdout:10: oid 10 updating version 0 to 12 2023-01-25T04:42:16.250 INFO:tasks.rados.rados.0.smithi116.stdout:10: oid 10 version 12 is already newer than 11 2023-01-25T04:42:16.250 INFO:tasks.rados.rados.0.smithi116.stdout:10: oid 10 version 12 is already newer than 4 2023-01-25T04:42:16.250 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 10 v 12 (ObjNum 9 snap 0 seq_num 9) dirty exists 2023-01-25T04:42:16.251 INFO:tasks.rados.rados.0.smithi116.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2023-01-25T04:42:16.251 INFO:tasks.rados.rados.0.smithi116.stdout:11: finishing write tid 2 to smithi116107171-11 2023-01-25T04:42:16.251 INFO:tasks.rados.rados.0.smithi116.stdout:11: finishing write tid 3 to smithi116107171-11 2023-01-25T04:42:16.251 INFO:tasks.rados.rados.0.smithi116.stdout:11: finishing write tid 4 to smithi116107171-11 2023-01-25T04:42:16.252 INFO:tasks.rados.rados.0.smithi116.stdout:11: oid 11 updating version 0 to 4 2023-01-25T04:42:16.252 INFO:tasks.rados.rados.0.smithi116.stdout:11: oid 11 updating version 4 to 11 2023-01-25T04:42:16.252 INFO:tasks.rados.rados.0.smithi116.stdout:11: oid 11 updating version 11 to 12 2023-01-25T04:42:16.252 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 11 v 12 (ObjNum 10 snap 0 seq_num 10) dirty exists 2023-01-25T04:42:16.252 INFO:tasks.rados.rados.0.smithi116.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2023-01-25T04:42:16.253 INFO:tasks.rados.rados.0.smithi116.stdout:12: finishing write tid 1 to smithi116107171-12 2023-01-25T04:42:16.253 INFO:tasks.rados.rados.0.smithi116.stdout:12: finishing write tid 2 to smithi116107171-12 2023-01-25T04:42:16.253 INFO:tasks.rados.rados.0.smithi116.stdout:12: finishing write tid 3 to smithi116107171-12 2023-01-25T04:42:16.253 INFO:tasks.rados.rados.0.smithi116.stdout:10: done (15 left) 2023-01-25T04:42:16.253 INFO:tasks.rados.rados.0.smithi116.stdout:11: done (14 left) 2023-01-25T04:42:16.254 INFO:tasks.rados.rados.0.smithi116.stdout:26: write initial oid 26 2023-01-25T04:42:16.254 INFO:tasks.rados.rados.0.smithi116.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2023-01-25T04:42:16.254 INFO:tasks.rados.rados.0.smithi116.stdout:26: writing smithi116107171-26 from 420175 to 1050459 tid 1 2023-01-25T04:42:16.260 INFO:tasks.rados.rados.0.smithi116.stdout:26: writing smithi116107171-26 from 1796638 to 2267971 tid 2 2023-01-25T04:42:16.261 INFO:tasks.rados.rados.0.smithi116.stdout:27: write initial oid 27 2023-01-25T04:42:16.261 INFO:tasks.rados.rados.0.smithi116.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2023-01-25T04:42:16.266 INFO:tasks.rados.rados.0.smithi116.stdout:27: writing smithi116107171-27 from 436982 to 1142515 tid 1 2023-01-25T04:42:16.274 INFO:tasks.rados.rados.0.smithi116.stdout:27: writing smithi116107171-27 from 1855120 to 2436982 tid 2 2023-01-25T04:42:16.275 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.275 INFO:tasks.rados.rados.0.smithi116.stdout:12: finishing write tid 4 to smithi116107171-12 2023-01-25T04:42:16.275 INFO:tasks.rados.rados.0.smithi116.stdout:12: oid 12 updating version 0 to 2 2023-01-25T04:42:16.275 INFO:tasks.rados.rados.0.smithi116.stdout:12: oid 12 updating version 2 to 6 2023-01-25T04:42:16.276 INFO:tasks.rados.rados.0.smithi116.stdout:12: oid 12 version 6 is already newer than 5 2023-01-25T04:42:16.276 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 12 v 6 (ObjNum 11 snap 0 seq_num 11) dirty exists 2023-01-25T04:42:16.276 INFO:tasks.rados.rados.0.smithi116.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2023-01-25T04:42:16.277 INFO:tasks.rados.rados.0.smithi116.stdout:13: finishing write tid 1 to smithi116107171-13 2023-01-25T04:42:16.277 INFO:tasks.rados.rados.0.smithi116.stdout:12: done (15 left) 2023-01-25T04:42:16.277 INFO:tasks.rados.rados.0.smithi116.stdout:28: write initial oid 28 2023-01-25T04:42:16.278 INFO:tasks.rados.rados.0.smithi116.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2023-01-25T04:42:16.280 INFO:tasks.rados.rados.0.smithi116.stdout:28: writing smithi116107171-28 from 453789 to 1234571 tid 1 2023-01-25T04:42:16.288 INFO:tasks.rados.rados.0.smithi116.stdout:28: writing smithi116107171-28 from 1913602 to 2388604 tid 2 2023-01-25T04:42:16.288 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.289 INFO:tasks.rados.rados.0.smithi116.stdout:13: finishing write tid 2 to smithi116107171-13 2023-01-25T04:42:16.289 INFO:tasks.rados.rados.0.smithi116.stdout:13: finishing write tid 3 to smithi116107171-13 2023-01-25T04:42:16.289 INFO:tasks.rados.rados.0.smithi116.stdout:13: finishing write tid 4 to smithi116107171-13 2023-01-25T04:42:16.289 INFO:tasks.rados.rados.0.smithi116.stdout:13: oid 13 updating version 0 to 3 2023-01-25T04:42:16.290 INFO:tasks.rados.rados.0.smithi116.stdout:13: oid 13 updating version 3 to 8 2023-01-25T04:42:16.290 INFO:tasks.rados.rados.0.smithi116.stdout:13: oid 13 updating version 8 to 9 2023-01-25T04:42:16.290 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 13 v 9 (ObjNum 12 snap 0 seq_num 12) dirty exists 2023-01-25T04:42:16.291 INFO:tasks.rados.rados.0.smithi116.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2023-01-25T04:42:16.291 INFO:tasks.rados.rados.0.smithi116.stdout:14: finishing write tid 1 to smithi116107171-14 2023-01-25T04:42:16.291 INFO:tasks.rados.rados.0.smithi116.stdout:15: finishing write tid 1 to smithi116107171-15 2023-01-25T04:42:16.291 INFO:tasks.rados.rados.0.smithi116.stdout:14: finishing write tid 2 to smithi116107171-14 2023-01-25T04:42:16.291 INFO:tasks.rados.rados.0.smithi116.stdout:14: finishing write tid 3 to smithi116107171-14 2023-01-25T04:42:16.292 INFO:tasks.rados.rados.0.smithi116.stdout:14: finishing write tid 4 to smithi116107171-14 2023-01-25T04:42:16.292 INFO:tasks.rados.rados.0.smithi116.stdout:14: oid 14 updating version 0 to 5 2023-01-25T04:42:16.292 INFO:tasks.rados.rados.0.smithi116.stdout:14: oid 14 updating version 5 to 15 2023-01-25T04:42:16.292 INFO:tasks.rados.rados.0.smithi116.stdout:14: oid 14 version 15 is already newer than 14 2023-01-25T04:42:16.292 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 14 v 15 (ObjNum 13 snap 0 seq_num 13) dirty exists 2023-01-25T04:42:16.293 INFO:tasks.rados.rados.0.smithi116.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2023-01-25T04:42:16.293 INFO:tasks.rados.rados.0.smithi116.stdout:13: done (15 left) 2023-01-25T04:42:16.293 INFO:tasks.rados.rados.0.smithi116.stdout:14: done (14 left) 2023-01-25T04:42:16.293 INFO:tasks.rados.rados.0.smithi116.stdout:29: write initial oid 29 2023-01-25T04:42:16.293 INFO:tasks.rados.rados.0.smithi116.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2023-01-25T04:42:16.294 INFO:tasks.rados.rados.0.smithi116.stdout:29: writing smithi116107171-29 from 470596 to 926627 tid 1 2023-01-25T04:42:16.299 INFO:tasks.rados.rados.0.smithi116.stdout:29: writing smithi116107171-29 from 1572084 to 2190744 tid 2 2023-01-25T04:42:16.299 INFO:tasks.rados.rados.0.smithi116.stdout:30: write initial oid 30 2023-01-25T04:42:16.299 INFO:tasks.rados.rados.0.smithi116.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2023-01-25T04:42:16.304 INFO:tasks.rados.rados.0.smithi116.stdout:30: writing smithi116107171-30 from 487403 to 1018683 tid 1 2023-01-25T04:42:16.310 INFO:tasks.rados.rados.0.smithi116.stdout:30: writing smithi116107171-30 from 1514213 to 1992884 tid 2 2023-01-25T04:42:16.310 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.310 INFO:tasks.rados.rados.0.smithi116.stdout:15: finishing write tid 2 to smithi116107171-15 2023-01-25T04:42:16.311 INFO:tasks.rados.rados.0.smithi116.stdout:15: finishing write tid 3 to smithi116107171-15 2023-01-25T04:42:16.311 INFO:tasks.rados.rados.0.smithi116.stdout:15: finishing write tid 4 to smithi116107171-15 2023-01-25T04:42:16.311 INFO:tasks.rados.rados.0.smithi116.stdout:15: oid 15 updating version 0 to 4 2023-01-25T04:42:16.312 INFO:tasks.rados.rados.0.smithi116.stdout:15: oid 15 updating version 4 to 12 2023-01-25T04:42:16.312 INFO:tasks.rados.rados.0.smithi116.stdout:15: oid 15 version 12 is already newer than 11 2023-01-25T04:42:16.312 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 15 v 12 (ObjNum 14 snap 0 seq_num 14) dirty exists 2023-01-25T04:42:16.312 INFO:tasks.rados.rados.0.smithi116.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2023-01-25T04:42:16.312 INFO:tasks.rados.rados.0.smithi116.stdout:16: finishing write tid 1 to smithi116107171-16 2023-01-25T04:42:16.313 INFO:tasks.rados.rados.0.smithi116.stdout:15: done (15 left) 2023-01-25T04:42:16.313 INFO:tasks.rados.rados.0.smithi116.stdout:31: write initial oid 31 2023-01-25T04:42:16.313 INFO:tasks.rados.rados.0.smithi116.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2023-01-25T04:42:16.316 INFO:tasks.rados.rados.0.smithi116.stdout:31: writing smithi116107171-31 from 504210 to 1110739 tid 1 2023-01-25T04:42:16.323 INFO:tasks.rados.rados.0.smithi116.stdout:31: writing smithi116107171-31 from 1572695 to 2195024 tid 2 2023-01-25T04:42:16.323 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.323 INFO:tasks.rados.rados.0.smithi116.stdout:16: finishing write tid 2 to smithi116107171-16 2023-01-25T04:42:16.323 INFO:tasks.rados.rados.0.smithi116.stdout:16: finishing write tid 3 to smithi116107171-16 2023-01-25T04:42:16.323 INFO:tasks.rados.rados.0.smithi116.stdout:16: finishing write tid 4 to smithi116107171-16 2023-01-25T04:42:16.324 INFO:tasks.rados.rados.0.smithi116.stdout:16: oid 16 updating version 0 to 5 2023-01-25T04:42:16.324 INFO:tasks.rados.rados.0.smithi116.stdout:16: oid 16 updating version 5 to 15 2023-01-25T04:42:16.325 INFO:tasks.rados.rados.0.smithi116.stdout:16: oid 16 version 15 is already newer than 14 2023-01-25T04:42:16.325 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 16 v 15 (ObjNum 15 snap 0 seq_num 15) dirty exists 2023-01-25T04:42:16.326 INFO:tasks.rados.rados.0.smithi116.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2023-01-25T04:42:16.326 INFO:tasks.rados.rados.0.smithi116.stdout:17: finishing write tid 1 to smithi116107171-17 2023-01-25T04:42:16.326 INFO:tasks.rados.rados.0.smithi116.stdout:17: finishing write tid 2 to smithi116107171-17 2023-01-25T04:42:16.326 INFO:tasks.rados.rados.0.smithi116.stdout:17: finishing write tid 3 to smithi116107171-17 2023-01-25T04:42:16.326 INFO:tasks.rados.rados.0.smithi116.stdout:17: finishing write tid 4 to smithi116107171-17 2023-01-25T04:42:16.327 INFO:tasks.rados.rados.0.smithi116.stdout:17: oid 17 updating version 0 to 8 2023-01-25T04:42:16.327 INFO:tasks.rados.rados.0.smithi116.stdout:17: oid 17 updating version 8 to 9 2023-01-25T04:42:16.327 INFO:tasks.rados.rados.0.smithi116.stdout:17: oid 17 version 9 is already newer than 3 2023-01-25T04:42:16.327 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 17 v 9 (ObjNum 16 snap 0 seq_num 16) dirty exists 2023-01-25T04:42:16.327 INFO:tasks.rados.rados.0.smithi116.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2023-01-25T04:42:16.328 INFO:tasks.rados.rados.0.smithi116.stdout:18: finishing write tid 1 to smithi116107171-18 2023-01-25T04:42:16.328 INFO:tasks.rados.rados.0.smithi116.stdout:16: done (15 left) 2023-01-25T04:42:16.328 INFO:tasks.rados.rados.0.smithi116.stdout:17: done (14 left) 2023-01-25T04:42:16.328 INFO:tasks.rados.rados.0.smithi116.stdout:32: write initial oid 32 2023-01-25T04:42:16.328 INFO:tasks.rados.rados.0.smithi116.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2023-01-25T04:42:16.329 INFO:tasks.rados.rados.0.smithi116.stdout:32: writing smithi116107171-32 from 521017 to 1319148 tid 1 2023-01-25T04:42:16.334 INFO:tasks.rados.rados.0.smithi116.stdout:32: writing smithi116107171-32 from 1747530 to 2229870 tid 2 2023-01-25T04:42:16.335 INFO:tasks.rados.rados.0.smithi116.stdout:33: write initial oid 33 2023-01-25T04:42:16.335 INFO:tasks.rados.rados.0.smithi116.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2023-01-25T04:42:16.339 INFO:tasks.rados.rados.0.smithi116.stdout:33: writing smithi116107171-33 from 537824 to 1011204 tid 1 2023-01-25T04:42:16.349 INFO:tasks.rados.rados.0.smithi116.stdout:33: writing smithi116107171-33 from 1806012 to 2432010 tid 2 2023-01-25T04:42:16.350 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.350 INFO:tasks.rados.rados.0.smithi116.stdout:18: finishing write tid 2 to smithi116107171-18 2023-01-25T04:42:16.351 INFO:tasks.rados.rados.0.smithi116.stdout:18: finishing write tid 3 to smithi116107171-18 2023-01-25T04:42:16.351 INFO:tasks.rados.rados.0.smithi116.stdout:18: finishing write tid 4 to smithi116107171-18 2023-01-25T04:42:16.351 INFO:tasks.rados.rados.0.smithi116.stdout:18: oid 18 updating version 0 to 17 2023-01-25T04:42:16.352 INFO:tasks.rados.rados.0.smithi116.stdout:18: oid 18 updating version 17 to 18 2023-01-25T04:42:16.352 INFO:tasks.rados.rados.0.smithi116.stdout:18: oid 18 version 18 is already newer than 6 2023-01-25T04:42:16.352 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 18 v 18 (ObjNum 17 snap 0 seq_num 17) dirty exists 2023-01-25T04:42:16.353 INFO:tasks.rados.rados.0.smithi116.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2023-01-25T04:42:16.353 INFO:tasks.rados.rados.0.smithi116.stdout:19: finishing write tid 1 to smithi116107171-19 2023-01-25T04:42:16.353 INFO:tasks.rados.rados.0.smithi116.stdout:18: done (15 left) 2023-01-25T04:42:16.354 INFO:tasks.rados.rados.0.smithi116.stdout:34: write initial oid 34 2023-01-25T04:42:16.354 INFO:tasks.rados.rados.0.smithi116.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2023-01-25T04:42:16.355 INFO:tasks.rados.rados.0.smithi116.stdout:34: writing smithi116107171-34 from 554631 to 1103260 tid 1 2023-01-25T04:42:16.361 INFO:tasks.rados.rados.0.smithi116.stdout:34: writing smithi116107171-34 from 1748141 to 2234150 tid 2 2023-01-25T04:42:16.362 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.362 INFO:tasks.rados.rados.0.smithi116.stdout:19: finishing write tid 2 to smithi116107171-19 2023-01-25T04:42:16.362 INFO:tasks.rados.rados.0.smithi116.stdout:19: finishing write tid 3 to smithi116107171-19 2023-01-25T04:42:16.362 INFO:tasks.rados.rados.0.smithi116.stdout:19: finishing write tid 4 to smithi116107171-19 2023-01-25T04:42:16.362 INFO:tasks.rados.rados.0.smithi116.stdout:19: oid 19 updating version 0 to 4 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:19: oid 19 updating version 4 to 12 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:19: oid 19 version 12 is already newer than 11 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 19 v 12 (ObjNum 18 snap 0 seq_num 18) dirty exists 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:20: finishing write tid 1 to smithi116107171-20 2023-01-25T04:42:16.363 INFO:tasks.rados.rados.0.smithi116.stdout:20: finishing write tid 2 to smithi116107171-20 2023-01-25T04:42:16.364 INFO:tasks.rados.rados.0.smithi116.stdout:20: finishing write tid 3 to smithi116107171-20 2023-01-25T04:42:16.364 INFO:tasks.rados.rados.0.smithi116.stdout:20: finishing write tid 4 to smithi116107171-20 2023-01-25T04:42:16.364 INFO:tasks.rados.rados.0.smithi116.stdout:20: oid 20 updating version 0 to 6 2023-01-25T04:42:16.364 INFO:tasks.rados.rados.0.smithi116.stdout:20: oid 20 updating version 6 to 18 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:20: oid 20 version 18 is already newer than 17 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 20 v 18 (ObjNum 19 snap 0 seq_num 19) dirty exists 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:21: finishing write tid 1 to smithi116107171-21 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:21: finishing write tid 2 to smithi116107171-21 2023-01-25T04:42:16.365 INFO:tasks.rados.rados.0.smithi116.stdout:19: done (15 left) 2023-01-25T04:42:16.366 INFO:tasks.rados.rados.0.smithi116.stdout:20: done (14 left) 2023-01-25T04:42:16.366 INFO:tasks.rados.rados.0.smithi116.stdout:35: write initial oid 35 2023-01-25T04:42:16.366 INFO:tasks.rados.rados.0.smithi116.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2023-01-25T04:42:16.366 INFO:tasks.rados.rados.0.smithi116.stdout:35: writing smithi116107171-35 from 571438 to 1195316 tid 1 2023-01-25T04:42:16.373 INFO:tasks.rados.rados.0.smithi116.stdout:35: writing smithi116107171-35 from 1806623 to 2436290 tid 2 2023-01-25T04:42:16.374 INFO:tasks.rados.rados.0.smithi116.stdout:36: write initial oid 36 2023-01-25T04:42:16.374 INFO:tasks.rados.rados.0.smithi116.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2023-01-25T04:42:16.381 INFO:tasks.rados.rados.0.smithi116.stdout:36: writing smithi116107171-36 from 588245 to 1287372 tid 1 2023-01-25T04:42:16.388 INFO:tasks.rados.rados.0.smithi116.stdout:36: writing smithi116107171-36 from 1865105 to 2354783 tid 2 2023-01-25T04:42:16.388 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.388 INFO:tasks.rados.rados.0.smithi116.stdout:21: finishing write tid 3 to smithi116107171-21 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:21: finishing write tid 4 to smithi116107171-21 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:21: oid 21 updating version 0 to 21 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:21: oid 21 version 21 is already newer than 7 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:21: oid 21 version 21 is already newer than 20 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 21 v 21 (ObjNum 20 snap 0 seq_num 20) dirty exists 2023-01-25T04:42:16.389 INFO:tasks.rados.rados.0.smithi116.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2023-01-25T04:42:16.390 INFO:tasks.rados.rados.0.smithi116.stdout:22: finishing write tid 1 to smithi116107171-22 2023-01-25T04:42:16.390 INFO:tasks.rados.rados.0.smithi116.stdout:22: finishing write tid 2 to smithi116107171-22 2023-01-25T04:42:16.390 INFO:tasks.rados.rados.0.smithi116.stdout:22: finishing write tid 3 to smithi116107171-22 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:22: finishing write tid 4 to smithi116107171-22 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:22: oid 22 updating version 0 to 14 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:22: oid 22 updating version 14 to 15 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:22: oid 22 version 15 is already newer than 5 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 22 v 15 (ObjNum 21 snap 0 seq_num 21) dirty exists 2023-01-25T04:42:16.391 INFO:tasks.rados.rados.0.smithi116.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2023-01-25T04:42:16.392 INFO:tasks.rados.rados.0.smithi116.stdout:23: finishing write tid 1 to smithi116107171-23 2023-01-25T04:42:16.392 INFO:tasks.rados.rados.0.smithi116.stdout:24: finishing write tid 1 to smithi116107171-24 2023-01-25T04:42:16.392 INFO:tasks.rados.rados.0.smithi116.stdout:21: done (15 left) 2023-01-25T04:42:16.392 INFO:tasks.rados.rados.0.smithi116.stdout:22: done (14 left) 2023-01-25T04:42:16.392 INFO:tasks.rados.rados.0.smithi116.stdout:37: write initial oid 37 2023-01-25T04:42:16.393 INFO:tasks.rados.rados.0.smithi116.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2023-01-25T04:42:16.394 INFO:tasks.rados.rados.0.smithi116.stdout:37: writing smithi116107171-37 from 605052 to 1379428 tid 1 2023-01-25T04:42:16.400 INFO:tasks.rados.rados.0.smithi116.stdout:37: writing smithi116107171-37 from 1923587 to 2556923 tid 2 2023-01-25T04:42:16.401 INFO:tasks.rados.rados.0.smithi116.stdout:38: write initial oid 38 2023-01-25T04:42:16.401 INFO:tasks.rados.rados.0.smithi116.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2023-01-25T04:42:16.406 INFO:tasks.rados.rados.0.smithi116.stdout:38: writing smithi116107171-38 from 621859 to 1071484 tid 1 2023-01-25T04:42:16.415 INFO:tasks.rados.rados.0.smithi116.stdout:38: writing smithi116107171-38 from 1865716 to 2621859 tid 2 2023-01-25T04:42:16.415 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.415 INFO:tasks.rados.rados.0.smithi116.stdout:23: finishing write tid 2 to smithi116107171-23 2023-01-25T04:42:16.416 INFO:tasks.rados.rados.0.smithi116.stdout:23: finishing write tid 3 to smithi116107171-23 2023-01-25T04:42:16.416 INFO:tasks.rados.rados.0.smithi116.stdout:23: finishing write tid 4 to smithi116107171-23 2023-01-25T04:42:16.416 INFO:tasks.rados.rados.0.smithi116.stdout:23: oid 23 updating version 0 to 8 2023-01-25T04:42:16.416 INFO:tasks.rados.rados.0.smithi116.stdout:23: oid 23 updating version 8 to 24 2023-01-25T04:42:16.416 INFO:tasks.rados.rados.0.smithi116.stdout:23: oid 23 version 24 is already newer than 23 2023-01-25T04:42:16.417 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 23 v 24 (ObjNum 22 snap 0 seq_num 22) dirty exists 2023-01-25T04:42:16.417 INFO:tasks.rados.rados.0.smithi116.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2023-01-25T04:42:16.417 INFO:tasks.rados.rados.0.smithi116.stdout:25: finishing write tid 1 to smithi116107171-25 2023-01-25T04:42:16.417 INFO:tasks.rados.rados.0.smithi116.stdout:24: finishing write tid 2 to smithi116107171-24 2023-01-25T04:42:16.418 INFO:tasks.rados.rados.0.smithi116.stdout:23: done (15 left) 2023-01-25T04:42:16.418 INFO:tasks.rados.rados.0.smithi116.stdout:39: write initial oid 39 2023-01-25T04:42:16.418 INFO:tasks.rados.rados.0.smithi116.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2023-01-25T04:42:16.420 INFO:tasks.rados.rados.0.smithi116.stdout:39: writing smithi116107171-39 from 638666 to 1163540 tid 1 2023-01-25T04:42:16.429 INFO:tasks.rados.rados.0.smithi116.stdout:39: writing smithi116107171-39 from 1924198 to 2561203 tid 2 2023-01-25T04:42:16.429 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.429 INFO:tasks.rados.rados.0.smithi116.stdout:24: finishing write tid 3 to smithi116107171-24 2023-01-25T04:42:16.430 INFO:tasks.rados.rados.0.smithi116.stdout:24: finishing write tid 4 to smithi116107171-24 2023-01-25T04:42:16.430 INFO:tasks.rados.rados.0.smithi116.stdout:24: oid 24 updating version 0 to 21 2023-01-25T04:42:16.430 INFO:tasks.rados.rados.0.smithi116.stdout:24: oid 24 version 21 is already newer than 7 2023-01-25T04:42:16.431 INFO:tasks.rados.rados.0.smithi116.stdout:24: oid 24 version 21 is already newer than 20 2023-01-25T04:42:16.431 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 24 v 21 (ObjNum 23 snap 0 seq_num 23) dirty exists 2023-01-25T04:42:16.431 INFO:tasks.rados.rados.0.smithi116.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2023-01-25T04:42:16.431 INFO:tasks.rados.rados.0.smithi116.stdout:25: finishing write tid 2 to smithi116107171-25 2023-01-25T04:42:16.431 INFO:tasks.rados.rados.0.smithi116.stdout:24: done (15 left) 2023-01-25T04:42:16.432 INFO:tasks.rados.rados.0.smithi116.stdout:40: write initial oid 40 2023-01-25T04:42:16.432 INFO:tasks.rados.rados.0.smithi116.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2023-01-25T04:42:16.436 INFO:tasks.rados.rados.0.smithi116.stdout:40: writing smithi116107171-40 from 655473 to 1371949 tid 1 2023-01-25T04:42:16.445 INFO:tasks.rados.rados.0.smithi116.stdout:40: writing smithi116107171-40 from 2099033 to 2655473 tid 2 2023-01-25T04:42:16.445 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.445 INFO:tasks.rados.rados.0.smithi116.stdout:25: finishing write tid 3 to smithi116107171-25 2023-01-25T04:42:16.445 INFO:tasks.rados.rados.0.smithi116.stdout:25: finishing write tid 4 to smithi116107171-25 2023-01-25T04:42:16.446 INFO:tasks.rados.rados.0.smithi116.stdout:25: oid 25 updating version 0 to 26 2023-01-25T04:42:16.446 INFO:tasks.rados.rados.0.smithi116.stdout:25: oid 25 updating version 26 to 27 2023-01-25T04:42:16.446 INFO:tasks.rados.rados.0.smithi116.stdout:25: oid 25 version 27 is already newer than 9 2023-01-25T04:42:16.446 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 25 v 27 (ObjNum 24 snap 0 seq_num 24) dirty exists 2023-01-25T04:42:16.446 INFO:tasks.rados.rados.0.smithi116.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2023-01-25T04:42:16.447 INFO:tasks.rados.rados.0.smithi116.stdout:26: finishing write tid 1 to smithi116107171-26 2023-01-25T04:42:16.447 INFO:tasks.rados.rados.0.smithi116.stdout:26: finishing write tid 2 to smithi116107171-26 2023-01-25T04:42:16.447 INFO:tasks.rados.rados.0.smithi116.stdout:26: finishing write tid 3 to smithi116107171-26 2023-01-25T04:42:16.447 INFO:tasks.rados.rados.0.smithi116.stdout:26: finishing write tid 4 to smithi116107171-26 2023-01-25T04:42:16.447 INFO:tasks.rados.rados.0.smithi116.stdout:26: oid 26 updating version 0 to 15 2023-01-25T04:42:16.448 INFO:tasks.rados.rados.0.smithi116.stdout:26: oid 26 version 15 is already newer than 14 2023-01-25T04:42:16.448 INFO:tasks.rados.rados.0.smithi116.stdout:26: oid 26 version 15 is already newer than 5 2023-01-25T04:42:16.448 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 26 v 15 (ObjNum 25 snap 0 seq_num 25) dirty exists 2023-01-25T04:42:16.448 INFO:tasks.rados.rados.0.smithi116.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2023-01-25T04:42:16.449 INFO:tasks.rados.rados.0.smithi116.stdout:27: finishing write tid 1 to smithi116107171-27 2023-01-25T04:42:16.449 INFO:tasks.rados.rados.0.smithi116.stdout:27: finishing write tid 2 to smithi116107171-27 2023-01-25T04:42:16.449 INFO:tasks.rados.rados.0.smithi116.stdout:27: finishing write tid 3 to smithi116107171-27 2023-01-25T04:42:16.450 INFO:tasks.rados.rados.0.smithi116.stdout:27: finishing write tid 4 to smithi116107171-27 2023-01-25T04:42:16.450 INFO:tasks.rados.rados.0.smithi116.stdout:27: oid 27 updating version 0 to 8 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:27: oid 27 updating version 8 to 23 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:27: oid 27 updating version 23 to 24 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 27 v 24 (ObjNum 26 snap 0 seq_num 26) dirty exists 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:28: finishing write tid 1 to smithi116107171-28 2023-01-25T04:42:16.451 INFO:tasks.rados.rados.0.smithi116.stdout:28: finishing write tid 2 to smithi116107171-28 2023-01-25T04:42:16.452 INFO:tasks.rados.rados.0.smithi116.stdout:28: finishing write tid 3 to smithi116107171-28 2023-01-25T04:42:16.452 INFO:tasks.rados.rados.0.smithi116.stdout:28: finishing write tid 4 to smithi116107171-28 2023-01-25T04:42:16.452 INFO:tasks.rados.rados.0.smithi116.stdout:28: oid 28 updating version 0 to 17 2023-01-25T04:42:16.452 INFO:tasks.rados.rados.0.smithi116.stdout:28: oid 28 version 17 is already newer than 6 2023-01-25T04:42:16.452 INFO:tasks.rados.rados.0.smithi116.stdout:28: oid 28 updating version 17 to 18 2023-01-25T04:42:16.453 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 28 v 18 (ObjNum 27 snap 0 seq_num 27) dirty exists 2023-01-25T04:42:16.453 INFO:tasks.rados.rados.0.smithi116.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2023-01-25T04:42:16.453 INFO:tasks.rados.rados.0.smithi116.stdout:29: finishing write tid 1 to smithi116107171-29 2023-01-25T04:42:16.453 INFO:tasks.rados.rados.0.smithi116.stdout:29: finishing write tid 2 to smithi116107171-29 2023-01-25T04:42:16.453 INFO:tasks.rados.rados.0.smithi116.stdout:25: done (15 left) 2023-01-25T04:42:16.454 INFO:tasks.rados.rados.0.smithi116.stdout:26: done (14 left) 2023-01-25T04:42:16.454 INFO:tasks.rados.rados.0.smithi116.stdout:27: done (13 left) 2023-01-25T04:42:16.454 INFO:tasks.rados.rados.0.smithi116.stdout:28: done (12 left) 2023-01-25T04:42:16.454 INFO:tasks.rados.rados.0.smithi116.stdout:41: write initial oid 41 2023-01-25T04:42:16.454 INFO:tasks.rados.rados.0.smithi116.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2023-01-25T04:42:16.455 INFO:tasks.rados.rados.0.smithi116.stdout:41: writing smithi116107171-41 from 672280 to 1464005 tid 1 2023-01-25T04:42:16.457 INFO:tasks.rados.rados.0.smithi116.stdout:41: writing smithi116107171-41 from 2157515 to 2672280 tid 2 2023-01-25T04:42:16.457 INFO:tasks.rados.rados.0.smithi116.stdout:42: write initial oid 42 2023-01-25T04:42:16.457 INFO:tasks.rados.rados.0.smithi116.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2023-01-25T04:42:16.463 INFO:tasks.rados.rados.0.smithi116.stdout:42: writing smithi116107171-42 from 689087 to 1156061 tid 1 2023-01-25T04:42:16.471 INFO:tasks.rados.rados.0.smithi116.stdout:42: writing smithi116107171-42 from 1699644 to 2483976 tid 2 2023-01-25T04:42:16.471 INFO:tasks.rados.rados.0.smithi116.stdout:43: write initial oid 43 2023-01-25T04:42:16.471 INFO:tasks.rados.rados.0.smithi116.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2023-01-25T04:42:16.477 INFO:tasks.rados.rados.0.smithi116.stdout:43: writing smithi116107171-43 from 705894 to 1248117 tid 1 2023-01-25T04:42:16.484 INFO:tasks.rados.rados.0.smithi116.stdout:43: writing smithi116107171-43 from 1758126 to 2402469 tid 2 2023-01-25T04:42:16.484 INFO:tasks.rados.rados.0.smithi116.stdout:44: write initial oid 44 2023-01-25T04:42:16.485 INFO:tasks.rados.rados.0.smithi116.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2023-01-25T04:42:16.491 INFO:tasks.rados.rados.0.smithi116.stdout:44: writing smithi116107171-44 from 722701 to 1340173 tid 1 2023-01-25T04:42:16.499 INFO:tasks.rados.rados.0.smithi116.stdout:44: writing smithi116107171-44 from 1816608 to 2604609 tid 2 2023-01-25T04:42:16.500 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.500 INFO:tasks.rados.rados.0.smithi116.stdout:30: finishing write tid 1 to smithi116107171-30 2023-01-25T04:42:16.500 INFO:tasks.rados.rados.0.smithi116.stdout:29: finishing write tid 3 to smithi116107171-29 2023-01-25T04:42:16.500 INFO:tasks.rados.rados.0.smithi116.stdout:29: finishing write tid 4 to smithi116107171-29 2023-01-25T04:42:16.501 INFO:tasks.rados.rados.0.smithi116.stdout:29: oid 29 updating version 0 to 21 2023-01-25T04:42:16.501 INFO:tasks.rados.rados.0.smithi116.stdout:29: oid 29 version 21 is already newer than 7 2023-01-25T04:42:16.501 INFO:tasks.rados.rados.0.smithi116.stdout:29: oid 29 version 21 is already newer than 20 2023-01-25T04:42:16.501 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 29 v 21 (ObjNum 28 snap 0 seq_num 28) dirty exists 2023-01-25T04:42:16.501 INFO:tasks.rados.rados.0.smithi116.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2023-01-25T04:42:16.502 INFO:tasks.rados.rados.0.smithi116.stdout:30: finishing write tid 2 to smithi116107171-30 2023-01-25T04:42:16.502 INFO:tasks.rados.rados.0.smithi116.stdout:30: finishing write tid 3 to smithi116107171-30 2023-01-25T04:42:16.502 INFO:tasks.rados.rados.0.smithi116.stdout:30: finishing write tid 4 to smithi116107171-30 2023-01-25T04:42:16.502 INFO:tasks.rados.rados.0.smithi116.stdout:30: oid 30 updating version 0 to 6 2023-01-25T04:42:16.502 INFO:tasks.rados.rados.0.smithi116.stdout:30: oid 30 updating version 6 to 17 2023-01-25T04:42:16.503 INFO:tasks.rados.rados.0.smithi116.stdout:30: oid 30 updating version 17 to 18 2023-01-25T04:42:16.503 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 30 v 18 (ObjNum 29 snap 0 seq_num 29) dirty exists 2023-01-25T04:42:16.503 INFO:tasks.rados.rados.0.smithi116.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2023-01-25T04:42:16.503 INFO:tasks.rados.rados.0.smithi116.stdout:31: finishing write tid 1 to smithi116107171-31 2023-01-25T04:42:16.503 INFO:tasks.rados.rados.0.smithi116.stdout:29: done (15 left) 2023-01-25T04:42:16.504 INFO:tasks.rados.rados.0.smithi116.stdout:30: done (14 left) 2023-01-25T04:42:16.504 INFO:tasks.rados.rados.0.smithi116.stdout:45: write initial oid 45 2023-01-25T04:42:16.504 INFO:tasks.rados.rados.0.smithi116.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2023-01-25T04:42:16.507 INFO:tasks.rados.rados.0.smithi116.stdout:45: writing smithi116107171-45 from 739508 to 1432229 tid 1 2023-01-25T04:42:16.512 INFO:tasks.rados.rados.0.smithi116.stdout:45: writing smithi116107171-45 from 1875090 to 2523102 tid 2 2023-01-25T04:42:16.513 INFO:tasks.rados.rados.0.smithi116.stdout:46: write initial oid 46 2023-01-25T04:42:16.513 INFO:tasks.rados.rados.0.smithi116.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2023-01-25T04:42:16.520 INFO:tasks.rados.rados.0.smithi116.stdout:46: writing smithi116107171-46 from 756315 to 1524285 tid 1 2023-01-25T04:42:16.528 INFO:tasks.rados.rados.0.smithi116.stdout:46: writing smithi116107171-46 from 1933572 to 2725242 tid 2 2023-01-25T04:42:16.528 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.528 INFO:tasks.rados.rados.0.smithi116.stdout:31: finishing write tid 2 to smithi116107171-31 2023-01-25T04:42:16.528 INFO:tasks.rados.rados.0.smithi116.stdout:31: finishing write tid 3 to smithi116107171-31 2023-01-25T04:42:16.529 INFO:tasks.rados.rados.0.smithi116.stdout:31: finishing write tid 4 to smithi116107171-31 2023-01-25T04:42:16.529 INFO:tasks.rados.rados.0.smithi116.stdout:31: oid 31 updating version 0 to 10 2023-01-25T04:42:16.529 INFO:tasks.rados.rados.0.smithi116.stdout:31: oid 31 updating version 10 to 12 2023-01-25T04:42:16.529 INFO:tasks.rados.rados.0.smithi116.stdout:31: oid 31 version 12 is already newer than 11 2023-01-25T04:42:16.529 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 31 v 12 (ObjNum 30 snap 0 seq_num 30) dirty exists 2023-01-25T04:42:16.530 INFO:tasks.rados.rados.0.smithi116.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2023-01-25T04:42:16.530 INFO:tasks.rados.rados.0.smithi116.stdout:32: finishing write tid 1 to smithi116107171-32 2023-01-25T04:42:16.530 INFO:tasks.rados.rados.0.smithi116.stdout:32: finishing write tid 2 to smithi116107171-32 2023-01-25T04:42:16.530 INFO:tasks.rados.rados.0.smithi116.stdout:31: done (15 left) 2023-01-25T04:42:16.530 INFO:tasks.rados.rados.0.smithi116.stdout:47: write initial oid 47 2023-01-25T04:42:16.531 INFO:tasks.rados.rados.0.smithi116.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2023-01-25T04:42:16.535 INFO:tasks.rados.rados.0.smithi116.stdout:47: writing smithi116107171-47 from 773122 to 1332694 tid 1 2023-01-25T04:42:16.545 INFO:tasks.rados.rados.0.smithi116.stdout:47: writing smithi116107171-47 from 1992054 to 2643735 tid 2 2023-01-25T04:42:16.546 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.546 INFO:tasks.rados.rados.0.smithi116.stdout:33: finishing write tid 1 to smithi116107171-33 2023-01-25T04:42:16.546 INFO:tasks.rados.rados.0.smithi116.stdout:32: finishing write tid 3 to smithi116107171-32 2023-01-25T04:42:16.547 INFO:tasks.rados.rados.0.smithi116.stdout:32: finishing write tid 4 to smithi116107171-32 2023-01-25T04:42:16.547 INFO:tasks.rados.rados.0.smithi116.stdout:32: oid 32 updating version 0 to 9 2023-01-25T04:42:16.547 INFO:tasks.rados.rados.0.smithi116.stdout:32: oid 32 version 9 is already newer than 8 2023-01-25T04:42:16.548 INFO:tasks.rados.rados.0.smithi116.stdout:32: oid 32 updating version 9 to 10 2023-01-25T04:42:16.548 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 32 v 10 (ObjNum 31 snap 0 seq_num 31) dirty exists 2023-01-25T04:42:16.548 INFO:tasks.rados.rados.0.smithi116.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2023-01-25T04:42:16.549 INFO:tasks.rados.rados.0.smithi116.stdout:33: finishing write tid 2 to smithi116107171-33 2023-01-25T04:42:16.549 INFO:tasks.rados.rados.0.smithi116.stdout:33: finishing write tid 3 to smithi116107171-33 2023-01-25T04:42:16.550 INFO:tasks.rados.rados.0.smithi116.stdout:33: finishing write tid 4 to smithi116107171-33 2023-01-25T04:42:16.550 INFO:tasks.rados.rados.0.smithi116.stdout:33: oid 33 updating version 0 to 7 2023-01-25T04:42:16.550 INFO:tasks.rados.rados.0.smithi116.stdout:33: oid 33 updating version 7 to 20 2023-01-25T04:42:16.551 INFO:tasks.rados.rados.0.smithi116.stdout:33: oid 33 updating version 20 to 21 2023-01-25T04:42:16.551 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 33 v 21 (ObjNum 32 snap 0 seq_num 32) dirty exists 2023-01-25T04:42:16.552 INFO:tasks.rados.rados.0.smithi116.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2023-01-25T04:42:16.552 INFO:tasks.rados.rados.0.smithi116.stdout:34: finishing write tid 1 to smithi116107171-34 2023-01-25T04:42:16.553 INFO:tasks.rados.rados.0.smithi116.stdout:34: finishing write tid 2 to smithi116107171-34 2023-01-25T04:42:16.553 INFO:tasks.rados.rados.0.smithi116.stdout:32: done (15 left) 2023-01-25T04:42:16.553 INFO:tasks.rados.rados.0.smithi116.stdout:33: done (14 left) 2023-01-25T04:42:16.553 INFO:tasks.rados.rados.0.smithi116.stdout:48: write initial oid 48 2023-01-25T04:42:16.553 INFO:tasks.rados.rados.0.smithi116.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2023-01-25T04:42:16.554 INFO:tasks.rados.rados.0.smithi116.stdout:48: writing smithi116107171-48 from 789929 to 1424750 tid 1 2023-01-25T04:42:16.558 INFO:tasks.rados.rados.0.smithi116.stdout:48: writing smithi116107171-48 from 2050536 to 2789929 tid 2 2023-01-25T04:42:16.558 INFO:tasks.rados.rados.0.smithi116.stdout:49: write initial oid 49 2023-01-25T04:42:16.559 INFO:tasks.rados.rados.0.smithi116.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2023-01-25T04:42:16.563 INFO:tasks.rados.rados.0.smithi116.stdout:49: writing smithi116107171-49 from 406736 to 1116806 tid 1 2023-01-25T04:42:16.572 INFO:tasks.rados.rados.0.smithi116.stdout:49: writing smithi116107171-49 from 1709018 to 2364368 tid 2 2023-01-25T04:42:16.572 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.572 INFO:tasks.rados.rados.0.smithi116.stdout:34: finishing write tid 3 to smithi116107171-34 2023-01-25T04:42:16.572 INFO:tasks.rados.rados.0.smithi116.stdout:34: finishing write tid 4 to smithi116107171-34 2023-01-25T04:42:16.573 INFO:tasks.rados.rados.0.smithi116.stdout:34: oid 34 updating version 0 to 26 2023-01-25T04:42:16.573 INFO:tasks.rados.rados.0.smithi116.stdout:34: oid 34 version 26 is already newer than 9 2023-01-25T04:42:16.573 INFO:tasks.rados.rados.0.smithi116.stdout:34: oid 34 updating version 26 to 27 2023-01-25T04:42:16.573 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 34 v 27 (ObjNum 33 snap 0 seq_num 33) dirty exists 2023-01-25T04:42:16.573 INFO:tasks.rados.rados.0.smithi116.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2023-01-25T04:42:16.574 INFO:tasks.rados.rados.0.smithi116.stdout:35: finishing write tid 1 to smithi116107171-35 2023-01-25T04:42:16.574 INFO:tasks.rados.rados.0.smithi116.stdout:35: finishing write tid 2 to smithi116107171-35 2023-01-25T04:42:16.574 INFO:tasks.rados.rados.0.smithi116.stdout:36: finishing write tid 1 to smithi116107171-36 2023-01-25T04:42:16.574 INFO:tasks.rados.rados.0.smithi116.stdout:35: finishing write tid 3 to smithi116107171-35 2023-01-25T04:42:16.574 INFO:tasks.rados.rados.0.smithi116.stdout:34: done (15 left) 2023-01-25T04:42:16.575 INFO:tasks.rados.rados.0.smithi116.stdout:50: write initial oid 50 2023-01-25T04:42:16.575 INFO:tasks.rados.rados.0.smithi116.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2023-01-25T04:42:16.577 INFO:tasks.rados.rados.0.smithi116.stdout:50: writing smithi116107171-50 from 423543 to 1208862 tid 1 2023-01-25T04:42:16.588 INFO:tasks.rados.rados.0.smithi116.stdout:50: writing smithi116107171-50 from 1767500 to 2566508 tid 2 2023-01-25T04:42:16.588 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.588 INFO:tasks.rados.rados.0.smithi116.stdout:35: finishing write tid 4 to smithi116107171-35 2023-01-25T04:42:16.588 INFO:tasks.rados.rados.0.smithi116.stdout:35: oid 35 updating version 0 to 30 2023-01-25T04:42:16.589 INFO:tasks.rados.rados.0.smithi116.stdout:35: oid 35 version 30 is already newer than 29 2023-01-25T04:42:16.589 INFO:tasks.rados.rados.0.smithi116.stdout:35: oid 35 version 30 is already newer than 10 2023-01-25T04:42:16.589 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 35 v 30 (ObjNum 34 snap 0 seq_num 34) dirty exists 2023-01-25T04:42:16.589 INFO:tasks.rados.rados.0.smithi116.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2023-01-25T04:42:16.589 INFO:tasks.rados.rados.0.smithi116.stdout:36: finishing write tid 2 to smithi116107171-36 2023-01-25T04:42:16.590 INFO:tasks.rados.rados.0.smithi116.stdout:36: finishing write tid 3 to smithi116107171-36 2023-01-25T04:42:16.590 INFO:tasks.rados.rados.0.smithi116.stdout:36: finishing write tid 4 to smithi116107171-36 2023-01-25T04:42:16.590 INFO:tasks.rados.rados.0.smithi116.stdout:36: oid 36 updating version 0 to 24 2023-01-25T04:42:16.590 INFO:tasks.rados.rados.0.smithi116.stdout:36: oid 36 version 24 is already newer than 12 2023-01-25T04:42:16.590 INFO:tasks.rados.rados.0.smithi116.stdout:36: oid 36 version 24 is already newer than 11 2023-01-25T04:42:16.591 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 36 v 24 (ObjNum 35 snap 0 seq_num 35) dirty exists 2023-01-25T04:42:16.591 INFO:tasks.rados.rados.0.smithi116.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2023-01-25T04:42:16.591 INFO:tasks.rados.rados.0.smithi116.stdout:37: finishing write tid 1 to smithi116107171-37 2023-01-25T04:42:16.591 INFO:tasks.rados.rados.0.smithi116.stdout:37: finishing write tid 2 to smithi116107171-37 2023-01-25T04:42:16.591 INFO:tasks.rados.rados.0.smithi116.stdout:37: finishing write tid 3 to smithi116107171-37 2023-01-25T04:42:16.592 INFO:tasks.rados.rados.0.smithi116.stdout:38: finishing write tid 1 to smithi116107171-38 2023-01-25T04:42:16.592 INFO:tasks.rados.rados.0.smithi116.stdout:37: finishing write tid 4 to smithi116107171-37 2023-01-25T04:42:16.592 INFO:tasks.rados.rados.0.smithi116.stdout:37: oid 37 updating version 0 to 27 2023-01-25T04:42:16.592 INFO:tasks.rados.rados.0.smithi116.stdout:37: oid 37 version 27 is already newer than 26 2023-01-25T04:42:16.592 INFO:tasks.rados.rados.0.smithi116.stdout:37: oid 37 version 27 is already newer than 13 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 37 v 27 (ObjNum 36 snap 0 seq_num 36) dirty exists 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:38: finishing write tid 2 to smithi116107171-38 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:38: finishing write tid 3 to smithi116107171-38 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:39: finishing write tid 1 to smithi116107171-39 2023-01-25T04:42:16.593 INFO:tasks.rados.rados.0.smithi116.stdout:38: finishing write tid 4 to smithi116107171-38 2023-01-25T04:42:16.594 INFO:tasks.rados.rados.0.smithi116.stdout:38: oid 38 updating version 0 to 14 2023-01-25T04:42:16.594 INFO:tasks.rados.rados.0.smithi116.stdout:38: oid 38 updating version 14 to 29 2023-01-25T04:42:16.594 INFO:tasks.rados.rados.0.smithi116.stdout:38: oid 38 updating version 29 to 30 2023-01-25T04:42:16.594 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 38 v 30 (ObjNum 37 snap 0 seq_num 37) dirty exists 2023-01-25T04:42:16.594 INFO:tasks.rados.rados.0.smithi116.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2023-01-25T04:42:16.595 INFO:tasks.rados.rados.0.smithi116.stdout:39: finishing write tid 2 to smithi116107171-39 2023-01-25T04:42:16.595 INFO:tasks.rados.rados.0.smithi116.stdout:39: finishing write tid 3 to smithi116107171-39 2023-01-25T04:42:16.595 INFO:tasks.rados.rados.0.smithi116.stdout:39: finishing write tid 4 to smithi116107171-39 2023-01-25T04:42:16.595 INFO:tasks.rados.rados.0.smithi116.stdout:39: oid 39 updating version 0 to 24 2023-01-25T04:42:16.595 INFO:tasks.rados.rados.0.smithi116.stdout:39: oid 39 version 24 is already newer than 23 2023-01-25T04:42:16.596 INFO:tasks.rados.rados.0.smithi116.stdout:39: oid 39 version 24 is already newer than 8 2023-01-25T04:42:16.596 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 39 v 24 (ObjNum 38 snap 0 seq_num 38) dirty exists 2023-01-25T04:42:16.596 INFO:tasks.rados.rados.0.smithi116.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2023-01-25T04:42:16.596 INFO:tasks.rados.rados.0.smithi116.stdout:40: finishing write tid 1 to smithi116107171-40 2023-01-25T04:42:16.596 INFO:tasks.rados.rados.0.smithi116.stdout:40: finishing write tid 2 to smithi116107171-40 2023-01-25T04:42:16.597 INFO:tasks.rados.rados.0.smithi116.stdout:40: finishing write tid 3 to smithi116107171-40 2023-01-25T04:42:16.597 INFO:tasks.rados.rados.0.smithi116.stdout:40: finishing write tid 4 to smithi116107171-40 2023-01-25T04:42:16.597 INFO:tasks.rados.rados.0.smithi116.stdout:40: oid 40 updating version 0 to 17 2023-01-25T04:42:16.597 INFO:tasks.rados.rados.0.smithi116.stdout:40: oid 40 version 17 is already newer than 15 2023-01-25T04:42:16.597 INFO:tasks.rados.rados.0.smithi116.stdout:40: oid 40 version 17 is already newer than 16 2023-01-25T04:42:16.598 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 40 v 17 (ObjNum 39 snap 0 seq_num 39) dirty exists 2023-01-25T04:42:16.598 INFO:tasks.rados.rados.0.smithi116.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2023-01-25T04:42:16.598 INFO:tasks.rados.rados.0.smithi116.stdout:41: finishing write tid 1 to smithi116107171-41 2023-01-25T04:42:16.598 INFO:tasks.rados.rados.0.smithi116.stdout:41: finishing write tid 2 to smithi116107171-41 2023-01-25T04:42:16.598 INFO:tasks.rados.rados.0.smithi116.stdout:41: finishing write tid 3 to smithi116107171-41 2023-01-25T04:42:16.599 INFO:tasks.rados.rados.0.smithi116.stdout:41: finishing write tid 4 to smithi116107171-41 2023-01-25T04:42:16.599 INFO:tasks.rados.rados.0.smithi116.stdout:41: oid 41 updating version 0 to 20 2023-01-25T04:42:16.599 INFO:tasks.rados.rados.0.smithi116.stdout:41: oid 41 version 20 is already newer than 19 2023-01-25T04:42:16.599 INFO:tasks.rados.rados.0.smithi116.stdout:41: oid 41 version 20 is already newer than 18 2023-01-25T04:42:16.599 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 41 v 20 (ObjNum 40 snap 0 seq_num 40) dirty exists 2023-01-25T04:42:16.600 INFO:tasks.rados.rados.0.smithi116.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2023-01-25T04:42:16.600 INFO:tasks.rados.rados.0.smithi116.stdout:42: finishing write tid 1 to smithi116107171-42 2023-01-25T04:42:16.600 INFO:tasks.rados.rados.0.smithi116.stdout:42: finishing write tid 2 to smithi116107171-42 2023-01-25T04:42:16.600 INFO:tasks.rados.rados.0.smithi116.stdout:42: finishing write tid 3 to smithi116107171-42 2023-01-25T04:42:16.600 INFO:tasks.rados.rados.0.smithi116.stdout:42: finishing write tid 4 to smithi116107171-42 2023-01-25T04:42:16.601 INFO:tasks.rados.rados.0.smithi116.stdout:42: oid 42 updating version 0 to 32 2023-01-25T04:42:16.601 INFO:tasks.rados.rados.0.smithi116.stdout:42: oid 42 updating version 32 to 33 2023-01-25T04:42:16.601 INFO:tasks.rados.rados.0.smithi116.stdout:42: oid 42 version 33 is already newer than 11 2023-01-25T04:42:16.601 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 42 v 33 (ObjNum 41 snap 0 seq_num 41) dirty exists 2023-01-25T04:42:16.601 INFO:tasks.rados.rados.0.smithi116.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: finishing write tid 1 to smithi116107171-43 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: finishing write tid 2 to smithi116107171-43 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: finishing write tid 3 to smithi116107171-43 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: finishing write tid 4 to smithi116107171-43 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: oid 43 updating version 0 to 35 2023-01-25T04:42:16.602 INFO:tasks.rados.rados.0.smithi116.stdout:43: oid 43 updating version 35 to 36 2023-01-25T04:42:16.603 INFO:tasks.rados.rados.0.smithi116.stdout:43: oid 43 version 36 is already newer than 12 2023-01-25T04:42:16.603 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 43 v 36 (ObjNum 42 snap 0 seq_num 42) dirty exists 2023-01-25T04:42:16.603 INFO:tasks.rados.rados.0.smithi116.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2023-01-25T04:42:16.603 INFO:tasks.rados.rados.0.smithi116.stdout:44: finishing write tid 1 to smithi116107171-44 2023-01-25T04:42:16.603 INFO:tasks.rados.rados.0.smithi116.stdout:44: finishing write tid 2 to smithi116107171-44 2023-01-25T04:42:16.604 INFO:tasks.rados.rados.0.smithi116.stdout:44: finishing write tid 3 to smithi116107171-44 2023-01-25T04:42:16.604 INFO:tasks.rados.rados.0.smithi116.stdout:44: finishing write tid 4 to smithi116107171-44 2023-01-25T04:42:16.604 INFO:tasks.rados.rados.0.smithi116.stdout:44: oid 44 updating version 0 to 27 2023-01-25T04:42:16.604 INFO:tasks.rados.rados.0.smithi116.stdout:44: oid 44 version 27 is already newer than 26 2023-01-25T04:42:16.604 INFO:tasks.rados.rados.0.smithi116.stdout:44: oid 44 version 27 is already newer than 9 2023-01-25T04:42:16.605 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 44 v 27 (ObjNum 43 snap 0 seq_num 43) dirty exists 2023-01-25T04:42:16.605 INFO:tasks.rados.rados.0.smithi116.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2023-01-25T04:42:16.605 INFO:tasks.rados.rados.0.smithi116.stdout:45: finishing write tid 1 to smithi116107171-45 2023-01-25T04:42:16.605 INFO:tasks.rados.rados.0.smithi116.stdout:45: finishing write tid 2 to smithi116107171-45 2023-01-25T04:42:16.605 INFO:tasks.rados.rados.0.smithi116.stdout:45: finishing write tid 3 to smithi116107171-45 2023-01-25T04:42:16.606 INFO:tasks.rados.rados.0.smithi116.stdout:45: finishing write tid 4 to smithi116107171-45 2023-01-25T04:42:16.606 INFO:tasks.rados.rados.0.smithi116.stdout:45: oid 45 updating version 0 to 15 2023-01-25T04:42:16.606 INFO:tasks.rados.rados.0.smithi116.stdout:45: oid 45 version 15 is already newer than 13 2023-01-25T04:42:16.607 INFO:tasks.rados.rados.0.smithi116.stdout:45: oid 45 version 15 is already newer than 14 2023-01-25T04:42:16.607 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 45 v 15 (ObjNum 44 snap 0 seq_num 44) dirty exists 2023-01-25T04:42:16.608 INFO:tasks.rados.rados.0.smithi116.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2023-01-25T04:42:16.608 INFO:tasks.rados.rados.0.smithi116.stdout:46: finishing write tid 1 to smithi116107171-46 2023-01-25T04:42:16.608 INFO:tasks.rados.rados.0.smithi116.stdout:46: finishing write tid 2 to smithi116107171-46 2023-01-25T04:42:16.608 INFO:tasks.rados.rados.0.smithi116.stdout:46: finishing write tid 3 to smithi116107171-46 2023-01-25T04:42:16.608 INFO:tasks.rados.rados.0.smithi116.stdout:35: done (15 left) 2023-01-25T04:42:16.609 INFO:tasks.rados.rados.0.smithi116.stdout:36: done (14 left) 2023-01-25T04:42:16.609 INFO:tasks.rados.rados.0.smithi116.stdout:37: done (13 left) 2023-01-25T04:42:16.609 INFO:tasks.rados.rados.0.smithi116.stdout:38: done (12 left) 2023-01-25T04:42:16.609 INFO:tasks.rados.rados.0.smithi116.stdout:39: done (11 left) 2023-01-25T04:42:16.609 INFO:tasks.rados.rados.0.smithi116.stdout:40: done (10 left) 2023-01-25T04:42:16.610 INFO:tasks.rados.rados.0.smithi116.stdout:41: done (9 left) 2023-01-25T04:42:16.610 INFO:tasks.rados.rados.0.smithi116.stdout:42: done (8 left) 2023-01-25T04:42:16.610 INFO:tasks.rados.rados.0.smithi116.stdout:43: done (7 left) 2023-01-25T04:42:16.610 INFO:tasks.rados.rados.0.smithi116.stdout:44: done (6 left) 2023-01-25T04:42:16.610 INFO:tasks.rados.rados.0.smithi116.stdout:45: done (5 left) 2023-01-25T04:42:16.611 INFO:tasks.rados.rados.0.smithi116.stdout:51: write initial oid 51 2023-01-25T04:42:16.611 INFO:tasks.rados.rados.0.smithi116.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2023-01-25T04:42:16.612 INFO:tasks.rados.rados.0.smithi116.stdout:51: writing smithi116107171-51 from 440350 to 900918 tid 1 2023-01-25T04:42:16.612 INFO:tasks.rados.rados.0.smithi116.stdout:51: writing smithi116107171-51 from 1309629 to 1852295 tid 2 2023-01-25T04:42:16.612 INFO:tasks.rados.rados.0.smithi116.stdout:51: writing smithi116107171-51 from 2323973 to 2840350 tid 3 2023-01-25T04:42:16.613 INFO:tasks.rados.rados.0.smithi116.stdout:52: write initial oid 52 2023-01-25T04:42:16.613 INFO:tasks.rados.rados.0.smithi116.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2023-01-25T04:42:16.613 INFO:tasks.rados.rados.0.smithi116.stdout:52: writing smithi116107171-52 from 457157 to 992974 tid 1 2023-01-25T04:42:16.614 INFO:tasks.rados.rados.0.smithi116.stdout:52: writing smithi116107171-52 from 1768111 to 2170788 tid 2 2023-01-25T04:42:16.614 INFO:tasks.rados.rados.0.smithi116.stdout:53: write initial oid 53 2023-01-25T04:42:16.614 INFO:tasks.rados.rados.0.smithi116.stdout:53: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2023-01-25T04:42:16.619 INFO:tasks.rados.rados.0.smithi116.stdout:53: writing smithi116107171-53 from 473964 to 1085030 tid 1 2023-01-25T04:42:16.626 INFO:tasks.rados.rados.0.smithi116.stdout:53: writing smithi116107171-53 from 1826593 to 2372928 tid 2 2023-01-25T04:42:16.629 INFO:tasks.rados.rados.0.smithi116.stdout:53: writing smithi116107171-53 from 2778819 to 2873964 tid 3 2023-01-25T04:42:16.629 INFO:tasks.rados.rados.0.smithi116.stdout:54: write initial oid 54 2023-01-25T04:42:16.629 INFO:tasks.rados.rados.0.smithi116.stdout:54: seq_num 53 ranges {490771=686315,1885075=406346} 2023-01-25T04:42:16.635 INFO:tasks.rados.rados.0.smithi116.stdout:54: writing smithi116107171-54 from 490771 to 1177086 tid 1 2023-01-25T04:42:16.642 INFO:tasks.rados.rados.0.smithi116.stdout:54: writing smithi116107171-54 from 1885075 to 2291421 tid 2 2023-01-25T04:42:16.642 INFO:tasks.rados.rados.0.smithi116.stdout:55: write initial oid 55 2023-01-25T04:42:16.642 INFO:tasks.rados.rados.0.smithi116.stdout:55: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2023-01-25T04:42:16.647 INFO:tasks.rados.rados.0.smithi116.stdout:55: writing smithi116107171-55 from 507578 to 985495 tid 1 2023-01-25T04:42:16.654 INFO:tasks.rados.rados.0.smithi116.stdout:55: writing smithi116107171-55 from 1543557 to 2093561 tid 2 2023-01-25T04:42:16.658 INFO:tasks.rados.rados.0.smithi116.stdout:55: writing smithi116107171-55 from 2833665 to 2907578 tid 3 2023-01-25T04:42:16.658 INFO:tasks.rados.rados.0.smithi116.stdout:56: write initial oid 56 2023-01-25T04:42:16.658 INFO:tasks.rados.rados.0.smithi116.stdout:56: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2023-01-25T04:42:16.663 INFO:tasks.rados.rados.0.smithi116.stdout:56: writing smithi116107171-56 from 524385 to 1077551 tid 1 2023-01-25T04:42:16.668 INFO:tasks.rados.rados.0.smithi116.stdout:56: writing smithi116107171-56 from 1602039 to 2012054 tid 2 2023-01-25T04:42:16.674 INFO:tasks.rados.rados.0.smithi116.stdout:56: writing smithi116107171-56 from 2577441 to 2924385 tid 3 2023-01-25T04:42:16.674 INFO:tasks.rados.rados.0.smithi116.stdout:57: write initial oid 57 2023-01-25T04:42:16.674 INFO:tasks.rados.rados.0.smithi116.stdout:57: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2023-01-25T04:42:16.680 INFO:tasks.rados.rados.0.smithi116.stdout:57: writing smithi116107171-57 from 541192 to 1169607 tid 1 2023-01-25T04:42:16.687 INFO:tasks.rados.rados.0.smithi116.stdout:57: writing smithi116107171-57 from 1660521 to 2214194 tid 2 2023-01-25T04:42:16.690 INFO:tasks.rados.rados.0.smithi116.stdout:57: writing smithi116107171-57 from 2888511 to 2941192 tid 3 2023-01-25T04:42:16.690 INFO:tasks.rados.rados.0.smithi116.stdout:58: write initial oid 58 2023-01-25T04:42:16.691 INFO:tasks.rados.rados.0.smithi116.stdout:58: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2023-01-25T04:42:16.697 INFO:tasks.rados.rados.0.smithi116.stdout:58: writing smithi116107171-58 from 557999 to 1261663 tid 1 2023-01-25T04:42:16.702 INFO:tasks.rados.rados.0.smithi116.stdout:58: writing smithi116107171-58 from 1719003 to 2132687 tid 2 2023-01-25T04:42:16.706 INFO:tasks.rados.rados.0.smithi116.stdout:58: writing smithi116107171-58 from 2632287 to 2957999 tid 3 2023-01-25T04:42:16.706 INFO:tasks.rados.rados.0.smithi116.stdout:59: write initial oid 59 2023-01-25T04:42:16.707 INFO:tasks.rados.rados.0.smithi116.stdout:59: seq_num 58 ranges {574806=778913,2061132=557342} 2023-01-25T04:42:16.714 INFO:tasks.rados.rados.0.smithi116.stdout:59: writing smithi116107171-59 from 574806 to 1353719 tid 1 2023-01-25T04:42:16.720 INFO:tasks.rados.rados.0.smithi116.stdout:59: writing smithi116107171-59 from 2061132 to 2618474 tid 2 2023-01-25T04:42:16.721 INFO:tasks.rados.rados.0.smithi116.stdout:60: write initial oid 60 2023-01-25T04:42:16.721 INFO:tasks.rados.rados.0.smithi116.stdout:60: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2023-01-25T04:42:16.726 INFO:tasks.rados.rados.0.smithi116.stdout:60: writing smithi116107171-60 from 591613 to 1045775 tid 1 2023-01-25T04:42:16.732 INFO:tasks.rados.rados.0.smithi116.stdout:60: writing smithi116107171-60 from 1719614 to 2136967 tid 2 2023-01-25T04:42:16.736 INFO:tasks.rados.rados.0.smithi116.stdout:60: writing smithi116107171-60 from 2570780 to 2991613 tid 3 2023-01-25T04:42:16.737 INFO:tasks.rados.rados.0.smithi116.stdout:61: write initial oid 61 2023-01-25T04:42:16.737 INFO:tasks.rados.rados.0.smithi116.stdout:61: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2023-01-25T04:42:16.742 INFO:tasks.rados.rados.0.smithi116.stdout:61: writing smithi116107171-61 from 608420 to 1137831 tid 1 2023-01-25T04:42:16.749 INFO:tasks.rados.rados.0.smithi116.stdout:61: writing smithi116107171-61 from 1778096 to 2339107 tid 2 2023-01-25T04:42:16.755 INFO:tasks.rados.rados.0.smithi116.stdout:61: writing smithi116107171-61 from 2881850 to 3008420 tid 3 2023-01-25T04:42:16.755 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.755 INFO:tasks.rados.rados.0.smithi116.stdout:46: finishing write tid 4 to smithi116107171-46 2023-01-25T04:42:16.756 INFO:tasks.rados.rados.0.smithi116.stdout:46: oid 46 updating version 0 to 29 2023-01-25T04:42:16.756 INFO:tasks.rados.rados.0.smithi116.stdout:46: oid 46 updating version 29 to 30 2023-01-25T04:42:16.756 INFO:tasks.rados.rados.0.smithi116.stdout:46: oid 46 version 30 is already newer than 10 2023-01-25T04:42:16.756 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 46 v 30 (ObjNum 45 snap 0 seq_num 45) dirty exists 2023-01-25T04:42:16.757 INFO:tasks.rados.rados.0.smithi116.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2023-01-25T04:42:16.757 INFO:tasks.rados.rados.0.smithi116.stdout:47: finishing write tid 1 to smithi116107171-47 2023-01-25T04:42:16.757 INFO:tasks.rados.rados.0.smithi116.stdout:47: finishing write tid 2 to smithi116107171-47 2023-01-25T04:42:16.757 INFO:tasks.rados.rados.0.smithi116.stdout:47: finishing write tid 3 to smithi116107171-47 2023-01-25T04:42:16.757 INFO:tasks.rados.rados.0.smithi116.stdout:47: finishing write tid 4 to smithi116107171-47 2023-01-25T04:42:16.758 INFO:tasks.rados.rados.0.smithi116.stdout:47: oid 47 updating version 0 to 13 2023-01-25T04:42:16.758 INFO:tasks.rados.rados.0.smithi116.stdout:47: oid 47 updating version 13 to 14 2023-01-25T04:42:16.758 INFO:tasks.rados.rados.0.smithi116.stdout:47: oid 47 updating version 14 to 15 2023-01-25T04:42:16.758 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 47 v 15 (ObjNum 46 snap 0 seq_num 46) dirty exists 2023-01-25T04:42:16.758 INFO:tasks.rados.rados.0.smithi116.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2023-01-25T04:42:16.759 INFO:tasks.rados.rados.0.smithi116.stdout:48: finishing write tid 1 to smithi116107171-48 2023-01-25T04:42:16.759 INFO:tasks.rados.rados.0.smithi116.stdout:48: finishing write tid 2 to smithi116107171-48 2023-01-25T04:42:16.759 INFO:tasks.rados.rados.0.smithi116.stdout:48: finishing write tid 3 to smithi116107171-48 2023-01-25T04:42:16.759 INFO:tasks.rados.rados.0.smithi116.stdout:48: finishing write tid 4 to smithi116107171-48 2023-01-25T04:42:16.760 INFO:tasks.rados.rados.0.smithi116.stdout:48: oid 48 updating version 0 to 12 2023-01-25T04:42:16.760 INFO:tasks.rados.rados.0.smithi116.stdout:48: oid 48 updating version 12 to 13 2023-01-25T04:42:16.760 INFO:tasks.rados.rados.0.smithi116.stdout:48: oid 48 version 13 is already newer than 11 2023-01-25T04:42:16.761 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 48 v 13 (ObjNum 47 snap 0 seq_num 47) dirty exists 2023-01-25T04:42:16.761 INFO:tasks.rados.rados.0.smithi116.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2023-01-25T04:42:16.761 INFO:tasks.rados.rados.0.smithi116.stdout:49: finishing write tid 1 to smithi116107171-49 2023-01-25T04:42:16.761 INFO:tasks.rados.rados.0.smithi116.stdout:49: finishing write tid 2 to smithi116107171-49 2023-01-25T04:42:16.761 INFO:tasks.rados.rados.0.smithi116.stdout:49: finishing write tid 3 to smithi116107171-49 2023-01-25T04:42:16.762 INFO:tasks.rados.rados.0.smithi116.stdout:49: finishing write tid 4 to smithi116107171-49 2023-01-25T04:42:16.762 INFO:tasks.rados.rados.0.smithi116.stdout:49: oid 49 updating version 0 to 17 2023-01-25T04:42:16.762 INFO:tasks.rados.rados.0.smithi116.stdout:49: oid 49 updating version 17 to 18 2023-01-25T04:42:16.762 INFO:tasks.rados.rados.0.smithi116.stdout:49: oid 49 version 18 is already newer than 16 2023-01-25T04:42:16.762 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 49 v 18 (ObjNum 48 snap 0 seq_num 48) dirty exists 2023-01-25T04:42:16.763 INFO:tasks.rados.rados.0.smithi116.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2023-01-25T04:42:16.763 INFO:tasks.rados.rados.0.smithi116.stdout:50: finishing write tid 1 to smithi116107171-50 2023-01-25T04:42:16.763 INFO:tasks.rados.rados.0.smithi116.stdout:46: done (15 left) 2023-01-25T04:42:16.763 INFO:tasks.rados.rados.0.smithi116.stdout:47: done (14 left) 2023-01-25T04:42:16.763 INFO:tasks.rados.rados.0.smithi116.stdout:48: done (13 left) 2023-01-25T04:42:16.764 INFO:tasks.rados.rados.0.smithi116.stdout:49: done (12 left) 2023-01-25T04:42:16.764 INFO:tasks.rados.rados.0.smithi116.stdout:62: write initial oid 62 2023-01-25T04:42:16.764 INFO:tasks.rados.rados.0.smithi116.stdout:62: seq_num 61 ranges {625227=721013,1952931=704669} 2023-01-25T04:42:16.764 INFO:tasks.rados.rados.0.smithi116.stdout:62: writing smithi116107171-62 from 625227 to 1346240 tid 1 2023-01-25T04:42:16.768 INFO:tasks.rados.rados.0.smithi116.stdout:62: writing smithi116107171-62 from 1952931 to 2657600 tid 2 2023-01-25T04:42:16.768 INFO:tasks.rados.rados.0.smithi116.stdout:63: write initial oid 63 2023-01-25T04:42:16.768 INFO:tasks.rados.rados.0.smithi116.stdout:63: seq_num 62 ranges {642034=796262,1895060=564680} 2023-01-25T04:42:16.775 INFO:tasks.rados.rados.0.smithi116.stdout:63: writing smithi116107171-63 from 642034 to 1438296 tid 1 2023-01-25T04:42:16.781 INFO:tasks.rados.rados.0.smithi116.stdout:63: writing smithi116107171-63 from 1895060 to 2459740 tid 2 2023-01-25T04:42:16.782 INFO:tasks.rados.rados.0.smithi116.stdout:64: write initial oid 64 2023-01-25T04:42:16.782 INFO:tasks.rados.rados.0.smithi116.stdout:64: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2023-01-25T04:42:16.787 INFO:tasks.rados.rados.0.smithi116.stdout:64: writing smithi116107171-64 from 658841 to 1130352 tid 1 2023-01-25T04:42:16.793 INFO:tasks.rados.rados.0.smithi116.stdout:64: writing smithi116107171-64 from 1553542 to 2261880 tid 2 2023-01-25T04:42:16.798 INFO:tasks.rados.rados.0.smithi116.stdout:64: writing smithi116107171-64 from 2964119 to 3058841 tid 3 2023-01-25T04:42:16.798 INFO:tasks.rados.rados.0.smithi116.stdout:65: write initial oid 65 2023-01-25T04:42:16.798 INFO:tasks.rados.rados.0.smithi116.stdout:65: seq_num 64 ranges {675648=546760,2012024=568349} 2023-01-25T04:42:16.805 INFO:tasks.rados.rados.0.smithi116.stdout:65: writing smithi116107171-65 from 675648 to 1222408 tid 1 2023-01-25T04:42:16.813 INFO:tasks.rados.rados.0.smithi116.stdout:65: writing smithi116107171-65 from 2012024 to 2580373 tid 2 2023-01-25T04:42:16.814 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.814 INFO:tasks.rados.rados.0.smithi116.stdout:50: finishing write tid 2 to smithi116107171-50 2023-01-25T04:42:16.814 INFO:tasks.rados.rados.0.smithi116.stdout:50: finishing write tid 3 to smithi116107171-50 2023-01-25T04:42:16.814 INFO:tasks.rados.rados.0.smithi116.stdout:50: finishing write tid 4 to smithi116107171-50 2023-01-25T04:42:16.815 INFO:tasks.rados.rados.0.smithi116.stdout:50: oid 50 updating version 0 to 21 2023-01-25T04:42:16.815 INFO:tasks.rados.rados.0.smithi116.stdout:50: oid 50 updating version 21 to 22 2023-01-25T04:42:16.815 INFO:tasks.rados.rados.0.smithi116.stdout:50: oid 50 updating version 22 to 23 2023-01-25T04:42:16.815 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 50 v 23 (ObjNum 49 snap 0 seq_num 49) dirty exists 2023-01-25T04:42:16.815 INFO:tasks.rados.rados.0.smithi116.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2023-01-25T04:42:16.816 INFO:tasks.rados.rados.0.smithi116.stdout:51: finishing write tid 1 to smithi116107171-51 2023-01-25T04:42:16.816 INFO:tasks.rados.rados.0.smithi116.stdout:51: finishing write tid 2 to smithi116107171-51 2023-01-25T04:42:16.816 INFO:tasks.rados.rados.0.smithi116.stdout:51: finishing write tid 3 to smithi116107171-51 2023-01-25T04:42:16.816 INFO:tasks.rados.rados.0.smithi116.stdout:51: finishing write tid 4 to smithi116107171-51 2023-01-25T04:42:16.816 INFO:tasks.rados.rados.0.smithi116.stdout:51: finishing write tid 5 to smithi116107171-51 2023-01-25T04:42:16.817 INFO:tasks.rados.rados.0.smithi116.stdout:51: oid 51 updating version 0 to 19 2023-01-25T04:42:16.817 INFO:tasks.rados.rados.0.smithi116.stdout:51: oid 51 updating version 19 to 20 2023-01-25T04:42:16.817 INFO:tasks.rados.rados.0.smithi116.stdout:51: oid 51 updating version 20 to 21 2023-01-25T04:42:16.817 INFO:tasks.rados.rados.0.smithi116.stdout:51: oid 51 updating version 21 to 22 2023-01-25T04:42:16.817 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 51 v 22 (ObjNum 50 snap 0 seq_num 50) dirty exists 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:51: left oid 51 (ObjNum 50 snap 0 seq_num 50) 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:52: finishing write tid 1 to smithi116107171-52 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:52: finishing write tid 2 to smithi116107171-52 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:52: finishing write tid 3 to smithi116107171-52 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:52: finishing write tid 4 to smithi116107171-52 2023-01-25T04:42:16.818 INFO:tasks.rados.rados.0.smithi116.stdout:52: oid 52 updating version 0 to 15 2023-01-25T04:42:16.819 INFO:tasks.rados.rados.0.smithi116.stdout:52: oid 52 version 15 is already newer than 14 2023-01-25T04:42:16.819 INFO:tasks.rados.rados.0.smithi116.stdout:52: oid 52 updating version 15 to 16 2023-01-25T04:42:16.819 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 52 v 16 (ObjNum 51 snap 0 seq_num 51) dirty exists 2023-01-25T04:42:16.819 INFO:tasks.rados.rados.0.smithi116.stdout:52: left oid 52 (ObjNum 51 snap 0 seq_num 51) 2023-01-25T04:42:16.819 INFO:tasks.rados.rados.0.smithi116.stdout:53: finishing write tid 1 to smithi116107171-53 2023-01-25T04:42:16.820 INFO:tasks.rados.rados.0.smithi116.stdout:53: finishing write tid 2 to smithi116107171-53 2023-01-25T04:42:16.820 INFO:tasks.rados.rados.0.smithi116.stdout:53: finishing write tid 3 to smithi116107171-53 2023-01-25T04:42:16.820 INFO:tasks.rados.rados.0.smithi116.stdout:53: finishing write tid 4 to smithi116107171-53 2023-01-25T04:42:16.820 INFO:tasks.rados.rados.0.smithi116.stdout:53: finishing write tid 5 to smithi116107171-53 2023-01-25T04:42:16.820 INFO:tasks.rados.rados.0.smithi116.stdout:53: oid 53 updating version 0 to 24 2023-01-25T04:42:16.821 INFO:tasks.rados.rados.0.smithi116.stdout:53: oid 53 updating version 24 to 25 2023-01-25T04:42:16.821 INFO:tasks.rados.rados.0.smithi116.stdout:53: oid 53 updating version 25 to 26 2023-01-25T04:42:16.821 INFO:tasks.rados.rados.0.smithi116.stdout:53: oid 53 version 26 is already newer than 23 2023-01-25T04:42:16.821 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 53 v 26 (ObjNum 52 snap 0 seq_num 52) dirty exists 2023-01-25T04:42:16.821 INFO:tasks.rados.rados.0.smithi116.stdout:53: left oid 53 (ObjNum 52 snap 0 seq_num 52) 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:54: finishing write tid 1 to smithi116107171-54 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:54: finishing write tid 2 to smithi116107171-54 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:54: finishing write tid 3 to smithi116107171-54 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:50: done (15 left) 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:51: done (14 left) 2023-01-25T04:42:16.822 INFO:tasks.rados.rados.0.smithi116.stdout:52: done (13 left) 2023-01-25T04:42:16.823 INFO:tasks.rados.rados.0.smithi116.stdout:53: done (12 left) 2023-01-25T04:42:16.823 INFO:tasks.rados.rados.0.smithi116.stdout:66: write initial oid 66 2023-01-25T04:42:16.823 INFO:tasks.rados.rados.0.smithi116.stdout:66: seq_num 65 ranges {692455=622009,2070506=712007} 2023-01-25T04:42:16.823 INFO:tasks.rados.rados.0.smithi116.stdout:66: writing smithi116107171-66 from 692455 to 1314464 tid 1 2023-01-25T04:42:16.828 INFO:tasks.rados.rados.0.smithi116.stdout:66: writing smithi116107171-66 from 2070506 to 2782513 tid 2 2023-01-25T04:42:16.828 INFO:tasks.rados.rados.0.smithi116.stdout:67: write initial oid 67 2023-01-25T04:42:16.828 INFO:tasks.rados.rados.0.smithi116.stdout:67: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2023-01-25T04:42:16.835 INFO:tasks.rados.rados.0.smithi116.stdout:67: writing smithi116107171-67 from 709262 to 1406520 tid 1 2023-01-25T04:42:16.842 INFO:tasks.rados.rados.0.smithi116.stdout:67: writing smithi116107171-67 from 2012635 to 2584653 tid 2 2023-01-25T04:42:16.845 INFO:tasks.rados.rados.0.smithi116.stdout:67: writing smithi116107171-67 from 3046388 to 3109262 tid 3 2023-01-25T04:42:16.845 INFO:tasks.rados.rados.0.smithi116.stdout:68: write initial oid 68 2023-01-25T04:42:16.846 INFO:tasks.rados.rados.0.smithi116.stdout:68: seq_num 67 ranges {726069=772507,2071117=715676} 2023-01-25T04:42:16.852 INFO:tasks.rados.rados.0.smithi116.stdout:68: writing smithi116107171-68 from 726069 to 1498576 tid 1 2023-01-25T04:42:16.860 INFO:tasks.rados.rados.0.smithi116.stdout:68: writing smithi116107171-68 from 2071117 to 2786793 tid 2 2023-01-25T04:42:16.860 INFO:tasks.rados.rados.0.smithi116.stdout:69: write initial oid 69 2023-01-25T04:42:16.860 INFO:tasks.rados.rados.0.smithi116.stdout:69: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2023-01-25T04:42:16.866 INFO:tasks.rados.rados.0.smithi116.stdout:69: writing smithi116107171-69 from 742876 to 1190632 tid 1 2023-01-25T04:42:16.872 INFO:tasks.rados.rados.0.smithi116.stdout:69: writing smithi116107171-69 from 1729599 to 2305286 tid 2 2023-01-25T04:42:16.878 INFO:tasks.rados.rados.0.smithi116.stdout:69: writing smithi116107171-69 from 3101234 to 3142876 tid 3 2023-01-25T04:42:16.878 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.878 INFO:tasks.rados.rados.0.smithi116.stdout:54: finishing write tid 4 to smithi116107171-54 2023-01-25T04:42:16.879 INFO:tasks.rados.rados.0.smithi116.stdout:54: oid 54 updating version 0 to 16 2023-01-25T04:42:16.879 INFO:tasks.rados.rados.0.smithi116.stdout:54: oid 54 updating version 16 to 17 2023-01-25T04:42:16.879 INFO:tasks.rados.rados.0.smithi116.stdout:54: oid 54 updating version 17 to 18 2023-01-25T04:42:16.881 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 54 v 18 (ObjNum 53 snap 0 seq_num 53) dirty exists 2023-01-25T04:42:16.882 INFO:tasks.rados.rados.0.smithi116.stdout:54: left oid 54 (ObjNum 53 snap 0 seq_num 53) 2023-01-25T04:42:16.882 INFO:tasks.rados.rados.0.smithi116.stdout:55: finishing write tid 1 to smithi116107171-55 2023-01-25T04:42:16.882 INFO:tasks.rados.rados.0.smithi116.stdout:55: finishing write tid 2 to smithi116107171-55 2023-01-25T04:42:16.882 INFO:tasks.rados.rados.0.smithi116.stdout:55: finishing write tid 3 to smithi116107171-55 2023-01-25T04:42:16.883 INFO:tasks.rados.rados.0.smithi116.stdout:55: finishing write tid 4 to smithi116107171-55 2023-01-25T04:42:16.883 INFO:tasks.rados.rados.0.smithi116.stdout:55: finishing write tid 5 to smithi116107171-55 2023-01-25T04:42:16.883 INFO:tasks.rados.rados.0.smithi116.stdout:55: oid 55 updating version 0 to 27 2023-01-25T04:42:16.883 INFO:tasks.rados.rados.0.smithi116.stdout:55: oid 55 updating version 27 to 29 2023-01-25T04:42:16.883 INFO:tasks.rados.rados.0.smithi116.stdout:55: oid 55 updating version 29 to 30 2023-01-25T04:42:16.884 INFO:tasks.rados.rados.0.smithi116.stdout:55: oid 55 version 30 is already newer than 28 2023-01-25T04:42:16.884 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 55 v 30 (ObjNum 54 snap 0 seq_num 54) dirty exists 2023-01-25T04:42:16.884 INFO:tasks.rados.rados.0.smithi116.stdout:55: left oid 55 (ObjNum 54 snap 0 seq_num 54) 2023-01-25T04:42:16.884 INFO:tasks.rados.rados.0.smithi116.stdout:56: finishing write tid 1 to smithi116107171-56 2023-01-25T04:42:16.885 INFO:tasks.rados.rados.0.smithi116.stdout:54: done (15 left) 2023-01-25T04:42:16.885 INFO:tasks.rados.rados.0.smithi116.stdout:55: done (14 left) 2023-01-25T04:42:16.885 INFO:tasks.rados.rados.0.smithi116.stdout:70: write initial oid 70 2023-01-25T04:42:16.885 INFO:tasks.rados.rados.0.smithi116.stdout:70: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2023-01-25T04:42:16.886 INFO:tasks.rados.rados.0.smithi116.stdout:70: writing smithi116107171-70 from 759683 to 1399041 tid 1 2023-01-25T04:42:16.892 INFO:tasks.rados.rados.0.smithi116.stdout:70: writing smithi116107171-70 from 1904434 to 2623779 tid 2 2023-01-25T04:42:16.895 INFO:tasks.rados.rados.0.smithi116.stdout:70: writing smithi116107171-70 from 3128657 to 3159683 tid 3 2023-01-25T04:42:16.895 INFO:tasks.rados.rados.0.smithi116.stdout:71: write initial oid 71 2023-01-25T04:42:16.895 INFO:tasks.rados.rados.0.smithi116.stdout:71: seq_num 70 ranges {776490=714607,2246563=579356} 2023-01-25T04:42:16.903 INFO:tasks.rados.rados.0.smithi116.stdout:71: writing smithi116107171-71 from 776490 to 1491097 tid 1 2023-01-25T04:42:16.911 INFO:tasks.rados.rados.0.smithi116.stdout:71: writing smithi116107171-71 from 2246563 to 2825919 tid 2 2023-01-25T04:42:16.911 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.911 INFO:tasks.rados.rados.0.smithi116.stdout:56: finishing write tid 2 to smithi116107171-56 2023-01-25T04:42:16.911 INFO:tasks.rados.rados.0.smithi116.stdout:56: finishing write tid 3 to smithi116107171-56 2023-01-25T04:42:16.912 INFO:tasks.rados.rados.0.smithi116.stdout:56: finishing write tid 4 to smithi116107171-56 2023-01-25T04:42:16.912 INFO:tasks.rados.rados.0.smithi116.stdout:56: finishing write tid 5 to smithi116107171-56 2023-01-25T04:42:16.912 INFO:tasks.rados.rados.0.smithi116.stdout:56: oid 56 updating version 0 to 19 2023-01-25T04:42:16.912 INFO:tasks.rados.rados.0.smithi116.stdout:56: oid 56 updating version 19 to 21 2023-01-25T04:42:16.913 INFO:tasks.rados.rados.0.smithi116.stdout:56: oid 56 version 21 is already newer than 20 2023-01-25T04:42:16.913 INFO:tasks.rados.rados.0.smithi116.stdout:56: oid 56 updating version 21 to 22 2023-01-25T04:42:16.913 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 56 v 22 (ObjNum 55 snap 0 seq_num 55) dirty exists 2023-01-25T04:42:16.913 INFO:tasks.rados.rados.0.smithi116.stdout:56: left oid 56 (ObjNum 55 snap 0 seq_num 55) 2023-01-25T04:42:16.914 INFO:tasks.rados.rados.0.smithi116.stdout:57: finishing write tid 1 to smithi116107171-57 2023-01-25T04:42:16.914 INFO:tasks.rados.rados.0.smithi116.stdout:56: done (15 left) 2023-01-25T04:42:16.914 INFO:tasks.rados.rados.0.smithi116.stdout:72: write initial oid 72 2023-01-25T04:42:16.914 INFO:tasks.rados.rados.0.smithi116.stdout:72: seq_num 71 ranges {793297=789856,2305045=723014} 2023-01-25T04:42:16.919 INFO:tasks.rados.rados.0.smithi116.stdout:72: writing smithi116107171-72 from 793297 to 1583153 tid 1 2023-01-25T04:42:16.927 INFO:tasks.rados.rados.0.smithi116.stdout:72: writing smithi116107171-72 from 2305045 to 3028059 tid 2 2023-01-25T04:42:16.928 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.928 INFO:tasks.rados.rados.0.smithi116.stdout:57: finishing write tid 2 to smithi116107171-57 2023-01-25T04:42:16.928 INFO:tasks.rados.rados.0.smithi116.stdout:57: finishing write tid 3 to smithi116107171-57 2023-01-25T04:42:16.928 INFO:tasks.rados.rados.0.smithi116.stdout:57: finishing write tid 4 to smithi116107171-57 2023-01-25T04:42:16.929 INFO:tasks.rados.rados.0.smithi116.stdout:57: finishing write tid 5 to smithi116107171-57 2023-01-25T04:42:16.929 INFO:tasks.rados.rados.0.smithi116.stdout:57: oid 57 updating version 0 to 23 2023-01-25T04:42:16.929 INFO:tasks.rados.rados.0.smithi116.stdout:57: oid 57 updating version 23 to 25 2023-01-25T04:42:16.929 INFO:tasks.rados.rados.0.smithi116.stdout:57: oid 57 version 25 is already newer than 24 2023-01-25T04:42:16.929 INFO:tasks.rados.rados.0.smithi116.stdout:57: oid 57 updating version 25 to 26 2023-01-25T04:42:16.930 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 57 v 26 (ObjNum 56 snap 0 seq_num 56) dirty exists 2023-01-25T04:42:16.930 INFO:tasks.rados.rados.0.smithi116.stdout:57: left oid 57 (ObjNum 56 snap 0 seq_num 56) 2023-01-25T04:42:16.930 INFO:tasks.rados.rados.0.smithi116.stdout:58: finishing write tid 1 to smithi116107171-58 2023-01-25T04:42:16.930 INFO:tasks.rados.rados.0.smithi116.stdout:57: done (15 left) 2023-01-25T04:42:16.930 INFO:tasks.rados.rados.0.smithi116.stdout:73: write initial oid 73 2023-01-25T04:42:16.931 INFO:tasks.rados.rados.0.smithi116.stdout:73: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2023-01-25T04:42:16.932 INFO:tasks.rados.rados.0.smithi116.stdout:73: writing smithi116107171-73 from 410104 to 875209 tid 1 2023-01-25T04:42:16.939 INFO:tasks.rados.rados.0.smithi116.stdout:73: writing smithi116107171-73 from 1563527 to 2146552 tid 2 2023-01-25T04:42:16.946 INFO:tasks.rados.rados.0.smithi116.stdout:73: writing smithi116107171-73 from 2810926 to 3210104 tid 3 2023-01-25T04:42:16.946 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.946 INFO:tasks.rados.rados.0.smithi116.stdout:58: finishing write tid 2 to smithi116107171-58 2023-01-25T04:42:16.946 INFO:tasks.rados.rados.0.smithi116.stdout:58: finishing write tid 3 to smithi116107171-58 2023-01-25T04:42:16.947 INFO:tasks.rados.rados.0.smithi116.stdout:58: finishing write tid 4 to smithi116107171-58 2023-01-25T04:42:16.947 INFO:tasks.rados.rados.0.smithi116.stdout:58: finishing write tid 5 to smithi116107171-58 2023-01-25T04:42:16.947 INFO:tasks.rados.rados.0.smithi116.stdout:58: oid 58 updating version 0 to 28 2023-01-25T04:42:16.947 INFO:tasks.rados.rados.0.smithi116.stdout:58: oid 58 updating version 28 to 30 2023-01-25T04:42:16.947 INFO:tasks.rados.rados.0.smithi116.stdout:58: oid 58 version 30 is already newer than 27 2023-01-25T04:42:16.948 INFO:tasks.rados.rados.0.smithi116.stdout:58: oid 58 version 30 is already newer than 29 2023-01-25T04:42:16.948 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 58 v 30 (ObjNum 57 snap 0 seq_num 57) dirty exists 2023-01-25T04:42:16.948 INFO:tasks.rados.rados.0.smithi116.stdout:58: left oid 58 (ObjNum 57 snap 0 seq_num 57) 2023-01-25T04:42:16.948 INFO:tasks.rados.rados.0.smithi116.stdout:59: finishing write tid 1 to smithi116107171-59 2023-01-25T04:42:16.948 INFO:tasks.rados.rados.0.smithi116.stdout:59: finishing write tid 2 to smithi116107171-59 2023-01-25T04:42:16.949 INFO:tasks.rados.rados.0.smithi116.stdout:59: finishing write tid 3 to smithi116107171-59 2023-01-25T04:42:16.949 INFO:tasks.rados.rados.0.smithi116.stdout:59: finishing write tid 4 to smithi116107171-59 2023-01-25T04:42:16.949 INFO:tasks.rados.rados.0.smithi116.stdout:59: oid 59 updating version 0 to 32 2023-01-25T04:42:16.949 INFO:tasks.rados.rados.0.smithi116.stdout:59: oid 59 version 32 is already newer than 31 2023-01-25T04:42:16.949 INFO:tasks.rados.rados.0.smithi116.stdout:59: oid 59 updating version 32 to 33 2023-01-25T04:42:16.950 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 59 v 33 (ObjNum 58 snap 0 seq_num 58) dirty exists 2023-01-25T04:42:16.950 INFO:tasks.rados.rados.0.smithi116.stdout:59: left oid 59 (ObjNum 58 snap 0 seq_num 58) 2023-01-25T04:42:16.950 INFO:tasks.rados.rados.0.smithi116.stdout:60: finishing write tid 1 to smithi116107171-60 2023-01-25T04:42:16.950 INFO:tasks.rados.rados.0.smithi116.stdout:60: finishing write tid 2 to smithi116107171-60 2023-01-25T04:42:16.950 INFO:tasks.rados.rados.0.smithi116.stdout:60: finishing write tid 3 to smithi116107171-60 2023-01-25T04:42:16.951 INFO:tasks.rados.rados.0.smithi116.stdout:60: finishing write tid 4 to smithi116107171-60 2023-01-25T04:42:16.951 INFO:tasks.rados.rados.0.smithi116.stdout:58: done (15 left) 2023-01-25T04:42:16.951 INFO:tasks.rados.rados.0.smithi116.stdout:59: done (14 left) 2023-01-25T04:42:16.951 INFO:tasks.rados.rados.0.smithi116.stdout:74: write initial oid 74 2023-01-25T04:42:16.951 INFO:tasks.rados.rados.0.smithi116.stdout:74: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2023-01-25T04:42:16.952 INFO:tasks.rados.rados.0.smithi116.stdout:74: writing smithi116107171-74 from 426911 to 967265 tid 1 2023-01-25T04:42:16.958 INFO:tasks.rados.rados.0.smithi116.stdout:74: writing smithi116107171-74 from 1622009 to 2348692 tid 2 2023-01-25T04:42:16.963 INFO:tasks.rados.rados.0.smithi116.stdout:74: writing smithi116107171-74 from 3121996 to 3226911 tid 3 2023-01-25T04:42:16.963 INFO:tasks.rados.rados.0.smithi116.stdout:75: write initial oid 75 2023-01-25T04:42:16.963 INFO:tasks.rados.rados.0.smithi116.stdout:75: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2023-01-25T04:42:16.968 INFO:tasks.rados.rados.0.smithi116.stdout:75: writing smithi116107171-75 from 443718 to 1059321 tid 1 2023-01-25T04:42:16.974 INFO:tasks.rados.rados.0.smithi116.stdout:75: writing smithi116107171-75 from 1564138 to 2034479 tid 2 2023-01-25T04:42:16.981 INFO:tasks.rados.rados.0.smithi116.stdout:75: writing smithi116107171-75 from 2633066 to 3243718 tid 3 2023-01-25T04:42:16.981 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.981 INFO:tasks.rados.rados.0.smithi116.stdout:60: finishing write tid 5 to smithi116107171-60 2023-01-25T04:42:16.981 INFO:tasks.rados.rados.0.smithi116.stdout:60: oid 60 updating version 0 to 27 2023-01-25T04:42:16.982 INFO:tasks.rados.rados.0.smithi116.stdout:60: oid 60 version 27 is already newer than 26 2023-01-25T04:42:16.982 INFO:tasks.rados.rados.0.smithi116.stdout:60: oid 60 version 27 is already newer than 24 2023-01-25T04:42:16.982 INFO:tasks.rados.rados.0.smithi116.stdout:60: oid 60 version 27 is already newer than 25 2023-01-25T04:42:16.982 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 60 v 27 (ObjNum 59 snap 0 seq_num 59) dirty exists 2023-01-25T04:42:16.983 INFO:tasks.rados.rados.0.smithi116.stdout:60: left oid 60 (ObjNum 59 snap 0 seq_num 59) 2023-01-25T04:42:16.983 INFO:tasks.rados.rados.0.smithi116.stdout:61: finishing write tid 1 to smithi116107171-61 2023-01-25T04:42:16.983 INFO:tasks.rados.rados.0.smithi116.stdout:60: done (15 left) 2023-01-25T04:42:16.983 INFO:tasks.rados.rados.0.smithi116.stdout:76: write initial oid 76 2023-01-25T04:42:16.983 INFO:tasks.rados.rados.0.smithi116.stdout:76: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2023-01-25T04:42:16.987 INFO:tasks.rados.rados.0.smithi116.stdout:76: writing smithi116107171-76 from 460525 to 1151377 tid 1 2023-01-25T04:42:16.993 INFO:tasks.rados.rados.0.smithi116.stdout:76: writing smithi116107171-76 from 1622620 to 2352972 tid 2 2023-01-25T04:42:16.999 INFO:tasks.rados.rados.0.smithi116.stdout:76: writing smithi116107171-76 from 3060489 to 3260525 tid 3 2023-01-25T04:42:16.999 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:16.999 INFO:tasks.rados.rados.0.smithi116.stdout:61: finishing write tid 2 to smithi116107171-61 2023-01-25T04:42:16.999 INFO:tasks.rados.rados.0.smithi116.stdout:61: finishing write tid 3 to smithi116107171-61 2023-01-25T04:42:16.999 INFO:tasks.rados.rados.0.smithi116.stdout:61: finishing write tid 4 to smithi116107171-61 2023-01-25T04:42:17.000 INFO:tasks.rados.rados.0.smithi116.stdout:61: finishing write tid 5 to smithi116107171-61 2023-01-25T04:42:17.000 INFO:tasks.rados.rados.0.smithi116.stdout:61: oid 61 updating version 0 to 32 2023-01-25T04:42:17.000 INFO:tasks.rados.rados.0.smithi116.stdout:61: oid 61 updating version 32 to 34 2023-01-25T04:42:17.000 INFO:tasks.rados.rados.0.smithi116.stdout:61: oid 61 version 34 is already newer than 33 2023-01-25T04:42:17.001 INFO:tasks.rados.rados.0.smithi116.stdout:61: oid 61 version 34 is already newer than 31 2023-01-25T04:42:17.001 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 61 v 34 (ObjNum 60 snap 0 seq_num 60) dirty exists 2023-01-25T04:42:17.001 INFO:tasks.rados.rados.0.smithi116.stdout:61: left oid 61 (ObjNum 60 snap 0 seq_num 60) 2023-01-25T04:42:17.001 INFO:tasks.rados.rados.0.smithi116.stdout:62: finishing write tid 1 to smithi116107171-62 2023-01-25T04:42:17.001 INFO:tasks.rados.rados.0.smithi116.stdout:61: done (15 left) 2023-01-25T04:42:17.002 INFO:tasks.rados.rados.0.smithi116.stdout:77: write initial oid 77 2023-01-25T04:42:17.002 INFO:tasks.rados.rados.0.smithi116.stdout:77: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2023-01-25T04:42:17.005 INFO:tasks.rados.rados.0.smithi116.stdout:77: writing smithi116107171-77 from 477332 to 1243433 tid 1 2023-01-25T04:42:17.010 INFO:tasks.rados.rados.0.smithi116.stdout:77: writing smithi116107171-77 from 1681102 to 2155112 tid 2 2023-01-25T04:42:17.017 INFO:tasks.rados.rados.0.smithi116.stdout:77: writing smithi116107171-77 from 2687912 to 3277332 tid 3 2023-01-25T04:42:17.017 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.017 INFO:tasks.rados.rados.0.smithi116.stdout:62: finishing write tid 2 to smithi116107171-62 2023-01-25T04:42:17.017 INFO:tasks.rados.rados.0.smithi116.stdout:62: finishing write tid 3 to smithi116107171-62 2023-01-25T04:42:17.018 INFO:tasks.rados.rados.0.smithi116.stdout:62: finishing write tid 4 to smithi116107171-62 2023-01-25T04:42:17.018 INFO:tasks.rados.rados.0.smithi116.stdout:62: oid 62 updating version 0 to 19 2023-01-25T04:42:17.018 INFO:tasks.rados.rados.0.smithi116.stdout:62: oid 62 version 19 is already newer than 18 2023-01-25T04:42:17.018 INFO:tasks.rados.rados.0.smithi116.stdout:62: oid 62 version 19 is already newer than 17 2023-01-25T04:42:17.019 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 62 v 19 (ObjNum 61 snap 0 seq_num 61) dirty exists 2023-01-25T04:42:17.019 INFO:tasks.rados.rados.0.smithi116.stdout:62: left oid 62 (ObjNum 61 snap 0 seq_num 61) 2023-01-25T04:42:17.019 INFO:tasks.rados.rados.0.smithi116.stdout:63: finishing write tid 1 to smithi116107171-63 2023-01-25T04:42:17.019 INFO:tasks.rados.rados.0.smithi116.stdout:63: finishing write tid 2 to smithi116107171-63 2023-01-25T04:42:17.019 INFO:tasks.rados.rados.0.smithi116.stdout:62: done (15 left) 2023-01-25T04:42:17.020 INFO:tasks.rados.rados.0.smithi116.stdout:78: write initial oid 78 2023-01-25T04:42:17.020 INFO:tasks.rados.rados.0.smithi116.stdout:78: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2023-01-25T04:42:17.022 INFO:tasks.rados.rados.0.smithi116.stdout:78: writing smithi116107171-78 from 494139 to 1051842 tid 1 2023-01-25T04:42:17.028 INFO:tasks.rados.rados.0.smithi116.stdout:78: writing smithi116107171-78 from 1455937 to 2189958 tid 2 2023-01-25T04:42:17.035 INFO:tasks.rados.rados.0.smithi116.stdout:78: writing smithi116107171-78 from 2948041 to 3294139 tid 3 2023-01-25T04:42:17.035 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.035 INFO:tasks.rados.rados.0.smithi116.stdout:63: finishing write tid 3 to smithi116107171-63 2023-01-25T04:42:17.035 INFO:tasks.rados.rados.0.smithi116.stdout:63: finishing write tid 4 to smithi116107171-63 2023-01-25T04:42:17.036 INFO:tasks.rados.rados.0.smithi116.stdout:63: oid 63 updating version 0 to 35 2023-01-25T04:42:17.036 INFO:tasks.rados.rados.0.smithi116.stdout:63: oid 63 version 35 is already newer than 34 2023-01-25T04:42:17.036 INFO:tasks.rados.rados.0.smithi116.stdout:63: oid 63 updating version 35 to 36 2023-01-25T04:42:17.036 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 63 v 36 (ObjNum 62 snap 0 seq_num 62) dirty exists 2023-01-25T04:42:17.036 INFO:tasks.rados.rados.0.smithi116.stdout:63: left oid 63 (ObjNum 62 snap 0 seq_num 62) 2023-01-25T04:42:17.037 INFO:tasks.rados.rados.0.smithi116.stdout:64: finishing write tid 1 to smithi116107171-64 2023-01-25T04:42:17.037 INFO:tasks.rados.rados.0.smithi116.stdout:63: done (15 left) 2023-01-25T04:42:17.037 INFO:tasks.rados.rados.0.smithi116.stdout:79: write initial oid 79 2023-01-25T04:42:17.037 INFO:tasks.rados.rados.0.smithi116.stdout:79: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2023-01-25T04:42:17.041 INFO:tasks.rados.rados.0.smithi116.stdout:79: writing smithi116107171-79 from 510946 to 1143898 tid 1 2023-01-25T04:42:17.047 INFO:tasks.rados.rados.0.smithi116.stdout:79: writing smithi116107171-79 from 1798066 to 2275745 tid 2 2023-01-25T04:42:17.053 INFO:tasks.rados.rados.0.smithi116.stdout:79: writing smithi116107171-79 from 2742758 to 3199975 tid 3 2023-01-25T04:42:17.054 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.054 INFO:tasks.rados.rados.0.smithi116.stdout:64: finishing write tid 2 to smithi116107171-64 2023-01-25T04:42:17.054 INFO:tasks.rados.rados.0.smithi116.stdout:64: finishing write tid 3 to smithi116107171-64 2023-01-25T04:42:17.054 INFO:tasks.rados.rados.0.smithi116.stdout:64: finishing write tid 4 to smithi116107171-64 2023-01-25T04:42:17.054 INFO:tasks.rados.rados.0.smithi116.stdout:64: finishing write tid 5 to smithi116107171-64 2023-01-25T04:42:17.055 INFO:tasks.rados.rados.0.smithi116.stdout:64: oid 64 updating version 0 to 35 2023-01-25T04:42:17.055 INFO:tasks.rados.rados.0.smithi116.stdout:64: oid 64 updating version 35 to 37 2023-01-25T04:42:17.055 INFO:tasks.rados.rados.0.smithi116.stdout:64: oid 64 version 37 is already newer than 36 2023-01-25T04:42:17.055 INFO:tasks.rados.rados.0.smithi116.stdout:64: oid 64 updating version 37 to 38 2023-01-25T04:42:17.055 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 64 v 38 (ObjNum 63 snap 0 seq_num 63) dirty exists 2023-01-25T04:42:17.056 INFO:tasks.rados.rados.0.smithi116.stdout:64: left oid 64 (ObjNum 63 snap 0 seq_num 63) 2023-01-25T04:42:17.056 INFO:tasks.rados.rados.0.smithi116.stdout:65: finishing write tid 1 to smithi116107171-65 2023-01-25T04:42:17.056 INFO:tasks.rados.rados.0.smithi116.stdout:64: done (15 left) 2023-01-25T04:42:17.056 INFO:tasks.rados.rados.0.smithi116.stdout:80: write initial oid 80 2023-01-25T04:42:17.056 INFO:tasks.rados.rados.0.smithi116.stdout:80: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2023-01-25T04:42:17.059 INFO:tasks.rados.rados.0.smithi116.stdout:80: writing smithi116107171-80 from 527753 to 1235954 tid 1 2023-01-25T04:42:17.067 INFO:tasks.rados.rados.0.smithi116.stdout:80: writing smithi116107171-80 from 1856548 to 2594238 tid 2 2023-01-25T04:42:17.072 INFO:tasks.rados.rados.0.smithi116.stdout:80: writing smithi116107171-80 from 3286534 to 3327753 tid 3 2023-01-25T04:42:17.072 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: finishing write tid 2 to smithi116107171-65 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: finishing write tid 3 to smithi116107171-65 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: finishing write tid 4 to smithi116107171-65 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: oid 65 updating version 0 to 20 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: oid 65 updating version 20 to 21 2023-01-25T04:42:17.073 INFO:tasks.rados.rados.0.smithi116.stdout:65: oid 65 updating version 21 to 22 2023-01-25T04:42:17.074 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 65 v 22 (ObjNum 64 snap 0 seq_num 64) dirty exists 2023-01-25T04:42:17.074 INFO:tasks.rados.rados.0.smithi116.stdout:65: left oid 65 (ObjNum 64 snap 0 seq_num 64) 2023-01-25T04:42:17.074 INFO:tasks.rados.rados.0.smithi116.stdout:66: finishing write tid 1 to smithi116107171-66 2023-01-25T04:42:17.074 INFO:tasks.rados.rados.0.smithi116.stdout:66: finishing write tid 2 to smithi116107171-66 2023-01-25T04:42:17.074 INFO:tasks.rados.rados.0.smithi116.stdout:66: finishing write tid 3 to smithi116107171-66 2023-01-25T04:42:17.075 INFO:tasks.rados.rados.0.smithi116.stdout:66: finishing write tid 4 to smithi116107171-66 2023-01-25T04:42:17.075 INFO:tasks.rados.rados.0.smithi116.stdout:66: oid 66 updating version 0 to 25 2023-01-25T04:42:17.075 INFO:tasks.rados.rados.0.smithi116.stdout:66: oid 66 version 25 is already newer than 24 2023-01-25T04:42:17.075 INFO:tasks.rados.rados.0.smithi116.stdout:66: oid 66 version 25 is already newer than 23 2023-01-25T04:42:17.075 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 66 v 25 (ObjNum 65 snap 0 seq_num 65) dirty exists 2023-01-25T04:42:17.076 INFO:tasks.rados.rados.0.smithi116.stdout:66: left oid 66 (ObjNum 65 snap 0 seq_num 65) 2023-01-25T04:42:17.076 INFO:tasks.rados.rados.0.smithi116.stdout:67: finishing write tid 1 to smithi116107171-67 2023-01-25T04:42:17.076 INFO:tasks.rados.rados.0.smithi116.stdout:67: finishing write tid 2 to smithi116107171-67 2023-01-25T04:42:17.076 INFO:tasks.rados.rados.0.smithi116.stdout:67: finishing write tid 3 to smithi116107171-67 2023-01-25T04:42:17.076 INFO:tasks.rados.rados.0.smithi116.stdout:65: done (15 left) 2023-01-25T04:42:17.077 INFO:tasks.rados.rados.0.smithi116.stdout:66: done (14 left) 2023-01-25T04:42:17.077 INFO:tasks.rados.rados.0.smithi116.stdout:81: write initial oid 81 2023-01-25T04:42:17.077 INFO:tasks.rados.rados.0.smithi116.stdout:81: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2023-01-25T04:42:17.079 INFO:tasks.rados.rados.0.smithi116.stdout:81: writing smithi116107171-81 from 544560 to 1328010 tid 1 2023-01-25T04:42:17.085 INFO:tasks.rados.rados.0.smithi116.stdout:81: writing smithi116107171-81 from 1915030 to 2396378 tid 2 2023-01-25T04:42:17.090 INFO:tasks.rados.rados.0.smithi116.stdout:81: writing smithi116107171-81 from 2797604 to 3277365 tid 3 2023-01-25T04:42:17.090 INFO:tasks.rados.rados.0.smithi116.stdout:82: write initial oid 82 2023-01-25T04:42:17.090 INFO:tasks.rados.rados.0.smithi116.stdout:82: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2023-01-25T04:42:17.096 INFO:tasks.rados.rados.0.smithi116.stdout:82: writing smithi116107171-82 from 561367 to 1020066 tid 1 2023-01-25T04:42:17.103 INFO:tasks.rados.rados.0.smithi116.stdout:82: writing smithi116107171-82 from 1573512 to 2314871 tid 2 2023-01-25T04:42:17.112 INFO:tasks.rados.rados.0.smithi116.stdout:82: writing smithi116107171-82 from 2941380 to 3361367 tid 3 2023-01-25T04:42:17.113 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.113 INFO:tasks.rados.rados.0.smithi116.stdout:67: finishing write tid 4 to smithi116107171-67 2023-01-25T04:42:17.113 INFO:tasks.rados.rados.0.smithi116.stdout:67: finishing write tid 5 to smithi116107171-67 2023-01-25T04:42:17.113 INFO:tasks.rados.rados.0.smithi116.stdout:67: oid 67 updating version 0 to 28 2023-01-25T04:42:17.114 INFO:tasks.rados.rados.0.smithi116.stdout:67: oid 67 updating version 28 to 30 2023-01-25T04:42:17.114 INFO:tasks.rados.rados.0.smithi116.stdout:67: oid 67 updating version 30 to 31 2023-01-25T04:42:17.114 INFO:tasks.rados.rados.0.smithi116.stdout:67: oid 67 version 31 is already newer than 29 2023-01-25T04:42:17.114 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 67 v 31 (ObjNum 66 snap 0 seq_num 66) dirty exists 2023-01-25T04:42:17.114 INFO:tasks.rados.rados.0.smithi116.stdout:67: left oid 67 (ObjNum 66 snap 0 seq_num 66) 2023-01-25T04:42:17.115 INFO:tasks.rados.rados.0.smithi116.stdout:68: finishing write tid 1 to smithi116107171-68 2023-01-25T04:42:17.115 INFO:tasks.rados.rados.0.smithi116.stdout:68: finishing write tid 2 to smithi116107171-68 2023-01-25T04:42:17.115 INFO:tasks.rados.rados.0.smithi116.stdout:68: finishing write tid 3 to smithi116107171-68 2023-01-25T04:42:17.115 INFO:tasks.rados.rados.0.smithi116.stdout:68: finishing write tid 4 to smithi116107171-68 2023-01-25T04:42:17.115 INFO:tasks.rados.rados.0.smithi116.stdout:68: oid 68 updating version 0 to 28 2023-01-25T04:42:17.116 INFO:tasks.rados.rados.0.smithi116.stdout:68: oid 68 version 28 is already newer than 26 2023-01-25T04:42:17.116 INFO:tasks.rados.rados.0.smithi116.stdout:68: oid 68 version 28 is already newer than 27 2023-01-25T04:42:17.116 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 68 v 28 (ObjNum 67 snap 0 seq_num 67) dirty exists 2023-01-25T04:42:17.116 INFO:tasks.rados.rados.0.smithi116.stdout:68: left oid 68 (ObjNum 67 snap 0 seq_num 67) 2023-01-25T04:42:17.116 INFO:tasks.rados.rados.0.smithi116.stdout:69: finishing write tid 1 to smithi116107171-69 2023-01-25T04:42:17.117 INFO:tasks.rados.rados.0.smithi116.stdout:69: finishing write tid 2 to smithi116107171-69 2023-01-25T04:42:17.118 INFO:tasks.rados.rados.0.smithi116.stdout:69: finishing write tid 3 to smithi116107171-69 2023-01-25T04:42:17.118 INFO:tasks.rados.rados.0.smithi116.stdout:69: finishing write tid 4 to smithi116107171-69 2023-01-25T04:42:17.118 INFO:tasks.rados.rados.0.smithi116.stdout:69: finishing write tid 5 to smithi116107171-69 2023-01-25T04:42:17.118 INFO:tasks.rados.rados.0.smithi116.stdout:69: oid 69 updating version 0 to 39 2023-01-25T04:42:17.118 INFO:tasks.rados.rados.0.smithi116.stdout:69: oid 69 updating version 39 to 41 2023-01-25T04:42:17.119 INFO:tasks.rados.rados.0.smithi116.stdout:69: oid 69 version 41 is already newer than 40 2023-01-25T04:42:17.119 INFO:tasks.rados.rados.0.smithi116.stdout:69: oid 69 updating version 41 to 42 2023-01-25T04:42:17.119 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 69 v 42 (ObjNum 68 snap 0 seq_num 68) dirty exists 2023-01-25T04:42:17.119 INFO:tasks.rados.rados.0.smithi116.stdout:69: left oid 69 (ObjNum 68 snap 0 seq_num 68) 2023-01-25T04:42:17.119 INFO:tasks.rados.rados.0.smithi116.stdout:70: finishing write tid 1 to smithi116107171-70 2023-01-25T04:42:17.120 INFO:tasks.rados.rados.0.smithi116.stdout:70: finishing write tid 2 to smithi116107171-70 2023-01-25T04:42:17.120 INFO:tasks.rados.rados.0.smithi116.stdout:70: finishing write tid 3 to smithi116107171-70 2023-01-25T04:42:17.120 INFO:tasks.rados.rados.0.smithi116.stdout:70: finishing write tid 4 to smithi116107171-70 2023-01-25T04:42:17.120 INFO:tasks.rados.rados.0.smithi116.stdout:70: finishing write tid 5 to smithi116107171-70 2023-01-25T04:42:17.120 INFO:tasks.rados.rados.0.smithi116.stdout:70: oid 70 updating version 0 to 46 2023-01-25T04:42:17.121 INFO:tasks.rados.rados.0.smithi116.stdout:70: oid 70 version 46 is already newer than 44 2023-01-25T04:42:17.121 INFO:tasks.rados.rados.0.smithi116.stdout:70: oid 70 version 46 is already newer than 43 2023-01-25T04:42:17.121 INFO:tasks.rados.rados.0.smithi116.stdout:70: oid 70 version 46 is already newer than 45 2023-01-25T04:42:17.121 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 70 v 46 (ObjNum 69 snap 0 seq_num 69) dirty exists 2023-01-25T04:42:17.121 INFO:tasks.rados.rados.0.smithi116.stdout:70: left oid 70 (ObjNum 69 snap 0 seq_num 69) 2023-01-25T04:42:17.122 INFO:tasks.rados.rados.0.smithi116.stdout:71: finishing write tid 1 to smithi116107171-71 2023-01-25T04:42:17.122 INFO:tasks.rados.rados.0.smithi116.stdout:71: finishing write tid 2 to smithi116107171-71 2023-01-25T04:42:17.122 INFO:tasks.rados.rados.0.smithi116.stdout:71: finishing write tid 3 to smithi116107171-71 2023-01-25T04:42:17.122 INFO:tasks.rados.rados.0.smithi116.stdout:67: done (15 left) 2023-01-25T04:42:17.122 INFO:tasks.rados.rados.0.smithi116.stdout:68: done (14 left) 2023-01-25T04:42:17.123 INFO:tasks.rados.rados.0.smithi116.stdout:69: done (13 left) 2023-01-25T04:42:17.123 INFO:tasks.rados.rados.0.smithi116.stdout:70: done (12 left) 2023-01-25T04:42:17.123 INFO:tasks.rados.rados.0.smithi116.stdout:83: write initial oid 83 2023-01-25T04:42:17.123 INFO:tasks.rados.rados.0.smithi116.stdout:83: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2023-01-25T04:42:17.124 INFO:tasks.rados.rados.0.smithi116.stdout:83: writing smithi116107171-83 from 578174 to 1112122 tid 1 2023-01-25T04:42:17.124 INFO:tasks.rados.rados.0.smithi116.stdout:83: writing smithi116107171-83 from 1515641 to 2000658 tid 2 2023-01-25T04:42:17.127 INFO:tasks.rados.rados.0.smithi116.stdout:83: writing smithi116107171-83 from 2736097 to 3238402 tid 3 2023-01-25T04:42:17.127 INFO:tasks.rados.rados.0.smithi116.stdout:84: write initial oid 84 2023-01-25T04:42:17.127 INFO:tasks.rados.rados.0.smithi116.stdout:84: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2023-01-25T04:42:17.135 INFO:tasks.rados.rados.0.smithi116.stdout:84: writing smithi116107171-84 from 594981 to 1204178 tid 1 2023-01-25T04:42:17.141 INFO:tasks.rados.rados.0.smithi116.stdout:84: writing smithi116107171-84 from 1974123 to 2719151 tid 2 2023-01-25T04:42:17.146 INFO:tasks.rados.rados.0.smithi116.stdout:84: writing smithi116107171-84 from 3279873 to 3394981 tid 3 2023-01-25T04:42:17.146 INFO:tasks.rados.rados.0.smithi116.stdout:85: write initial oid 85 2023-01-25T04:42:17.147 INFO:tasks.rados.rados.0.smithi116.stdout:85: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2023-01-25T04:42:17.150 INFO:tasks.rados.rados.0.smithi116.stdout:85: writing smithi116107171-85 from 611788 to 1012587 tid 1 2023-01-25T04:42:17.157 INFO:tasks.rados.rados.0.smithi116.stdout:85: writing smithi116107171-85 from 1748958 to 2237644 tid 2 2023-01-25T04:42:17.164 INFO:tasks.rados.rados.0.smithi116.stdout:85: writing smithi116107171-85 from 2907296 to 3411788 tid 3 2023-01-25T04:42:17.164 INFO:tasks.rados.rados.0.smithi116.stdout:86: write initial oid 86 2023-01-25T04:42:17.164 INFO:tasks.rados.rados.0.smithi116.stdout:86: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2023-01-25T04:42:17.170 INFO:tasks.rados.rados.0.smithi116.stdout:86: writing smithi116107171-86 from 628595 to 1104643 tid 1 2023-01-25T04:42:17.177 INFO:tasks.rados.rados.0.smithi116.stdout:86: writing smithi116107171-86 from 1807440 to 2439784 tid 2 2023-01-25T04:42:17.184 INFO:tasks.rados.rados.0.smithi116.stdout:86: writing smithi116107171-86 from 2934719 to 3387193 tid 3 2023-01-25T04:42:17.184 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.184 INFO:tasks.rados.rados.0.smithi116.stdout:71: finishing write tid 4 to smithi116107171-71 2023-01-25T04:42:17.184 INFO:tasks.rados.rados.0.smithi116.stdout:71: oid 71 updating version 0 to 29 2023-01-25T04:42:17.184 INFO:tasks.rados.rados.0.smithi116.stdout:71: oid 71 updating version 29 to 31 2023-01-25T04:42:17.185 INFO:tasks.rados.rados.0.smithi116.stdout:71: oid 71 version 31 is already newer than 30 2023-01-25T04:42:17.185 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 71 v 31 (ObjNum 70 snap 0 seq_num 70) dirty exists 2023-01-25T04:42:17.185 INFO:tasks.rados.rados.0.smithi116.stdout:71: left oid 71 (ObjNum 70 snap 0 seq_num 70) 2023-01-25T04:42:17.185 INFO:tasks.rados.rados.0.smithi116.stdout:72: finishing write tid 1 to smithi116107171-72 2023-01-25T04:42:17.185 INFO:tasks.rados.rados.0.smithi116.stdout:71: done (15 left) 2023-01-25T04:42:17.186 INFO:tasks.rados.rados.0.smithi116.stdout:87: write initial oid 87 2023-01-25T04:42:17.186 INFO:tasks.rados.rados.0.smithi116.stdout:87: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2023-01-25T04:42:17.189 INFO:tasks.rados.rados.0.smithi116.stdout:87: writing smithi116107171-87 from 645402 to 1196699 tid 1 2023-01-25T04:42:17.195 INFO:tasks.rados.rados.0.smithi116.stdout:87: writing smithi116107171-87 from 1749569 to 2241924 tid 2 2023-01-25T04:42:17.202 INFO:tasks.rados.rados.0.smithi116.stdout:87: writing smithi116107171-87 from 2845789 to 3445402 tid 3 2023-01-25T04:42:17.203 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.203 INFO:tasks.rados.rados.0.smithi116.stdout:72: finishing write tid 2 to smithi116107171-72 2023-01-25T04:42:17.203 INFO:tasks.rados.rados.0.smithi116.stdout:72: finishing write tid 3 to smithi116107171-72 2023-01-25T04:42:17.204 INFO:tasks.rados.rados.0.smithi116.stdout:72: finishing write tid 4 to smithi116107171-72 2023-01-25T04:42:17.204 INFO:tasks.rados.rados.0.smithi116.stdout:72: oid 72 updating version 0 to 37 2023-01-25T04:42:17.204 INFO:tasks.rados.rados.0.smithi116.stdout:72: oid 72 updating version 37 to 39 2023-01-25T04:42:17.204 INFO:tasks.rados.rados.0.smithi116.stdout:72: oid 72 version 39 is already newer than 38 2023-01-25T04:42:17.205 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 72 v 39 (ObjNum 71 snap 0 seq_num 71) dirty exists 2023-01-25T04:42:17.205 INFO:tasks.rados.rados.0.smithi116.stdout:72: left oid 72 (ObjNum 71 snap 0 seq_num 71) 2023-01-25T04:42:17.205 INFO:tasks.rados.rados.0.smithi116.stdout:73: finishing write tid 1 to smithi116107171-73 2023-01-25T04:42:17.205 INFO:tasks.rados.rados.0.smithi116.stdout:72: done (15 left) 2023-01-25T04:42:17.206 INFO:tasks.rados.rados.0.smithi116.stdout:88: write initial oid 88 2023-01-25T04:42:17.206 INFO:tasks.rados.rados.0.smithi116.stdout:88: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2023-01-25T04:42:17.209 INFO:tasks.rados.rados.0.smithi116.stdout:88: writing smithi116107171-88 from 662209 to 1288755 tid 1 2023-01-25T04:42:17.215 INFO:tasks.rados.rados.0.smithi116.stdout:88: writing smithi116107171-88 from 1808051 to 2444064 tid 2 2023-01-25T04:42:17.221 INFO:tasks.rados.rados.0.smithi116.stdout:88: writing smithi116107171-88 from 2873212 to 3462209 tid 3 2023-01-25T04:42:17.222 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.222 INFO:tasks.rados.rados.0.smithi116.stdout:73: finishing write tid 2 to smithi116107171-73 2023-01-25T04:42:17.222 INFO:tasks.rados.rados.0.smithi116.stdout:73: finishing write tid 3 to smithi116107171-73 2023-01-25T04:42:17.222 INFO:tasks.rados.rados.0.smithi116.stdout:73: finishing write tid 4 to smithi116107171-73 2023-01-25T04:42:17.222 INFO:tasks.rados.rados.0.smithi116.stdout:73: finishing write tid 5 to smithi116107171-73 2023-01-25T04:42:17.223 INFO:tasks.rados.rados.0.smithi116.stdout:73: oid 73 updating version 0 to 35 2023-01-25T04:42:17.223 INFO:tasks.rados.rados.0.smithi116.stdout:73: oid 73 version 35 is already newer than 33 2023-01-25T04:42:17.223 INFO:tasks.rados.rados.0.smithi116.stdout:73: oid 73 version 35 is already newer than 34 2023-01-25T04:42:17.223 INFO:tasks.rados.rados.0.smithi116.stdout:73: oid 73 version 35 is already newer than 32 2023-01-25T04:42:17.223 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 73 v 35 (ObjNum 72 snap 0 seq_num 72) dirty exists 2023-01-25T04:42:17.224 INFO:tasks.rados.rados.0.smithi116.stdout:73: left oid 73 (ObjNum 72 snap 0 seq_num 72) 2023-01-25T04:42:17.224 INFO:tasks.rados.rados.0.smithi116.stdout:74: finishing write tid 1 to smithi116107171-74 2023-01-25T04:42:17.224 INFO:tasks.rados.rados.0.smithi116.stdout:73: done (15 left) 2023-01-25T04:42:17.224 INFO:tasks.rados.rados.0.smithi116.stdout:89: write initial oid 89 2023-01-25T04:42:17.224 INFO:tasks.rados.rados.0.smithi116.stdout:89: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2023-01-25T04:42:17.229 INFO:tasks.rados.rados.0.smithi116.stdout:89: writing smithi116107171-89 from 679016 to 1380811 tid 1 2023-01-25T04:42:17.234 INFO:tasks.rados.rados.0.smithi116.stdout:89: writing smithi116107171-89 from 1866533 to 2362557 tid 2 2023-01-25T04:42:17.241 INFO:tasks.rados.rados.0.smithi116.stdout:89: writing smithi116107171-89 from 2900635 to 3303278 tid 3 2023-01-25T04:42:17.242 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.242 INFO:tasks.rados.rados.0.smithi116.stdout:74: finishing write tid 2 to smithi116107171-74 2023-01-25T04:42:17.242 INFO:tasks.rados.rados.0.smithi116.stdout:74: finishing write tid 3 to smithi116107171-74 2023-01-25T04:42:17.242 INFO:tasks.rados.rados.0.smithi116.stdout:74: finishing write tid 4 to smithi116107171-74 2023-01-25T04:42:17.242 INFO:tasks.rados.rados.0.smithi116.stdout:74: finishing write tid 5 to smithi116107171-74 2023-01-25T04:42:17.243 INFO:tasks.rados.rados.0.smithi116.stdout:74: oid 74 updating version 0 to 37 2023-01-25T04:42:17.243 INFO:tasks.rados.rados.0.smithi116.stdout:74: oid 74 updating version 37 to 38 2023-01-25T04:42:17.243 INFO:tasks.rados.rados.0.smithi116.stdout:74: oid 74 version 38 is already newer than 36 2023-01-25T04:42:17.243 INFO:tasks.rados.rados.0.smithi116.stdout:74: oid 74 updating version 38 to 39 2023-01-25T04:42:17.243 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 74 v 39 (ObjNum 73 snap 0 seq_num 73) dirty exists 2023-01-25T04:42:17.244 INFO:tasks.rados.rados.0.smithi116.stdout:74: left oid 74 (ObjNum 73 snap 0 seq_num 73) 2023-01-25T04:42:17.244 INFO:tasks.rados.rados.0.smithi116.stdout:75: finishing write tid 1 to smithi116107171-75 2023-01-25T04:42:17.244 INFO:tasks.rados.rados.0.smithi116.stdout:75: finishing write tid 2 to smithi116107171-75 2023-01-25T04:42:17.244 INFO:tasks.rados.rados.0.smithi116.stdout:75: finishing write tid 3 to smithi116107171-75 2023-01-25T04:42:17.244 INFO:tasks.rados.rados.0.smithi116.stdout:75: finishing write tid 4 to smithi116107171-75 2023-01-25T04:42:17.245 INFO:tasks.rados.rados.0.smithi116.stdout:75: finishing write tid 5 to smithi116107171-75 2023-01-25T04:42:17.245 INFO:tasks.rados.rados.0.smithi116.stdout:75: oid 75 updating version 0 to 40 2023-01-25T04:42:17.245 INFO:tasks.rados.rados.0.smithi116.stdout:75: oid 75 updating version 40 to 42 2023-01-25T04:42:17.245 INFO:tasks.rados.rados.0.smithi116.stdout:75: oid 75 version 42 is already newer than 41 2023-01-25T04:42:17.245 INFO:tasks.rados.rados.0.smithi116.stdout:75: oid 75 updating version 42 to 43 2023-01-25T04:42:17.246 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 75 v 43 (ObjNum 74 snap 0 seq_num 74) dirty exists 2023-01-25T04:42:17.246 INFO:tasks.rados.rados.0.smithi116.stdout:75: left oid 75 (ObjNum 74 snap 0 seq_num 74) 2023-01-25T04:42:17.246 INFO:tasks.rados.rados.0.smithi116.stdout:76: finishing write tid 1 to smithi116107171-76 2023-01-25T04:42:17.246 INFO:tasks.rados.rados.0.smithi116.stdout:76: finishing write tid 2 to smithi116107171-76 2023-01-25T04:42:17.246 INFO:tasks.rados.rados.0.smithi116.stdout:76: finishing write tid 3 to smithi116107171-76 2023-01-25T04:42:17.247 INFO:tasks.rados.rados.0.smithi116.stdout:76: finishing write tid 4 to smithi116107171-76 2023-01-25T04:42:17.247 INFO:tasks.rados.rados.0.smithi116.stdout:76: finishing write tid 5 to smithi116107171-76 2023-01-25T04:42:17.249 INFO:tasks.rados.rados.0.smithi116.stdout:76: oid 76 updating version 0 to 32 2023-01-25T04:42:17.249 INFO:tasks.rados.rados.0.smithi116.stdout:76: oid 76 updating version 32 to 34 2023-01-25T04:42:17.249 INFO:tasks.rados.rados.0.smithi116.stdout:76: oid 76 updating version 34 to 35 2023-01-25T04:42:17.249 INFO:tasks.rados.rados.0.smithi116.stdout:76: oid 76 version 35 is already newer than 33 2023-01-25T04:42:17.249 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 76 v 35 (ObjNum 75 snap 0 seq_num 75) dirty exists 2023-01-25T04:42:17.250 INFO:tasks.rados.rados.0.smithi116.stdout:76: left oid 76 (ObjNum 75 snap 0 seq_num 75) 2023-01-25T04:42:17.250 INFO:tasks.rados.rados.0.smithi116.stdout:77: finishing write tid 1 to smithi116107171-77 2023-01-25T04:42:17.250 INFO:tasks.rados.rados.0.smithi116.stdout:77: finishing write tid 2 to smithi116107171-77 2023-01-25T04:42:17.250 INFO:tasks.rados.rados.0.smithi116.stdout:77: finishing write tid 3 to smithi116107171-77 2023-01-25T04:42:17.250 INFO:tasks.rados.rados.0.smithi116.stdout:77: finishing write tid 4 to smithi116107171-77 2023-01-25T04:42:17.251 INFO:tasks.rados.rados.0.smithi116.stdout:77: finishing write tid 5 to smithi116107171-77 2023-01-25T04:42:17.251 INFO:tasks.rados.rados.0.smithi116.stdout:77: oid 77 updating version 0 to 47 2023-01-25T04:42:17.251 INFO:tasks.rados.rados.0.smithi116.stdout:77: oid 77 version 47 is already newer than 45 2023-01-25T04:42:17.251 INFO:tasks.rados.rados.0.smithi116.stdout:77: oid 77 version 47 is already newer than 46 2023-01-25T04:42:17.251 INFO:tasks.rados.rados.0.smithi116.stdout:77: oid 77 version 47 is already newer than 44 2023-01-25T04:42:17.252 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 77 v 47 (ObjNum 76 snap 0 seq_num 76) dirty exists 2023-01-25T04:42:17.252 INFO:tasks.rados.rados.0.smithi116.stdout:77: left oid 77 (ObjNum 76 snap 0 seq_num 76) 2023-01-25T04:42:17.252 INFO:tasks.rados.rados.0.smithi116.stdout:78: finishing write tid 1 to smithi116107171-78 2023-01-25T04:42:17.252 INFO:tasks.rados.rados.0.smithi116.stdout:78: finishing write tid 2 to smithi116107171-78 2023-01-25T04:42:17.252 INFO:tasks.rados.rados.0.smithi116.stdout:78: finishing write tid 3 to smithi116107171-78 2023-01-25T04:42:17.253 INFO:tasks.rados.rados.0.smithi116.stdout:78: finishing write tid 4 to smithi116107171-78 2023-01-25T04:42:17.253 INFO:tasks.rados.rados.0.smithi116.stdout:78: finishing write tid 5 to smithi116107171-78 2023-01-25T04:42:17.253 INFO:tasks.rados.rados.0.smithi116.stdout:78: oid 78 updating version 0 to 49 2023-01-25T04:42:17.253 INFO:tasks.rados.rados.0.smithi116.stdout:78: oid 78 updating version 49 to 51 2023-01-25T04:42:17.253 INFO:tasks.rados.rados.0.smithi116.stdout:78: oid 78 version 51 is already newer than 48 2023-01-25T04:42:17.254 INFO:tasks.rados.rados.0.smithi116.stdout:78: oid 78 version 51 is already newer than 50 2023-01-25T04:42:17.254 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 78 v 51 (ObjNum 77 snap 0 seq_num 77) dirty exists 2023-01-25T04:42:17.254 INFO:tasks.rados.rados.0.smithi116.stdout:78: left oid 78 (ObjNum 77 snap 0 seq_num 77) 2023-01-25T04:42:17.254 INFO:tasks.rados.rados.0.smithi116.stdout:79: finishing write tid 1 to smithi116107171-79 2023-01-25T04:42:17.254 INFO:tasks.rados.rados.0.smithi116.stdout:79: finishing write tid 2 to smithi116107171-79 2023-01-25T04:42:17.255 INFO:tasks.rados.rados.0.smithi116.stdout:79: finishing write tid 3 to smithi116107171-79 2023-01-25T04:42:17.255 INFO:tasks.rados.rados.0.smithi116.stdout:79: finishing write tid 4 to smithi116107171-79 2023-01-25T04:42:17.255 INFO:tasks.rados.rados.0.smithi116.stdout:79: finishing write tid 5 to smithi116107171-79 2023-01-25T04:42:17.255 INFO:tasks.rados.rados.0.smithi116.stdout:79: oid 79 updating version 0 to 55 2023-01-25T04:42:17.255 INFO:tasks.rados.rados.0.smithi116.stdout:79: oid 79 version 55 is already newer than 53 2023-01-25T04:42:17.256 INFO:tasks.rados.rados.0.smithi116.stdout:79: oid 79 version 55 is already newer than 52 2023-01-25T04:42:17.256 INFO:tasks.rados.rados.0.smithi116.stdout:79: oid 79 version 55 is already newer than 54 2023-01-25T04:42:17.256 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 79 v 55 (ObjNum 78 snap 0 seq_num 78) dirty exists 2023-01-25T04:42:17.256 INFO:tasks.rados.rados.0.smithi116.stdout:79: left oid 79 (ObjNum 78 snap 0 seq_num 78) 2023-01-25T04:42:17.256 INFO:tasks.rados.rados.0.smithi116.stdout:80: finishing write tid 1 to smithi116107171-80 2023-01-25T04:42:17.257 INFO:tasks.rados.rados.0.smithi116.stdout:80: finishing write tid 2 to smithi116107171-80 2023-01-25T04:42:17.257 INFO:tasks.rados.rados.0.smithi116.stdout:80: finishing write tid 3 to smithi116107171-80 2023-01-25T04:42:17.257 INFO:tasks.rados.rados.0.smithi116.stdout:80: finishing write tid 4 to smithi116107171-80 2023-01-25T04:42:17.257 INFO:tasks.rados.rados.0.smithi116.stdout:80: finishing write tid 5 to smithi116107171-80 2023-01-25T04:42:17.257 INFO:tasks.rados.rados.0.smithi116.stdout:80: oid 80 updating version 0 to 50 2023-01-25T04:42:17.258 INFO:tasks.rados.rados.0.smithi116.stdout:80: oid 80 version 50 is already newer than 49 2023-01-25T04:42:17.258 INFO:tasks.rados.rados.0.smithi116.stdout:80: oid 80 version 50 is already newer than 47 2023-01-25T04:42:17.258 INFO:tasks.rados.rados.0.smithi116.stdout:80: oid 80 version 50 is already newer than 48 2023-01-25T04:42:17.258 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 80 v 50 (ObjNum 79 snap 0 seq_num 79) dirty exists 2023-01-25T04:42:17.258 INFO:tasks.rados.rados.0.smithi116.stdout:80: left oid 80 (ObjNum 79 snap 0 seq_num 79) 2023-01-25T04:42:17.259 INFO:tasks.rados.rados.0.smithi116.stdout:81: finishing write tid 1 to smithi116107171-81 2023-01-25T04:42:17.259 INFO:tasks.rados.rados.0.smithi116.stdout:81: finishing write tid 2 to smithi116107171-81 2023-01-25T04:42:17.259 INFO:tasks.rados.rados.0.smithi116.stdout:81: finishing write tid 3 to smithi116107171-81 2023-01-25T04:42:17.259 INFO:tasks.rados.rados.0.smithi116.stdout:81: finishing write tid 4 to smithi116107171-81 2023-01-25T04:42:17.259 INFO:tasks.rados.rados.0.smithi116.stdout:81: finishing write tid 5 to smithi116107171-81 2023-01-25T04:42:17.260 INFO:tasks.rados.rados.0.smithi116.stdout:81: oid 81 updating version 0 to 52 2023-01-25T04:42:17.260 INFO:tasks.rados.rados.0.smithi116.stdout:81: oid 81 version 52 is already newer than 51 2023-01-25T04:42:17.260 INFO:tasks.rados.rados.0.smithi116.stdout:81: oid 81 version 52 is already newer than 49 2023-01-25T04:42:17.260 INFO:tasks.rados.rados.0.smithi116.stdout:81: oid 81 updating version 52 to 53 2023-01-25T04:42:17.261 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 81 v 53 (ObjNum 80 snap 0 seq_num 80) dirty exists 2023-01-25T04:42:17.261 INFO:tasks.rados.rados.0.smithi116.stdout:81: left oid 81 (ObjNum 80 snap 0 seq_num 80) 2023-01-25T04:42:17.261 INFO:tasks.rados.rados.0.smithi116.stdout:82: finishing write tid 1 to smithi116107171-82 2023-01-25T04:42:17.261 INFO:tasks.rados.rados.0.smithi116.stdout:74: done (15 left) 2023-01-25T04:42:17.261 INFO:tasks.rados.rados.0.smithi116.stdout:75: done (14 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:76: done (13 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:77: done (12 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:78: done (11 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:79: done (10 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:80: done (9 left) 2023-01-25T04:42:17.262 INFO:tasks.rados.rados.0.smithi116.stdout:81: done (8 left) 2023-01-25T04:42:17.263 INFO:tasks.rados.rados.0.smithi116.stdout:90: write initial oid 90 2023-01-25T04:42:17.263 INFO:tasks.rados.rados.0.smithi116.stdout:90: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2023-01-25T04:42:17.264 INFO:tasks.rados.rados.0.smithi116.stdout:90: writing smithi116107171-90 from 695823 to 1472867 tid 1 2023-01-25T04:42:17.264 INFO:tasks.rados.rados.0.smithi116.stdout:90: writing smithi116107171-90 from 1925015 to 2564697 tid 2 2023-01-25T04:42:17.264 INFO:tasks.rados.rados.0.smithi116.stdout:90: writing smithi116107171-90 from 3328058 to 3495823 tid 3 2023-01-25T04:42:17.264 INFO:tasks.rados.rados.0.smithi116.stdout:91: write initial oid 91 2023-01-25T04:42:17.265 INFO:tasks.rados.rados.0.smithi116.stdout:91: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2023-01-25T04:42:17.266 INFO:tasks.rados.rados.0.smithi116.stdout:91: writing smithi116107171-91 from 712630 to 1164923 tid 1 2023-01-25T04:42:17.271 INFO:tasks.rados.rados.0.smithi116.stdout:91: writing smithi116107171-91 from 1583497 to 2083190 tid 2 2023-01-25T04:42:17.276 INFO:tasks.rados.rados.0.smithi116.stdout:91: writing smithi116107171-91 from 2555481 to 2980668 tid 3 2023-01-25T04:42:17.276 INFO:tasks.rados.rados.0.smithi116.stdout:92: write initial oid 92 2023-01-25T04:42:17.276 INFO:tasks.rados.rados.0.smithi116.stdout:92: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2023-01-25T04:42:17.282 INFO:tasks.rados.rados.0.smithi116.stdout:92: writing smithi116107171-92 from 729437 to 1256979 tid 1 2023-01-25T04:42:17.290 INFO:tasks.rados.rados.0.smithi116.stdout:92: writing smithi116107171-92 from 1925626 to 2568977 tid 2 2023-01-25T04:42:17.295 INFO:tasks.rados.rados.0.smithi116.stdout:92: writing smithi116107171-92 from 3266551 to 3529437 tid 3 2023-01-25T04:42:17.295 INFO:tasks.rados.rados.0.smithi116.stdout:93: write initial oid 93 2023-01-25T04:42:17.295 INFO:tasks.rados.rados.0.smithi116.stdout:93: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2023-01-25T04:42:17.303 INFO:tasks.rados.rados.0.smithi116.stdout:93: writing smithi116107171-93 from 746244 to 1465388 tid 1 2023-01-25T04:42:17.309 INFO:tasks.rados.rados.0.smithi116.stdout:93: writing smithi116107171-93 from 2100461 to 2603823 tid 2 2023-01-25T04:42:17.315 INFO:tasks.rados.rados.0.smithi116.stdout:93: writing smithi116107171-93 from 3126680 to 3546244 tid 3 2023-01-25T04:42:17.315 INFO:tasks.rados.rados.0.smithi116.stdout:94: write initial oid 94 2023-01-25T04:42:17.315 INFO:tasks.rados.rados.0.smithi116.stdout:94: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2023-01-25T04:42:17.324 INFO:tasks.rados.rados.0.smithi116.stdout:94: writing smithi116107171-94 from 763051 to 1557444 tid 1 2023-01-25T04:42:17.330 INFO:tasks.rados.rados.0.smithi116.stdout:94: writing smithi116107171-94 from 2158943 to 2805963 tid 2 2023-01-25T04:42:17.334 INFO:tasks.rados.rados.0.smithi116.stdout:94: writing smithi116107171-94 from 3437750 to 3563051 tid 3 2023-01-25T04:42:17.335 INFO:tasks.rados.rados.0.smithi116.stdout:95: write initial oid 95 2023-01-25T04:42:17.335 INFO:tasks.rados.rados.0.smithi116.stdout:95: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2023-01-25T04:42:17.341 INFO:tasks.rados.rados.0.smithi116.stdout:95: writing smithi116107171-95 from 779858 to 1249500 tid 1 2023-01-25T04:42:17.347 INFO:tasks.rados.rados.0.smithi116.stdout:95: writing smithi116107171-95 from 1817425 to 2324456 tid 2 2023-01-25T04:42:17.354 INFO:tasks.rados.rados.0.smithi116.stdout:95: writing smithi116107171-95 from 2781526 to 3368154 tid 3 2023-01-25T04:42:17.355 INFO:tasks.rados.rados.0.smithi116.stdout:96: write initial oid 96 2023-01-25T04:42:17.355 INFO:tasks.rados.rados.0.smithi116.stdout:96: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2023-01-25T04:42:17.360 INFO:tasks.rados.rados.0.smithi116.stdout:96: writing smithi116107171-96 from 796665 to 1341556 tid 1 2023-01-25T04:42:17.368 INFO:tasks.rados.rados.0.smithi116.stdout:96: writing smithi116107171-96 from 1759554 to 2410243 tid 2 2023-01-25T04:42:17.373 INFO:tasks.rados.rados.0.smithi116.stdout:96: writing smithi116107171-96 from 2976243 to 3596665 tid 3 2023-01-25T04:42:17.373 INFO:tasks.rados.rados.0.smithi116.stdout:97: write initial oid 97 2023-01-25T04:42:17.374 INFO:tasks.rados.rados.0.smithi116.stdout:97: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2023-01-25T04:42:17.378 INFO:tasks.rados.rados.0.smithi116.stdout:97: writing smithi116107171-97 from 413472 to 1033612 tid 1 2023-01-25T04:42:17.385 INFO:tasks.rados.rados.0.smithi116.stdout:97: writing smithi116107171-97 from 1818036 to 2328736 tid 2 2023-01-25T04:42:17.393 INFO:tasks.rados.rados.0.smithi116.stdout:97: writing smithi116107171-97 from 3120019 to 3613472 tid 3 2023-01-25T04:42:17.393 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.393 INFO:tasks.rados.rados.0.smithi116.stdout:82: finishing write tid 2 to smithi116107171-82 2023-01-25T04:42:17.394 INFO:tasks.rados.rados.0.smithi116.stdout:82: finishing write tid 3 to smithi116107171-82 2023-01-25T04:42:17.394 INFO:tasks.rados.rados.0.smithi116.stdout:82: finishing write tid 4 to smithi116107171-82 2023-01-25T04:42:17.394 INFO:tasks.rados.rados.0.smithi116.stdout:82: finishing write tid 5 to smithi116107171-82 2023-01-25T04:42:17.394 INFO:tasks.rados.rados.0.smithi116.stdout:82: oid 82 updating version 0 to 50 2023-01-25T04:42:17.394 INFO:tasks.rados.rados.0.smithi116.stdout:82: oid 82 updating version 50 to 55 2023-01-25T04:42:17.395 INFO:tasks.rados.rados.0.smithi116.stdout:82: oid 82 version 55 is already newer than 54 2023-01-25T04:42:17.395 INFO:tasks.rados.rados.0.smithi116.stdout:82: oid 82 updating version 55 to 56 2023-01-25T04:42:17.395 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 82 v 56 (ObjNum 81 snap 0 seq_num 81) dirty exists 2023-01-25T04:42:17.395 INFO:tasks.rados.rados.0.smithi116.stdout:82: left oid 82 (ObjNum 81 snap 0 seq_num 81) 2023-01-25T04:42:17.395 INFO:tasks.rados.rados.0.smithi116.stdout:83: finishing write tid 1 to smithi116107171-83 2023-01-25T04:42:17.396 INFO:tasks.rados.rados.0.smithi116.stdout:82: done (15 left) 2023-01-25T04:42:17.396 INFO:tasks.rados.rados.0.smithi116.stdout:98: write initial oid 98 2023-01-25T04:42:17.396 INFO:tasks.rados.rados.0.smithi116.stdout:98: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2023-01-25T04:42:17.399 INFO:tasks.rados.rados.0.smithi116.stdout:98: writing smithi116107171-98 from 430279 to 1125668 tid 1 2023-01-25T04:42:17.407 INFO:tasks.rados.rados.0.smithi116.stdout:98: writing smithi116107171-98 from 1876518 to 2530876 tid 2 2023-01-25T04:42:17.414 INFO:tasks.rados.rados.0.smithi116.stdout:98: writing smithi116107171-98 from 3031089 to 3567886 tid 3 2023-01-25T04:42:17.414 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.414 INFO:tasks.rados.rados.0.smithi116.stdout:83: finishing write tid 2 to smithi116107171-83 2023-01-25T04:42:17.415 INFO:tasks.rados.rados.0.smithi116.stdout:83: finishing write tid 3 to smithi116107171-83 2023-01-25T04:42:17.415 INFO:tasks.rados.rados.0.smithi116.stdout:83: finishing write tid 4 to smithi116107171-83 2023-01-25T04:42:17.415 INFO:tasks.rados.rados.0.smithi116.stdout:83: finishing write tid 5 to smithi116107171-83 2023-01-25T04:42:17.416 INFO:tasks.rados.rados.0.smithi116.stdout:83: oid 83 updating version 0 to 57 2023-01-25T04:42:17.416 INFO:tasks.rados.rados.0.smithi116.stdout:83: oid 83 updating version 57 to 59 2023-01-25T04:42:17.416 INFO:tasks.rados.rados.0.smithi116.stdout:83: oid 83 version 59 is already newer than 51 2023-01-25T04:42:17.416 INFO:tasks.rados.rados.0.smithi116.stdout:83: oid 83 version 59 is already newer than 58 2023-01-25T04:42:17.417 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 83 v 59 (ObjNum 82 snap 0 seq_num 82) dirty exists 2023-01-25T04:42:17.417 INFO:tasks.rados.rados.0.smithi116.stdout:83: left oid 83 (ObjNum 82 snap 0 seq_num 82) 2023-01-25T04:42:17.417 INFO:tasks.rados.rados.0.smithi116.stdout:84: finishing write tid 1 to smithi116107171-84 2023-01-25T04:42:17.417 INFO:tasks.rados.rados.0.smithi116.stdout:84: finishing write tid 2 to smithi116107171-84 2023-01-25T04:42:17.417 INFO:tasks.rados.rados.0.smithi116.stdout:83: done (15 left) 2023-01-25T04:42:17.418 INFO:tasks.rados.rados.0.smithi116.stdout:99: write initial oid 99 2023-01-25T04:42:17.418 INFO:tasks.rados.rados.0.smithi116.stdout:99: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2023-01-25T04:42:17.419 INFO:tasks.rados.rados.0.smithi116.stdout:99: writing smithi116107171-99 from 447086 to 1217724 tid 1 2023-01-25T04:42:17.428 INFO:tasks.rados.rados.0.smithi116.stdout:99: writing smithi116107171-99 from 1935000 to 2733016 tid 2 2023-01-25T04:42:17.433 INFO:tasks.rados.rados.0.smithi116.stdout:99: writing smithi116107171-99 from 3458512 to 3647086 tid 3 2023-01-25T04:42:17.433 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.434 INFO:tasks.rados.rados.0.smithi116.stdout:84: finishing write tid 3 to smithi116107171-84 2023-01-25T04:42:17.434 INFO:tasks.rados.rados.0.smithi116.stdout:84: finishing write tid 4 to smithi116107171-84 2023-01-25T04:42:17.434 INFO:tasks.rados.rados.0.smithi116.stdout:84: finishing write tid 5 to smithi116107171-84 2023-01-25T04:42:17.434 INFO:tasks.rados.rados.0.smithi116.stdout:84: oid 84 updating version 0 to 39 2023-01-25T04:42:17.434 INFO:tasks.rados.rados.0.smithi116.stdout:84: oid 84 version 39 is already newer than 36 2023-01-25T04:42:17.435 INFO:tasks.rados.rados.0.smithi116.stdout:84: oid 84 version 39 is already newer than 37 2023-01-25T04:42:17.435 INFO:tasks.rados.rados.0.smithi116.stdout:84: oid 84 version 39 is already newer than 38 2023-01-25T04:42:17.435 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 84 v 39 (ObjNum 83 snap 0 seq_num 83) dirty exists 2023-01-25T04:42:17.435 INFO:tasks.rados.rados.0.smithi116.stdout:84: left oid 84 (ObjNum 83 snap 0 seq_num 83) 2023-01-25T04:42:17.435 INFO:tasks.rados.rados.0.smithi116.stdout:85: finishing write tid 1 to smithi116107171-85 2023-01-25T04:42:17.436 INFO:tasks.rados.rados.0.smithi116.stdout:84: done (15 left) 2023-01-25T04:42:17.436 INFO:tasks.rados.rados.0.smithi116.stdout:100: write initial oid 100 2023-01-25T04:42:17.436 INFO:tasks.rados.rados.0.smithi116.stdout:100: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2023-01-25T04:42:17.438 INFO:tasks.rados.rados.0.smithi116.stdout:100: writing smithi116107171-100 from 463893 to 1026133 tid 1 2023-01-25T04:42:17.445 INFO:tasks.rados.rados.0.smithi116.stdout:100: writing smithi116107171-100 from 1593482 to 2251509 tid 2 2023-01-25T04:42:17.451 INFO:tasks.rados.rados.0.smithi116.stdout:100: writing smithi116107171-100 from 2685935 to 3245276 tid 3 2023-01-25T04:42:17.452 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.452 INFO:tasks.rados.rados.0.smithi116.stdout:85: finishing write tid 2 to smithi116107171-85 2023-01-25T04:42:17.452 INFO:tasks.rados.rados.0.smithi116.stdout:85: finishing write tid 3 to smithi116107171-85 2023-01-25T04:42:17.452 INFO:tasks.rados.rados.0.smithi116.stdout:85: finishing write tid 4 to smithi116107171-85 2023-01-25T04:42:17.452 INFO:tasks.rados.rados.0.smithi116.stdout:85: finishing write tid 5 to smithi116107171-85 2023-01-25T04:42:17.453 INFO:tasks.rados.rados.0.smithi116.stdout:85: oid 85 updating version 0 to 58 2023-01-25T04:42:17.453 INFO:tasks.rados.rados.0.smithi116.stdout:85: oid 85 version 58 is already newer than 56 2023-01-25T04:42:17.453 INFO:tasks.rados.rados.0.smithi116.stdout:85: oid 85 version 58 is already newer than 57 2023-01-25T04:42:17.453 INFO:tasks.rados.rados.0.smithi116.stdout:85: oid 85 updating version 58 to 59 2023-01-25T04:42:17.454 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 85 v 59 (ObjNum 84 snap 0 seq_num 84) dirty exists 2023-01-25T04:42:17.454 INFO:tasks.rados.rados.0.smithi116.stdout:85: left oid 85 (ObjNum 84 snap 0 seq_num 84) 2023-01-25T04:42:17.454 INFO:tasks.rados.rados.0.smithi116.stdout:86: finishing write tid 1 to smithi116107171-86 2023-01-25T04:42:17.454 INFO:tasks.rados.rados.0.smithi116.stdout:85: done (15 left) 2023-01-25T04:42:17.454 INFO:tasks.rados.rados.0.smithi116.stdout:101: write initial oid 101 2023-01-25T04:42:17.455 INFO:tasks.rados.rados.0.smithi116.stdout:101: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2023-01-25T04:42:17.457 INFO:tasks.rados.rados.0.smithi116.stdout:101: writing smithi116107171-101 from 480700 to 1118189 tid 1 2023-01-25T04:42:17.462 INFO:tasks.rados.rados.0.smithi116.stdout:101: writing smithi116107171-101 from 1651964 to 2053649 tid 2 2023-01-25T04:42:17.471 INFO:tasks.rados.rados.0.smithi116.stdout:101: writing smithi116107171-101 from 2713358 to 3483971 tid 3 2023-01-25T04:42:17.471 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.471 INFO:tasks.rados.rados.0.smithi116.stdout:86: finishing write tid 2 to smithi116107171-86 2023-01-25T04:42:17.472 INFO:tasks.rados.rados.0.smithi116.stdout:86: finishing write tid 3 to smithi116107171-86 2023-01-25T04:42:17.472 INFO:tasks.rados.rados.0.smithi116.stdout:86: finishing write tid 4 to smithi116107171-86 2023-01-25T04:42:17.472 INFO:tasks.rados.rados.0.smithi116.stdout:86: finishing write tid 5 to smithi116107171-86 2023-01-25T04:42:17.472 INFO:tasks.rados.rados.0.smithi116.stdout:86: oid 86 updating version 0 to 43 2023-01-25T04:42:17.472 INFO:tasks.rados.rados.0.smithi116.stdout:86: oid 86 version 43 is already newer than 40 2023-01-25T04:42:17.473 INFO:tasks.rados.rados.0.smithi116.stdout:86: oid 86 version 43 is already newer than 41 2023-01-25T04:42:17.473 INFO:tasks.rados.rados.0.smithi116.stdout:86: oid 86 version 43 is already newer than 42 2023-01-25T04:42:17.473 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 86 v 43 (ObjNum 85 snap 0 seq_num 85) dirty exists 2023-01-25T04:42:17.473 INFO:tasks.rados.rados.0.smithi116.stdout:86: left oid 86 (ObjNum 85 snap 0 seq_num 85) 2023-01-25T04:42:17.473 INFO:tasks.rados.rados.0.smithi116.stdout:87: finishing write tid 1 to smithi116107171-87 2023-01-25T04:42:17.474 INFO:tasks.rados.rados.0.smithi116.stdout:86: done (15 left) 2023-01-25T04:42:17.474 INFO:tasks.rados.rados.0.smithi116.stdout:102: write initial oid 102 2023-01-25T04:42:17.474 INFO:tasks.rados.rados.0.smithi116.stdout:102: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2023-01-25T04:42:17.477 INFO:tasks.rados.rados.0.smithi116.stdout:102: writing smithi116107171-102 from 497507 to 1210245 tid 1 2023-01-25T04:42:17.483 INFO:tasks.rados.rados.0.smithi116.stdout:102: writing smithi116107171-102 from 1710446 to 2372142 tid 2 2023-01-25T04:42:17.492 INFO:tasks.rados.rados.0.smithi116.stdout:102: writing smithi116107171-102 from 3140781 to 3697507 tid 3 2023-01-25T04:42:17.492 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.492 INFO:tasks.rados.rados.0.smithi116.stdout:87: finishing write tid 2 to smithi116107171-87 2023-01-25T04:42:17.492 INFO:tasks.rados.rados.0.smithi116.stdout:87: finishing write tid 3 to smithi116107171-87 2023-01-25T04:42:17.493 INFO:tasks.rados.rados.0.smithi116.stdout:87: finishing write tid 4 to smithi116107171-87 2023-01-25T04:42:17.493 INFO:tasks.rados.rados.0.smithi116.stdout:87: finishing write tid 5 to smithi116107171-87 2023-01-25T04:42:17.493 INFO:tasks.rados.rados.0.smithi116.stdout:87: oid 87 updating version 0 to 44 2023-01-25T04:42:17.493 INFO:tasks.rados.rados.0.smithi116.stdout:87: oid 87 updating version 44 to 45 2023-01-25T04:42:17.493 INFO:tasks.rados.rados.0.smithi116.stdout:87: oid 87 version 45 is already newer than 41 2023-01-25T04:42:17.494 INFO:tasks.rados.rados.0.smithi116.stdout:87: oid 87 updating version 45 to 46 2023-01-25T04:42:17.495 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 87 v 46 (ObjNum 86 snap 0 seq_num 86) dirty exists 2023-01-25T04:42:17.495 INFO:tasks.rados.rados.0.smithi116.stdout:87: left oid 87 (ObjNum 86 snap 0 seq_num 86) 2023-01-25T04:42:17.495 INFO:tasks.rados.rados.0.smithi116.stdout:88: finishing write tid 1 to smithi116107171-88 2023-01-25T04:42:17.496 INFO:tasks.rados.rados.0.smithi116.stdout:88: finishing write tid 2 to smithi116107171-88 2023-01-25T04:42:17.496 INFO:tasks.rados.rados.0.smithi116.stdout:88: finishing write tid 3 to smithi116107171-88 2023-01-25T04:42:17.497 INFO:tasks.rados.rados.0.smithi116.stdout:88: finishing write tid 4 to smithi116107171-88 2023-01-25T04:42:17.497 INFO:tasks.rados.rados.0.smithi116.stdout:88: finishing write tid 5 to smithi116107171-88 2023-01-25T04:42:17.497 INFO:tasks.rados.rados.0.smithi116.stdout:88: oid 88 updating version 0 to 53 2023-01-25T04:42:17.497 INFO:tasks.rados.rados.0.smithi116.stdout:88: oid 88 updating version 53 to 54 2023-01-25T04:42:17.498 INFO:tasks.rados.rados.0.smithi116.stdout:88: oid 88 version 54 is already newer than 52 2023-01-25T04:42:17.498 INFO:tasks.rados.rados.0.smithi116.stdout:88: oid 88 updating version 54 to 55 2023-01-25T04:42:17.498 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 88 v 55 (ObjNum 87 snap 0 seq_num 87) dirty exists 2023-01-25T04:42:17.498 INFO:tasks.rados.rados.0.smithi116.stdout:88: left oid 88 (ObjNum 87 snap 0 seq_num 87) 2023-01-25T04:42:17.498 INFO:tasks.rados.rados.0.smithi116.stdout:89: finishing write tid 1 to smithi116107171-89 2023-01-25T04:42:17.499 INFO:tasks.rados.rados.0.smithi116.stdout:87: done (15 left) 2023-01-25T04:42:17.499 INFO:tasks.rados.rados.0.smithi116.stdout:88: done (14 left) 2023-01-25T04:42:17.499 INFO:tasks.rados.rados.0.smithi116.stdout:103: write initial oid 103 2023-01-25T04:42:17.499 INFO:tasks.rados.rados.0.smithi116.stdout:103: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2023-01-25T04:42:17.500 INFO:tasks.rados.rados.0.smithi116.stdout:103: writing smithi116107171-103 from 514314 to 1302301 tid 1 2023-01-25T04:42:17.502 INFO:tasks.rados.rados.0.smithi116.stdout:103: writing smithi116107171-103 from 1768928 to 2174282 tid 2 2023-01-25T04:42:17.509 INFO:tasks.rados.rados.0.smithi116.stdout:103: writing smithi116107171-103 from 2768204 to 3277714 tid 3 2023-01-25T04:42:17.509 INFO:tasks.rados.rados.0.smithi116.stdout:104: write initial oid 104 2023-01-25T04:42:17.510 INFO:tasks.rados.rados.0.smithi116.stdout:104: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2023-01-25T04:42:17.514 INFO:tasks.rados.rados.0.smithi116.stdout:104: writing smithi116107171-104 from 531121 to 994357 tid 1 2023-01-25T04:42:17.522 INFO:tasks.rados.rados.0.smithi116.stdout:104: writing smithi116107171-104 from 1711057 to 2376422 tid 2 2023-01-25T04:42:17.530 INFO:tasks.rados.rados.0.smithi116.stdout:104: writing smithi116107171-104 from 3079274 to 3731121 tid 3 2023-01-25T04:42:17.530 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.531 INFO:tasks.rados.rados.0.smithi116.stdout:89: finishing write tid 2 to smithi116107171-89 2023-01-25T04:42:17.531 INFO:tasks.rados.rados.0.smithi116.stdout:89: finishing write tid 3 to smithi116107171-89 2023-01-25T04:42:17.531 INFO:tasks.rados.rados.0.smithi116.stdout:89: finishing write tid 4 to smithi116107171-89 2023-01-25T04:42:17.532 INFO:tasks.rados.rados.0.smithi116.stdout:89: finishing write tid 5 to smithi116107171-89 2023-01-25T04:42:17.532 INFO:tasks.rados.rados.0.smithi116.stdout:89: oid 89 updating version 0 to 61 2023-01-25T04:42:17.532 INFO:tasks.rados.rados.0.smithi116.stdout:89: oid 89 version 61 is already newer than 57 2023-01-25T04:42:17.532 INFO:tasks.rados.rados.0.smithi116.stdout:89: oid 89 version 61 is already newer than 60 2023-01-25T04:42:17.532 INFO:tasks.rados.rados.0.smithi116.stdout:89: oid 89 version 61 is already newer than 58 2023-01-25T04:42:17.533 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 89 v 61 (ObjNum 88 snap 0 seq_num 88) dirty exists 2023-01-25T04:42:17.533 INFO:tasks.rados.rados.0.smithi116.stdout:89: left oid 89 (ObjNum 88 snap 0 seq_num 88) 2023-01-25T04:42:17.533 INFO:tasks.rados.rados.0.smithi116.stdout:90: finishing write tid 1 to smithi116107171-90 2023-01-25T04:42:17.533 INFO:tasks.rados.rados.0.smithi116.stdout:89: done (15 left) 2023-01-25T04:42:17.533 INFO:tasks.rados.rados.0.smithi116.stdout:105: write initial oid 105 2023-01-25T04:42:17.534 INFO:tasks.rados.rados.0.smithi116.stdout:105: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2023-01-25T04:42:17.536 INFO:tasks.rados.rados.0.smithi116.stdout:105: writing smithi116107171-105 from 547928 to 1086413 tid 1 2023-01-25T04:42:17.542 INFO:tasks.rados.rados.0.smithi116.stdout:105: writing smithi116107171-105 from 1769539 to 2178562 tid 2 2023-01-25T04:42:17.549 INFO:tasks.rados.rados.0.smithi116.stdout:105: writing smithi116107171-105 from 2706697 to 3238751 tid 3 2023-01-25T04:42:17.549 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.549 INFO:tasks.rados.rados.0.smithi116.stdout:90: finishing write tid 2 to smithi116107171-90 2023-01-25T04:42:17.549 INFO:tasks.rados.rados.0.smithi116.stdout:90: finishing write tid 3 to smithi116107171-90 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:91: finishing write tid 1 to smithi116107171-91 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:90: finishing write tid 4 to smithi116107171-90 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:90: finishing write tid 5 to smithi116107171-90 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:90: oid 90 updating version 0 to 63 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:90: oid 90 version 63 is already newer than 59 2023-01-25T04:42:17.550 INFO:tasks.rados.rados.0.smithi116.stdout:90: oid 90 version 63 is already newer than 60 2023-01-25T04:42:17.551 INFO:tasks.rados.rados.0.smithi116.stdout:90: oid 90 version 63 is already newer than 62 2023-01-25T04:42:17.551 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 90 v 63 (ObjNum 89 snap 0 seq_num 89) dirty exists 2023-01-25T04:42:17.551 INFO:tasks.rados.rados.0.smithi116.stdout:90: left oid 90 (ObjNum 89 snap 0 seq_num 89) 2023-01-25T04:42:17.551 INFO:tasks.rados.rados.0.smithi116.stdout:91: finishing write tid 2 to smithi116107171-91 2023-01-25T04:42:17.551 INFO:tasks.rados.rados.0.smithi116.stdout:91: finishing write tid 3 to smithi116107171-91 2023-01-25T04:42:17.552 INFO:tasks.rados.rados.0.smithi116.stdout:91: finishing write tid 4 to smithi116107171-91 2023-01-25T04:42:17.552 INFO:tasks.rados.rados.0.smithi116.stdout:91: finishing write tid 5 to smithi116107171-91 2023-01-25T04:42:17.552 INFO:tasks.rados.rados.0.smithi116.stdout:91: oid 91 updating version 0 to 40 2023-01-25T04:42:17.552 INFO:tasks.rados.rados.0.smithi116.stdout:91: oid 91 updating version 40 to 41 2023-01-25T04:42:17.552 INFO:tasks.rados.rados.0.smithi116.stdout:91: oid 91 updating version 41 to 43 2023-01-25T04:42:17.553 INFO:tasks.rados.rados.0.smithi116.stdout:91: oid 91 version 43 is already newer than 42 2023-01-25T04:42:17.553 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 91 v 43 (ObjNum 90 snap 0 seq_num 90) dirty exists 2023-01-25T04:42:17.554 INFO:tasks.rados.rados.0.smithi116.stdout:91: left oid 91 (ObjNum 90 snap 0 seq_num 90) 2023-01-25T04:42:17.554 INFO:tasks.rados.rados.0.smithi116.stdout:92: finishing write tid 1 to smithi116107171-92 2023-01-25T04:42:17.554 INFO:tasks.rados.rados.0.smithi116.stdout:90: done (15 left) 2023-01-25T04:42:17.555 INFO:tasks.rados.rados.0.smithi116.stdout:91: done (14 left) 2023-01-25T04:42:17.556 INFO:tasks.rados.rados.0.smithi116.stdout:106: write initial oid 106 2023-01-25T04:42:17.556 INFO:tasks.rados.rados.0.smithi116.stdout:106: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2023-01-25T04:42:17.556 INFO:tasks.rados.rados.0.smithi116.stdout:106: writing smithi116107171-106 from 564735 to 1178469 tid 1 2023-01-25T04:42:17.562 INFO:tasks.rados.rados.0.smithi116.stdout:106: writing smithi116107171-106 from 1828021 to 2497055 tid 2 2023-01-25T04:42:17.568 INFO:tasks.rados.rados.0.smithi116.stdout:106: writing smithi116107171-106 from 3134120 to 3764735 tid 3 2023-01-25T04:42:17.568 INFO:tasks.rados.rados.0.smithi116.stdout:107: write initial oid 107 2023-01-25T04:42:17.569 INFO:tasks.rados.rados.0.smithi116.stdout:107: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2023-01-25T04:42:17.575 INFO:tasks.rados.rados.0.smithi116.stdout:107: writing smithi116107171-107 from 581542 to 1270525 tid 1 2023-01-25T04:42:17.581 INFO:tasks.rados.rados.0.smithi116.stdout:107: writing smithi116107171-107 from 1886503 to 2299195 tid 2 2023-01-25T04:42:17.588 INFO:tasks.rados.rados.0.smithi116.stdout:107: writing smithi116107171-107 from 2761543 to 3432494 tid 3 2023-01-25T04:42:17.589 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.589 INFO:tasks.rados.rados.0.smithi116.stdout:92: finishing write tid 2 to smithi116107171-92 2023-01-25T04:42:17.589 INFO:tasks.rados.rados.0.smithi116.stdout:92: finishing write tid 3 to smithi116107171-92 2023-01-25T04:42:17.589 INFO:tasks.rados.rados.0.smithi116.stdout:92: finishing write tid 4 to smithi116107171-92 2023-01-25T04:42:17.589 INFO:tasks.rados.rados.0.smithi116.stdout:92: finishing write tid 5 to smithi116107171-92 2023-01-25T04:42:17.590 INFO:tasks.rados.rados.0.smithi116.stdout:92: oid 92 updating version 0 to 56 2023-01-25T04:42:17.590 INFO:tasks.rados.rados.0.smithi116.stdout:92: oid 92 updating version 56 to 57 2023-01-25T04:42:17.590 INFO:tasks.rados.rados.0.smithi116.stdout:92: oid 92 updating version 57 to 59 2023-01-25T04:42:17.590 INFO:tasks.rados.rados.0.smithi116.stdout:92: oid 92 version 59 is already newer than 58 2023-01-25T04:42:17.590 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 92 v 59 (ObjNum 91 snap 0 seq_num 91) dirty exists 2023-01-25T04:42:17.591 INFO:tasks.rados.rados.0.smithi116.stdout:92: left oid 92 (ObjNum 91 snap 0 seq_num 91) 2023-01-25T04:42:17.591 INFO:tasks.rados.rados.0.smithi116.stdout:93: finishing write tid 1 to smithi116107171-93 2023-01-25T04:42:17.591 INFO:tasks.rados.rados.0.smithi116.stdout:93: finishing write tid 2 to smithi116107171-93 2023-01-25T04:42:17.591 INFO:tasks.rados.rados.0.smithi116.stdout:93: finishing write tid 3 to smithi116107171-93 2023-01-25T04:42:17.591 INFO:tasks.rados.rados.0.smithi116.stdout:93: finishing write tid 4 to smithi116107171-93 2023-01-25T04:42:17.592 INFO:tasks.rados.rados.0.smithi116.stdout:93: finishing write tid 5 to smithi116107171-93 2023-01-25T04:42:17.592 INFO:tasks.rados.rados.0.smithi116.stdout:93: oid 93 updating version 0 to 64 2023-01-25T04:42:17.592 INFO:tasks.rados.rados.0.smithi116.stdout:93: oid 93 version 64 is already newer than 62 2023-01-25T04:42:17.592 INFO:tasks.rados.rados.0.smithi116.stdout:93: oid 93 version 64 is already newer than 63 2023-01-25T04:42:17.592 INFO:tasks.rados.rados.0.smithi116.stdout:93: oid 93 version 64 is already newer than 61 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 93 v 64 (ObjNum 92 snap 0 seq_num 92) dirty exists 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:93: left oid 93 (ObjNum 92 snap 0 seq_num 92) 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:94: finishing write tid 1 to smithi116107171-94 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:94: finishing write tid 2 to smithi116107171-94 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:94: finishing write tid 3 to smithi116107171-94 2023-01-25T04:42:17.593 INFO:tasks.rados.rados.0.smithi116.stdout:94: finishing write tid 4 to smithi116107171-94 2023-01-25T04:42:17.594 INFO:tasks.rados.rados.0.smithi116.stdout:94: finishing write tid 5 to smithi116107171-94 2023-01-25T04:42:17.594 INFO:tasks.rados.rados.0.smithi116.stdout:94: oid 94 updating version 0 to 47 2023-01-25T04:42:17.594 INFO:tasks.rados.rados.0.smithi116.stdout:94: oid 94 updating version 47 to 48 2023-01-25T04:42:17.594 INFO:tasks.rados.rados.0.smithi116.stdout:94: oid 94 updating version 48 to 49 2023-01-25T04:42:17.594 INFO:tasks.rados.rados.0.smithi116.stdout:94: oid 94 version 49 is already newer than 42 2023-01-25T04:42:17.595 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 94 v 49 (ObjNum 93 snap 0 seq_num 93) dirty exists 2023-01-25T04:42:17.595 INFO:tasks.rados.rados.0.smithi116.stdout:94: left oid 94 (ObjNum 93 snap 0 seq_num 93) 2023-01-25T04:42:17.595 INFO:tasks.rados.rados.0.smithi116.stdout:95: finishing write tid 1 to smithi116107171-95 2023-01-25T04:42:17.595 INFO:tasks.rados.rados.0.smithi116.stdout:95: finishing write tid 2 to smithi116107171-95 2023-01-25T04:42:17.597 INFO:tasks.rados.rados.0.smithi116.stdout:96: finishing write tid 1 to smithi116107171-96 2023-01-25T04:42:17.597 INFO:tasks.rados.rados.0.smithi116.stdout:92: done (15 left) 2023-01-25T04:42:17.597 INFO:tasks.rados.rados.0.smithi116.stdout:93: done (14 left) 2023-01-25T04:42:17.597 INFO:tasks.rados.rados.0.smithi116.stdout:94: done (13 left) 2023-01-25T04:42:17.598 INFO:tasks.rados.rados.0.smithi116.stdout:108: write initial oid 108 2023-01-25T04:42:17.598 INFO:tasks.rados.rados.0.smithi116.stdout:108: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2023-01-25T04:42:17.598 INFO:tasks.rados.rados.0.smithi116.stdout:108: writing smithi116107171-108 from 598349 to 1078934 tid 1 2023-01-25T04:42:17.599 INFO:tasks.rados.rados.0.smithi116.stdout:108: writing smithi116107171-108 from 1544985 to 2217688 tid 2 2023-01-25T04:42:17.605 INFO:tasks.rados.rados.0.smithi116.stdout:108: writing smithi116107171-108 from 2905319 to 3387542 tid 3 2023-01-25T04:42:17.605 INFO:tasks.rados.rados.0.smithi116.stdout:109: write initial oid 109 2023-01-25T04:42:17.606 INFO:tasks.rados.rados.0.smithi116.stdout:109: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2023-01-25T04:42:17.611 INFO:tasks.rados.rados.0.smithi116.stdout:109: writing smithi116107171-109 from 615156 to 1170990 tid 1 2023-01-25T04:42:17.616 INFO:tasks.rados.rados.0.smithi116.stdout:109: writing smithi116107171-109 from 1603467 to 2019828 tid 2 2023-01-25T04:42:17.624 INFO:tasks.rados.rados.0.smithi116.stdout:109: writing smithi116107171-109 from 2816389 to 3509884 tid 3 2023-01-25T04:42:17.625 INFO:tasks.rados.rados.0.smithi116.stdout:110: write initial oid 110 2023-01-25T04:42:17.625 INFO:tasks.rados.rados.0.smithi116.stdout:110: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2023-01-25T04:42:17.632 INFO:tasks.rados.rados.0.smithi116.stdout:110: writing smithi116107171-110 from 631963 to 1263046 tid 1 2023-01-25T04:42:17.639 INFO:tasks.rados.rados.0.smithi116.stdout:110: writing smithi116107171-110 from 2061949 to 2621968 tid 2 2023-01-25T04:42:17.646 INFO:tasks.rados.rados.0.smithi116.stdout:110: writing smithi116107171-110 from 3243812 to 3748579 tid 3 2023-01-25T04:42:17.646 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.647 INFO:tasks.rados.rados.0.smithi116.stdout:95: finishing write tid 3 to smithi116107171-95 2023-01-25T04:42:17.647 INFO:tasks.rados.rados.0.smithi116.stdout:95: finishing write tid 4 to smithi116107171-95 2023-01-25T04:42:17.647 INFO:tasks.rados.rados.0.smithi116.stdout:95: finishing write tid 5 to smithi116107171-95 2023-01-25T04:42:17.647 INFO:tasks.rados.rados.0.smithi116.stdout:95: oid 95 updating version 0 to 44 2023-01-25T04:42:17.648 INFO:tasks.rados.rados.0.smithi116.stdout:95: oid 95 updating version 44 to 50 2023-01-25T04:42:17.648 INFO:tasks.rados.rados.0.smithi116.stdout:95: oid 95 version 50 is already newer than 43 2023-01-25T04:42:17.648 INFO:tasks.rados.rados.0.smithi116.stdout:95: oid 95 updating version 50 to 51 2023-01-25T04:42:17.649 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 95 v 51 (ObjNum 94 snap 0 seq_num 94) dirty exists 2023-01-25T04:42:17.649 INFO:tasks.rados.rados.0.smithi116.stdout:95: left oid 95 (ObjNum 94 snap 0 seq_num 94) 2023-01-25T04:42:17.649 INFO:tasks.rados.rados.0.smithi116.stdout:96: finishing write tid 2 to smithi116107171-96 2023-01-25T04:42:17.649 INFO:tasks.rados.rados.0.smithi116.stdout:96: finishing write tid 3 to smithi116107171-96 2023-01-25T04:42:17.650 INFO:tasks.rados.rados.0.smithi116.stdout:97: finishing write tid 1 to smithi116107171-97 2023-01-25T04:42:17.650 INFO:tasks.rados.rados.0.smithi116.stdout:96: finishing write tid 4 to smithi116107171-96 2023-01-25T04:42:17.650 INFO:tasks.rados.rados.0.smithi116.stdout:95: done (15 left) 2023-01-25T04:42:17.650 INFO:tasks.rados.rados.0.smithi116.stdout:111: write initial oid 111 2023-01-25T04:42:17.651 INFO:tasks.rados.rados.0.smithi116.stdout:111: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2023-01-25T04:42:17.652 INFO:tasks.rados.rados.0.smithi116.stdout:111: writing smithi116107171-111 from 648770 to 1355102 tid 1 2023-01-25T04:42:17.659 INFO:tasks.rados.rados.0.smithi116.stdout:111: writing smithi116107171-111 from 2120431 to 2540461 tid 2 2023-01-25T04:42:17.666 INFO:tasks.rados.rados.0.smithi116.stdout:111: writing smithi116107171-111 from 3271235 to 3703627 tid 3 2023-01-25T04:42:17.666 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.666 INFO:tasks.rados.rados.0.smithi116.stdout:96: finishing write tid 5 to smithi116107171-96 2023-01-25T04:42:17.666 INFO:tasks.rados.rados.0.smithi116.stdout:96: oid 96 updating version 0 to 47 2023-01-25T04:42:17.667 INFO:tasks.rados.rados.0.smithi116.stdout:96: oid 96 version 47 is already newer than 45 2023-01-25T04:42:17.667 INFO:tasks.rados.rados.0.smithi116.stdout:96: oid 96 version 47 is already newer than 44 2023-01-25T04:42:17.667 INFO:tasks.rados.rados.0.smithi116.stdout:96: oid 96 version 47 is already newer than 46 2023-01-25T04:42:17.667 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 96 v 47 (ObjNum 95 snap 0 seq_num 95) dirty exists 2023-01-25T04:42:17.667 INFO:tasks.rados.rados.0.smithi116.stdout:96: left oid 96 (ObjNum 95 snap 0 seq_num 95) 2023-01-25T04:42:17.668 INFO:tasks.rados.rados.0.smithi116.stdout:96: done (15 left) 2023-01-25T04:42:17.668 INFO:tasks.rados.rados.0.smithi116.stdout:112: write initial oid 112 2023-01-25T04:42:17.668 INFO:tasks.rados.rados.0.smithi116.stdout:112: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2023-01-25T04:42:17.673 INFO:tasks.rados.rados.0.smithi116.stdout:112: writing smithi116107171-112 from 665577 to 1447158 tid 1 2023-01-25T04:42:17.680 INFO:tasks.rados.rados.0.smithi116.stdout:112: writing smithi116107171-112 from 2062560 to 2626248 tid 2 2023-01-25T04:42:17.691 INFO:tasks.rados.rados.0.smithi116.stdout:112: writing smithi116107171-112 from 3182305 to 3825969 tid 3 2023-01-25T04:42:17.692 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.692 INFO:tasks.rados.rados.0.smithi116.stdout:97: finishing write tid 2 to smithi116107171-97 2023-01-25T04:42:17.692 INFO:tasks.rados.rados.0.smithi116.stdout:97: finishing write tid 3 to smithi116107171-97 2023-01-25T04:42:17.692 INFO:tasks.rados.rados.0.smithi116.stdout:97: finishing write tid 4 to smithi116107171-97 2023-01-25T04:42:17.693 INFO:tasks.rados.rados.0.smithi116.stdout:97: finishing write tid 5 to smithi116107171-97 2023-01-25T04:42:17.693 INFO:tasks.rados.rados.0.smithi116.stdout:97: oid 97 updating version 0 to 62 2023-01-25T04:42:17.693 INFO:tasks.rados.rados.0.smithi116.stdout:97: oid 97 version 62 is already newer than 61 2023-01-25T04:42:17.693 INFO:tasks.rados.rados.0.smithi116.stdout:97: oid 97 version 62 is already newer than 60 2023-01-25T04:42:17.693 INFO:tasks.rados.rados.0.smithi116.stdout:97: oid 97 updating version 62 to 63 2023-01-25T04:42:17.694 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 97 v 63 (ObjNum 96 snap 0 seq_num 96) dirty exists 2023-01-25T04:42:17.694 INFO:tasks.rados.rados.0.smithi116.stdout:97: left oid 97 (ObjNum 96 snap 0 seq_num 96) 2023-01-25T04:42:17.694 INFO:tasks.rados.rados.0.smithi116.stdout:98: finishing write tid 1 to smithi116107171-98 2023-01-25T04:42:17.694 INFO:tasks.rados.rados.0.smithi116.stdout:98: finishing write tid 2 to smithi116107171-98 2023-01-25T04:42:17.694 INFO:tasks.rados.rados.0.smithi116.stdout:98: finishing write tid 3 to smithi116107171-98 2023-01-25T04:42:17.695 INFO:tasks.rados.rados.0.smithi116.stdout:98: finishing write tid 4 to smithi116107171-98 2023-01-25T04:42:17.695 INFO:tasks.rados.rados.0.smithi116.stdout:98: finishing write tid 5 to smithi116107171-98 2023-01-25T04:42:17.695 INFO:tasks.rados.rados.0.smithi116.stdout:98: oid 98 updating version 0 to 66 2023-01-25T04:42:17.695 INFO:tasks.rados.rados.0.smithi116.stdout:98: oid 98 updating version 66 to 68 2023-01-25T04:42:17.696 INFO:tasks.rados.rados.0.smithi116.stdout:98: oid 98 version 68 is already newer than 67 2023-01-25T04:42:17.696 INFO:tasks.rados.rados.0.smithi116.stdout:98: oid 98 version 68 is already newer than 65 2023-01-25T04:42:17.696 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 98 v 68 (ObjNum 97 snap 0 seq_num 97) dirty exists 2023-01-25T04:42:17.696 INFO:tasks.rados.rados.0.smithi116.stdout:98: left oid 98 (ObjNum 97 snap 0 seq_num 97) 2023-01-25T04:42:17.697 INFO:tasks.rados.rados.0.smithi116.stdout:99: finishing write tid 1 to smithi116107171-99 2023-01-25T04:42:17.697 INFO:tasks.rados.rados.0.smithi116.stdout:99: finishing write tid 2 to smithi116107171-99 2023-01-25T04:42:17.697 INFO:tasks.rados.rados.0.smithi116.stdout:99: finishing write tid 3 to smithi116107171-99 2023-01-25T04:42:17.697 INFO:tasks.rados.rados.0.smithi116.stdout:99: finishing write tid 4 to smithi116107171-99 2023-01-25T04:42:17.697 INFO:tasks.rados.rados.0.smithi116.stdout:99: finishing write tid 5 to smithi116107171-99 2023-01-25T04:42:17.698 INFO:tasks.rados.rados.0.smithi116.stdout:99: oid 99 updating version 0 to 71 2023-01-25T04:42:17.698 INFO:tasks.rados.rados.0.smithi116.stdout:99: oid 99 updating version 71 to 72 2023-01-25T04:42:17.698 INFO:tasks.rados.rados.0.smithi116.stdout:99: oid 99 version 72 is already newer than 70 2023-01-25T04:42:17.698 INFO:tasks.rados.rados.0.smithi116.stdout:99: oid 99 version 72 is already newer than 69 2023-01-25T04:42:17.698 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 99 v 72 (ObjNum 98 snap 0 seq_num 98) dirty exists 2023-01-25T04:42:17.699 INFO:tasks.rados.rados.0.smithi116.stdout:99: left oid 99 (ObjNum 98 snap 0 seq_num 98) 2023-01-25T04:42:17.699 INFO:tasks.rados.rados.0.smithi116.stdout:100: finishing write tid 1 to smithi116107171-100 2023-01-25T04:42:17.700 INFO:tasks.rados.rados.0.smithi116.stdout:100: finishing write tid 2 to smithi116107171-100 2023-01-25T04:42:17.700 INFO:tasks.rados.rados.0.smithi116.stdout:100: finishing write tid 3 to smithi116107171-100 2023-01-25T04:42:17.700 INFO:tasks.rados.rados.0.smithi116.stdout:100: finishing write tid 4 to smithi116107171-100 2023-01-25T04:42:17.701 INFO:tasks.rados.rados.0.smithi116.stdout:100: finishing write tid 5 to smithi116107171-100 2023-01-25T04:42:17.701 INFO:tasks.rados.rados.0.smithi116.stdout:100: oid 100 updating version 0 to 47 2023-01-25T04:42:17.701 INFO:tasks.rados.rados.0.smithi116.stdout:100: oid 100 version 47 is already newer than 46 2023-01-25T04:42:17.701 INFO:tasks.rados.rados.0.smithi116.stdout:100: oid 100 updating version 47 to 48 2023-01-25T04:42:17.701 INFO:tasks.rados.rados.0.smithi116.stdout:100: oid 100 version 48 is already newer than 45 2023-01-25T04:42:17.702 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 100 v 48 (ObjNum 99 snap 0 seq_num 99) dirty exists 2023-01-25T04:42:17.702 INFO:tasks.rados.rados.0.smithi116.stdout:100: left oid 100 (ObjNum 99 snap 0 seq_num 99) 2023-01-25T04:42:17.702 INFO:tasks.rados.rados.0.smithi116.stdout:101: finishing write tid 1 to smithi116107171-101 2023-01-25T04:42:17.702 INFO:tasks.rados.rados.0.smithi116.stdout:101: finishing write tid 2 to smithi116107171-101 2023-01-25T04:42:17.702 INFO:tasks.rados.rados.0.smithi116.stdout:101: finishing write tid 3 to smithi116107171-101 2023-01-25T04:42:17.703 INFO:tasks.rados.rados.0.smithi116.stdout:101: finishing write tid 4 to smithi116107171-101 2023-01-25T04:42:17.703 INFO:tasks.rados.rados.0.smithi116.stdout:101: finishing write tid 5 to smithi116107171-101 2023-01-25T04:42:17.703 INFO:tasks.rados.rados.0.smithi116.stdout:101: oid 101 updating version 0 to 50 2023-01-25T04:42:17.703 INFO:tasks.rados.rados.0.smithi116.stdout:101: oid 101 updating version 50 to 51 2023-01-25T04:42:17.703 INFO:tasks.rados.rados.0.smithi116.stdout:101: oid 101 version 51 is already newer than 49 2023-01-25T04:42:17.704 INFO:tasks.rados.rados.0.smithi116.stdout:101: oid 101 updating version 51 to 52 2023-01-25T04:42:17.704 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 101 v 52 (ObjNum 100 snap 0 seq_num 100) dirty exists 2023-01-25T04:42:17.704 INFO:tasks.rados.rados.0.smithi116.stdout:101: left oid 101 (ObjNum 100 snap 0 seq_num 100) 2023-01-25T04:42:17.704 INFO:tasks.rados.rados.0.smithi116.stdout:102: finishing write tid 1 to smithi116107171-102 2023-01-25T04:42:17.704 INFO:tasks.rados.rados.0.smithi116.stdout:97: done (15 left) 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:98: done (14 left) 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:99: done (13 left) 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:100: done (12 left) 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:101: done (11 left) 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:113: write initial oid 113 2023-01-25T04:42:17.705 INFO:tasks.rados.rados.0.smithi116.stdout:113: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2023-01-25T04:42:17.706 INFO:tasks.rados.rados.0.smithi116.stdout:113: writing smithi116107171-113 from 682384 to 1139214 tid 1 2023-01-25T04:42:17.706 INFO:tasks.rados.rados.0.smithi116.stdout:113: writing smithi116107171-113 from 1721042 to 2144741 tid 2 2023-01-25T04:42:17.707 INFO:tasks.rados.rados.0.smithi116.stdout:113: writing smithi116107171-113 from 2809728 to 3264664 tid 3 2023-01-25T04:42:17.709 INFO:tasks.rados.rados.0.smithi116.stdout:113: writing smithi116107171-113 from 3731357 to 3882384 tid 4 2023-01-25T04:42:17.709 INFO:tasks.rados.rados.0.smithi116.stdout:114: write initial oid 114 2023-01-25T04:42:17.710 INFO:tasks.rados.rados.0.smithi116.stdout:102: finishing write tid 2 to smithi116107171-102 2023-01-25T04:42:17.710 INFO:tasks.rados.rados.0.smithi116.stdout:102: finishing write tid 3 to smithi116107171-102 2023-01-25T04:42:17.710 INFO:tasks.rados.rados.0.smithi116.stdout:102: finishing write tid 4 to smithi116107171-102 2023-01-25T04:42:17.710 INFO:tasks.rados.rados.0.smithi116.stdout:102: finishing write tid 5 to smithi116107171-102 2023-01-25T04:42:17.710 INFO:tasks.rados.rados.0.smithi116.stdout:102: oid 102 updating version 0 to 48 2023-01-25T04:42:17.711 INFO:tasks.rados.rados.0.smithi116.stdout:102: oid 102 updating version 48 to 49 2023-01-25T04:42:17.711 INFO:tasks.rados.rados.0.smithi116.stdout:102: oid 102 version 49 is already newer than 47 2023-01-25T04:42:17.711 INFO:tasks.rados.rados.0.smithi116.stdout:102: oid 102 updating version 49 to 50 2023-01-25T04:42:17.711 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 102 v 50 (ObjNum 101 snap 0 seq_num 101) dirty exists 2023-01-25T04:42:17.711 INFO:tasks.rados.rados.0.smithi116.stdout:102: left oid 102 (ObjNum 101 snap 0 seq_num 101) 2023-01-25T04:42:17.712 INFO:tasks.rados.rados.0.smithi116.stdout:114: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2023-01-25T04:42:17.715 INFO:tasks.rados.rados.0.smithi116.stdout:114: writing smithi116107171-114 from 699191 to 1231270 tid 1 2023-01-25T04:42:17.721 INFO:tasks.rados.rados.0.smithi116.stdout:114: writing smithi116107171-114 from 1779524 to 2346881 tid 2 2023-01-25T04:42:17.728 INFO:tasks.rados.rados.0.smithi116.stdout:114: writing smithi116107171-114 from 2837151 to 3503359 tid 3 2023-01-25T04:42:17.728 INFO:tasks.rados.rados.0.smithi116.stdout:102: done (12 left) 2023-01-25T04:42:17.729 INFO:tasks.rados.rados.0.smithi116.stdout:115: write initial oid 115 2023-01-25T04:42:17.729 INFO:tasks.rados.rados.0.smithi116.stdout:115: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2023-01-25T04:42:17.736 INFO:tasks.rados.rados.0.smithi116.stdout:115: writing smithi116107171-115 from 715998 to 1323326 tid 1 2023-01-25T04:42:17.740 INFO:tasks.rados.rados.0.smithi116.stdout:115: writing smithi116107171-115 from 1838006 to 2265374 tid 2 2023-01-25T04:42:17.746 INFO:tasks.rados.rados.0.smithi116.stdout:115: writing smithi116107171-115 from 2864574 to 3342054 tid 3 2023-01-25T04:42:17.749 INFO:tasks.rados.rados.0.smithi116.stdout:115: writing smithi116107171-115 from 3863835 to 3915998 tid 4 2023-01-25T04:42:17.750 INFO:tasks.rados.rados.0.smithi116.stdout:116: write initial oid 116 2023-01-25T04:42:17.750 INFO:tasks.rados.rados.0.smithi116.stdout:116: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2023-01-25T04:42:17.757 INFO:tasks.rados.rados.0.smithi116.stdout:116: writing smithi116107171-116 from 732805 to 1531735 tid 1 2023-01-25T04:42:17.765 INFO:tasks.rados.rados.0.smithi116.stdout:116: writing smithi116107171-116 from 2296488 to 2867514 tid 2 2023-01-25T04:42:17.769 INFO:tasks.rados.rados.0.smithi116.stdout:116: writing smithi116107171-116 from 3291997 to 3697102 tid 3 2023-01-25T04:42:17.770 INFO:tasks.rados.rados.0.smithi116.stdout:117: write initial oid 117 2023-01-25T04:42:17.770 INFO:tasks.rados.rados.0.smithi116.stdout:117: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2023-01-25T04:42:17.776 INFO:tasks.rados.rados.0.smithi116.stdout:117: writing smithi116107171-117 from 749612 to 1223791 tid 1 2023-01-25T04:42:17.782 INFO:tasks.rados.rados.0.smithi116.stdout:117: writing smithi116107171-117 from 1954970 to 2386007 tid 2 2023-01-25T04:42:17.789 INFO:tasks.rados.rados.0.smithi116.stdout:117: writing smithi116107171-117 from 2919420 to 3535797 tid 3 2023-01-25T04:42:17.789 INFO:tasks.rados.rados.0.smithi116.stdout:118: write initial oid 118 2023-01-25T04:42:17.790 INFO:tasks.rados.rados.0.smithi116.stdout:118: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2023-01-25T04:42:17.796 INFO:tasks.rados.rados.0.smithi116.stdout:118: writing smithi116107171-118 from 766419 to 1315847 tid 1 2023-01-25T04:42:17.803 INFO:tasks.rados.rados.0.smithi116.stdout:118: writing smithi116107171-118 from 2013452 to 2588147 tid 2 2023-01-25T04:42:17.810 INFO:tasks.rados.rados.0.smithi116.stdout:118: writing smithi116107171-118 from 3346843 to 3774492 tid 3 2023-01-25T04:42:17.810 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.810 INFO:tasks.rados.rados.0.smithi116.stdout:103: finishing write tid 1 to smithi116107171-103 2023-01-25T04:42:17.811 INFO:tasks.rados.rados.0.smithi116.stdout:103: finishing write tid 2 to smithi116107171-103 2023-01-25T04:42:17.811 INFO:tasks.rados.rados.0.smithi116.stdout:103: finishing write tid 3 to smithi116107171-103 2023-01-25T04:42:17.811 INFO:tasks.rados.rados.0.smithi116.stdout:103: finishing write tid 4 to smithi116107171-103 2023-01-25T04:42:17.811 INFO:tasks.rados.rados.0.smithi116.stdout:103: finishing write tid 5 to smithi116107171-103 2023-01-25T04:42:17.811 INFO:tasks.rados.rados.0.smithi116.stdout:103: oid 103 updating version 0 to 67 2023-01-25T04:42:17.812 INFO:tasks.rados.rados.0.smithi116.stdout:103: oid 103 version 67 is already newer than 65 2023-01-25T04:42:17.812 INFO:tasks.rados.rados.0.smithi116.stdout:103: oid 103 version 67 is already newer than 66 2023-01-25T04:42:17.812 INFO:tasks.rados.rados.0.smithi116.stdout:103: oid 103 version 67 is already newer than 64 2023-01-25T04:42:17.812 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 103 v 67 (ObjNum 102 snap 0 seq_num 102) dirty exists 2023-01-25T04:42:17.813 INFO:tasks.rados.rados.0.smithi116.stdout:103: left oid 103 (ObjNum 102 snap 0 seq_num 102) 2023-01-25T04:42:17.813 INFO:tasks.rados.rados.0.smithi116.stdout:104: finishing write tid 1 to smithi116107171-104 2023-01-25T04:42:17.813 INFO:tasks.rados.rados.0.smithi116.stdout:103: done (15 left) 2023-01-25T04:42:17.813 INFO:tasks.rados.rados.0.smithi116.stdout:119: write initial oid 119 2023-01-25T04:42:17.813 INFO:tasks.rados.rados.0.smithi116.stdout:119: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2023-01-25T04:42:17.817 INFO:tasks.rados.rados.0.smithi116.stdout:119: writing smithi116107171-119 from 783226 to 1407903 tid 1 2023-01-25T04:42:17.823 INFO:tasks.rados.rados.0.smithi116.stdout:119: writing smithi116107171-119 from 2071934 to 2506640 tid 2 2023-01-25T04:42:17.831 INFO:tasks.rados.rados.0.smithi116.stdout:119: writing smithi116107171-119 from 2974266 to 3613187 tid 3 2023-01-25T04:42:17.832 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.832 INFO:tasks.rados.rados.0.smithi116.stdout:104: finishing write tid 2 to smithi116107171-104 2023-01-25T04:42:17.832 INFO:tasks.rados.rados.0.smithi116.stdout:104: finishing write tid 3 to smithi116107171-104 2023-01-25T04:42:17.832 INFO:tasks.rados.rados.0.smithi116.stdout:104: finishing write tid 4 to smithi116107171-104 2023-01-25T04:42:17.833 INFO:tasks.rados.rados.0.smithi116.stdout:104: finishing write tid 5 to smithi116107171-104 2023-01-25T04:42:17.833 INFO:tasks.rados.rados.0.smithi116.stdout:104: oid 104 updating version 0 to 68 2023-01-25T04:42:17.833 INFO:tasks.rados.rados.0.smithi116.stdout:104: oid 104 updating version 68 to 71 2023-01-25T04:42:17.833 INFO:tasks.rados.rados.0.smithi116.stdout:104: oid 104 version 71 is already newer than 70 2023-01-25T04:42:17.833 INFO:tasks.rados.rados.0.smithi116.stdout:104: oid 104 version 71 is already newer than 69 2023-01-25T04:42:17.834 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 104 v 71 (ObjNum 103 snap 0 seq_num 103) dirty exists 2023-01-25T04:42:17.834 INFO:tasks.rados.rados.0.smithi116.stdout:104: left oid 104 (ObjNum 103 snap 0 seq_num 103) 2023-01-25T04:42:17.834 INFO:tasks.rados.rados.0.smithi116.stdout:105: finishing write tid 1 to smithi116107171-105 2023-01-25T04:42:17.834 INFO:tasks.rados.rados.0.smithi116.stdout:105: finishing write tid 2 to smithi116107171-105 2023-01-25T04:42:17.834 INFO:tasks.rados.rados.0.smithi116.stdout:105: finishing write tid 3 to smithi116107171-105 2023-01-25T04:42:17.835 INFO:tasks.rados.rados.0.smithi116.stdout:105: finishing write tid 4 to smithi116107171-105 2023-01-25T04:42:17.835 INFO:tasks.rados.rados.0.smithi116.stdout:105: finishing write tid 5 to smithi116107171-105 2023-01-25T04:42:17.835 INFO:tasks.rados.rados.0.smithi116.stdout:105: oid 105 updating version 0 to 54 2023-01-25T04:42:17.835 INFO:tasks.rados.rados.0.smithi116.stdout:105: oid 105 updating version 54 to 55 2023-01-25T04:42:17.835 INFO:tasks.rados.rados.0.smithi116.stdout:105: oid 105 updating version 55 to 56 2023-01-25T04:42:17.836 INFO:tasks.rados.rados.0.smithi116.stdout:105: oid 105 version 56 is already newer than 53 2023-01-25T04:42:17.836 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 105 v 56 (ObjNum 104 snap 0 seq_num 104) dirty exists 2023-01-25T04:42:17.836 INFO:tasks.rados.rados.0.smithi116.stdout:105: left oid 105 (ObjNum 104 snap 0 seq_num 104) 2023-01-25T04:42:17.836 INFO:tasks.rados.rados.0.smithi116.stdout:106: finishing write tid 1 to smithi116107171-106 2023-01-25T04:42:17.836 INFO:tasks.rados.rados.0.smithi116.stdout:106: finishing write tid 2 to smithi116107171-106 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: finishing write tid 3 to smithi116107171-106 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: finishing write tid 4 to smithi116107171-106 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: finishing write tid 5 to smithi116107171-106 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: oid 106 updating version 0 to 52 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: oid 106 version 52 is already newer than 51 2023-01-25T04:42:17.837 INFO:tasks.rados.rados.0.smithi116.stdout:106: oid 106 version 52 is already newer than 48 2023-01-25T04:42:17.838 INFO:tasks.rados.rados.0.smithi116.stdout:106: oid 106 version 52 is already newer than 49 2023-01-25T04:42:17.838 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 106 v 52 (ObjNum 105 snap 0 seq_num 105) dirty exists 2023-01-25T04:42:17.838 INFO:tasks.rados.rados.0.smithi116.stdout:106: left oid 106 (ObjNum 105 snap 0 seq_num 105) 2023-01-25T04:42:17.838 INFO:tasks.rados.rados.0.smithi116.stdout:107: finishing write tid 1 to smithi116107171-107 2023-01-25T04:42:17.838 INFO:tasks.rados.rados.0.smithi116.stdout:107: finishing write tid 2 to smithi116107171-107 2023-01-25T04:42:17.839 INFO:tasks.rados.rados.0.smithi116.stdout:107: finishing write tid 3 to smithi116107171-107 2023-01-25T04:42:17.839 INFO:tasks.rados.rados.0.smithi116.stdout:107: finishing write tid 4 to smithi116107171-107 2023-01-25T04:42:17.839 INFO:tasks.rados.rados.0.smithi116.stdout:107: finishing write tid 5 to smithi116107171-107 2023-01-25T04:42:17.839 INFO:tasks.rados.rados.0.smithi116.stdout:107: oid 107 updating version 0 to 52 2023-01-25T04:42:17.839 INFO:tasks.rados.rados.0.smithi116.stdout:107: oid 107 updating version 52 to 53 2023-01-25T04:42:17.840 INFO:tasks.rados.rados.0.smithi116.stdout:107: oid 107 version 53 is already newer than 51 2023-01-25T04:42:17.840 INFO:tasks.rados.rados.0.smithi116.stdout:107: oid 107 version 53 is already newer than 50 2023-01-25T04:42:17.840 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 107 v 53 (ObjNum 106 snap 0 seq_num 106) dirty exists 2023-01-25T04:42:17.840 INFO:tasks.rados.rados.0.smithi116.stdout:107: left oid 107 (ObjNum 106 snap 0 seq_num 106) 2023-01-25T04:42:17.840 INFO:tasks.rados.rados.0.smithi116.stdout:108: finishing write tid 1 to smithi116107171-108 2023-01-25T04:42:17.841 INFO:tasks.rados.rados.0.smithi116.stdout:108: finishing write tid 2 to smithi116107171-108 2023-01-25T04:42:17.841 INFO:tasks.rados.rados.0.smithi116.stdout:108: finishing write tid 3 to smithi116107171-108 2023-01-25T04:42:17.841 INFO:tasks.rados.rados.0.smithi116.stdout:108: finishing write tid 4 to smithi116107171-108 2023-01-25T04:42:17.841 INFO:tasks.rados.rados.0.smithi116.stdout:104: done (15 left) 2023-01-25T04:42:17.841 INFO:tasks.rados.rados.0.smithi116.stdout:105: done (14 left) 2023-01-25T04:42:17.842 INFO:tasks.rados.rados.0.smithi116.stdout:106: done (13 left) 2023-01-25T04:42:17.842 INFO:tasks.rados.rados.0.smithi116.stdout:107: done (12 left) 2023-01-25T04:42:17.842 INFO:tasks.rados.rados.0.smithi116.stdout:120: write initial oid 120 2023-01-25T04:42:17.842 INFO:tasks.rados.rados.0.smithi116.stdout:120: seq_num 119 ranges {400033=699926,1614063=385970} 2023-01-25T04:42:17.843 INFO:tasks.rados.rados.0.smithi116.stdout:120: writing smithi116107171-120 from 400033 to 1099959 tid 1 2023-01-25T04:42:17.843 INFO:tasks.rados.rados.0.smithi116.stdout:120: writing smithi116107171-120 from 1614063 to 2000033 tid 2 2023-01-25T04:42:17.843 INFO:tasks.rados.rados.0.smithi116.stdout:121: write initial oid 121 2023-01-25T04:42:17.844 INFO:tasks.rados.rados.0.smithi116.stdout:121: seq_num 120 ranges {416840=775175,1672545=344295} 2023-01-25T04:42:17.847 INFO:tasks.rados.rados.0.smithi116.stdout:121: writing smithi116107171-121 from 416840 to 1192015 tid 1 2023-01-25T04:42:17.851 INFO:tasks.rados.rados.0.smithi116.stdout:121: writing smithi116107171-121 from 1672545 to 2016840 tid 2 2023-01-25T04:42:17.851 INFO:tasks.rados.rados.0.smithi116.stdout:122: write initial oid 122 2023-01-25T04:42:17.852 INFO:tasks.rados.rados.0.smithi116.stdout:122: seq_num 121 ranges {433647=450424,1331027=582033} 2023-01-25T04:42:17.856 INFO:tasks.rados.rados.0.smithi116.stdout:122: writing smithi116107171-122 from 433647 to 884071 tid 1 2023-01-25T04:42:17.862 INFO:tasks.rados.rados.0.smithi116.stdout:122: writing smithi116107171-122 from 1331027 to 1913060 tid 2 2023-01-25T04:42:17.862 INFO:tasks.rados.rados.0.smithi116.stdout:123: write initial oid 123 2023-01-25T04:42:17.862 INFO:tasks.rados.rados.0.smithi116.stdout:123: seq_num 122 ranges {450454=642026,1505862=544592} 2023-01-25T04:42:17.868 INFO:tasks.rados.rados.0.smithi116.stdout:123: writing smithi116107171-123 from 450454 to 1092480 tid 1 2023-01-25T04:42:17.873 INFO:tasks.rados.rados.0.smithi116.stdout:123: writing smithi116107171-123 from 1505862 to 2050454 tid 2 2023-01-25T04:42:17.874 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.874 INFO:tasks.rados.rados.0.smithi116.stdout:108: finishing write tid 5 to smithi116107171-108 2023-01-25T04:42:17.874 INFO:tasks.rados.rados.0.smithi116.stdout:108: oid 108 updating version 0 to 75 2023-01-25T04:42:17.874 INFO:tasks.rados.rados.0.smithi116.stdout:108: oid 108 version 75 is already newer than 74 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:108: oid 108 version 75 is already newer than 73 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:108: oid 108 updating version 75 to 76 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 108 v 76 (ObjNum 107 snap 0 seq_num 107) dirty exists 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:108: left oid 108 (ObjNum 107 snap 0 seq_num 107) 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:109: finishing write tid 1 to smithi116107171-109 2023-01-25T04:42:17.875 INFO:tasks.rados.rados.0.smithi116.stdout:109: finishing write tid 2 to smithi116107171-109 2023-01-25T04:42:17.876 INFO:tasks.rados.rados.0.smithi116.stdout:108: done (15 left) 2023-01-25T04:42:17.876 INFO:tasks.rados.rados.0.smithi116.stdout:124: write initial oid 124 2023-01-25T04:42:17.876 INFO:tasks.rados.rados.0.smithi116.stdout:124: seq_num 123 ranges {467261=717275,1847991=219270} 2023-01-25T04:42:17.880 INFO:tasks.rados.rados.0.smithi116.stdout:124: writing smithi116107171-124 from 467261 to 1184536 tid 1 2023-01-25T04:42:17.885 INFO:tasks.rados.rados.0.smithi116.stdout:124: writing smithi116107171-124 from 1847991 to 2067261 tid 2 2023-01-25T04:42:17.886 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.886 INFO:tasks.rados.rados.0.smithi116.stdout:109: finishing write tid 3 to smithi116107171-109 2023-01-25T04:42:17.886 INFO:tasks.rados.rados.0.smithi116.stdout:109: finishing write tid 4 to smithi116107171-109 2023-01-25T04:42:17.886 INFO:tasks.rados.rados.0.smithi116.stdout:109: finishing write tid 5 to smithi116107171-109 2023-01-25T04:42:17.886 INFO:tasks.rados.rados.0.smithi116.stdout:109: oid 109 updating version 0 to 80 2023-01-25T04:42:17.887 INFO:tasks.rados.rados.0.smithi116.stdout:109: oid 109 version 80 is already newer than 79 2023-01-25T04:42:17.887 INFO:tasks.rados.rados.0.smithi116.stdout:109: oid 109 version 80 is already newer than 78 2023-01-25T04:42:17.887 INFO:tasks.rados.rados.0.smithi116.stdout:109: oid 109 version 80 is already newer than 77 2023-01-25T04:42:17.887 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 109 v 80 (ObjNum 108 snap 0 seq_num 108) dirty exists 2023-01-25T04:42:17.887 INFO:tasks.rados.rados.0.smithi116.stdout:109: left oid 109 (ObjNum 108 snap 0 seq_num 108) 2023-01-25T04:42:17.888 INFO:tasks.rados.rados.0.smithi116.stdout:110: finishing write tid 1 to smithi116107171-110 2023-01-25T04:42:17.888 INFO:tasks.rados.rados.0.smithi116.stdout:109: done (15 left) 2023-01-25T04:42:17.888 INFO:tasks.rados.rados.0.smithi116.stdout:125: write initial oid 125 2023-01-25T04:42:17.889 INFO:tasks.rados.rados.0.smithi116.stdout:125: seq_num 124 ranges {484068=792524,1906473=177595} 2023-01-25T04:42:17.892 INFO:tasks.rados.rados.0.smithi116.stdout:125: writing smithi116107171-125 from 484068 to 1276592 tid 1 2023-01-25T04:42:17.897 INFO:tasks.rados.rados.0.smithi116.stdout:125: writing smithi116107171-125 from 1906473 to 2084068 tid 2 2023-01-25T04:42:17.898 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.898 INFO:tasks.rados.rados.0.smithi116.stdout:110: finishing write tid 2 to smithi116107171-110 2023-01-25T04:42:17.898 INFO:tasks.rados.rados.0.smithi116.stdout:110: finishing write tid 3 to smithi116107171-110 2023-01-25T04:42:17.898 INFO:tasks.rados.rados.0.smithi116.stdout:110: finishing write tid 4 to smithi116107171-110 2023-01-25T04:42:17.898 INFO:tasks.rados.rados.0.smithi116.stdout:110: finishing write tid 5 to smithi116107171-110 2023-01-25T04:42:17.899 INFO:tasks.rados.rados.0.smithi116.stdout:110: oid 110 updating version 0 to 57 2023-01-25T04:42:17.899 INFO:tasks.rados.rados.0.smithi116.stdout:110: oid 110 version 57 is already newer than 56 2023-01-25T04:42:17.899 INFO:tasks.rados.rados.0.smithi116.stdout:110: oid 110 version 57 is already newer than 54 2023-01-25T04:42:17.900 INFO:tasks.rados.rados.0.smithi116.stdout:110: oid 110 version 57 is already newer than 55 2023-01-25T04:42:17.900 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 110 v 57 (ObjNum 109 snap 0 seq_num 109) dirty exists 2023-01-25T04:42:17.900 INFO:tasks.rados.rados.0.smithi116.stdout:110: left oid 110 (ObjNum 109 snap 0 seq_num 109) 2023-01-25T04:42:17.901 INFO:tasks.rados.rados.0.smithi116.stdout:111: finishing write tid 1 to smithi116107171-111 2023-01-25T04:42:17.901 INFO:tasks.rados.rados.0.smithi116.stdout:111: finishing write tid 2 to smithi116107171-111 2023-01-25T04:42:17.902 INFO:tasks.rados.rados.0.smithi116.stdout:111: finishing write tid 3 to smithi116107171-111 2023-01-25T04:42:17.902 INFO:tasks.rados.rados.0.smithi116.stdout:111: finishing write tid 4 to smithi116107171-111 2023-01-25T04:42:17.903 INFO:tasks.rados.rados.0.smithi116.stdout:111: finishing write tid 5 to smithi116107171-111 2023-01-25T04:42:17.903 INFO:tasks.rados.rados.0.smithi116.stdout:111: oid 111 updating version 0 to 81 2023-01-25T04:42:17.904 INFO:tasks.rados.rados.0.smithi116.stdout:111: oid 111 updating version 81 to 83 2023-01-25T04:42:17.904 INFO:tasks.rados.rados.0.smithi116.stdout:111: oid 111 updating version 83 to 84 2023-01-25T04:42:17.904 INFO:tasks.rados.rados.0.smithi116.stdout:111: oid 111 version 84 is already newer than 82 2023-01-25T04:42:17.905 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 111 v 84 (ObjNum 110 snap 0 seq_num 110) dirty exists 2023-01-25T04:42:17.906 INFO:tasks.rados.rados.0.smithi116.stdout:111: left oid 111 (ObjNum 110 snap 0 seq_num 110) 2023-01-25T04:42:17.906 INFO:tasks.rados.rados.0.smithi116.stdout:112: finishing write tid 1 to smithi116107171-112 2023-01-25T04:42:17.906 INFO:tasks.rados.rados.0.smithi116.stdout:112: finishing write tid 2 to smithi116107171-112 2023-01-25T04:42:17.906 INFO:tasks.rados.rados.0.smithi116.stdout:110: done (15 left) 2023-01-25T04:42:17.906 INFO:tasks.rados.rados.0.smithi116.stdout:111: done (14 left) 2023-01-25T04:42:17.907 INFO:tasks.rados.rados.0.smithi116.stdout:126: write initial oid 126 2023-01-25T04:42:17.907 INFO:tasks.rados.rados.0.smithi116.stdout:126: seq_num 125 ranges {500875=467773,1564955=535920} 2023-01-25T04:42:17.907 INFO:tasks.rados.rados.0.smithi116.stdout:126: writing smithi116107171-126 from 500875 to 968648 tid 1 2023-01-25T04:42:17.908 INFO:tasks.rados.rados.0.smithi116.stdout:126: writing smithi116107171-126 from 1564955 to 2100875 tid 2 2023-01-25T04:42:17.908 INFO:tasks.rados.rados.0.smithi116.stdout:127: write initial oid 127 2023-01-25T04:42:17.909 INFO:tasks.rados.rados.0.smithi116.stdout:127: seq_num 126 ranges {517682=543022,1623437=494245} 2023-01-25T04:42:17.914 INFO:tasks.rados.rados.0.smithi116.stdout:127: writing smithi116107171-127 from 517682 to 1060704 tid 1 2023-01-25T04:42:17.921 INFO:tasks.rados.rados.0.smithi116.stdout:127: writing smithi116107171-127 from 1623437 to 2117682 tid 2 2023-01-25T04:42:17.921 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.921 INFO:tasks.rados.rados.0.smithi116.stdout:112: finishing write tid 3 to smithi116107171-112 2023-01-25T04:42:17.921 INFO:tasks.rados.rados.0.smithi116.stdout:112: finishing write tid 4 to smithi116107171-112 2023-01-25T04:42:17.921 INFO:tasks.rados.rados.0.smithi116.stdout:112: finishing write tid 5 to smithi116107171-112 2023-01-25T04:42:17.922 INFO:tasks.rados.rados.0.smithi116.stdout:112: oid 112 updating version 0 to 75 2023-01-25T04:42:17.922 INFO:tasks.rados.rados.0.smithi116.stdout:112: oid 112 version 75 is already newer than 73 2023-01-25T04:42:17.922 INFO:tasks.rados.rados.0.smithi116.stdout:112: oid 112 version 75 is already newer than 74 2023-01-25T04:42:17.923 INFO:tasks.rados.rados.0.smithi116.stdout:112: oid 112 version 75 is already newer than 72 2023-01-25T04:42:17.923 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 112 v 75 (ObjNum 111 snap 0 seq_num 111) dirty exists 2023-01-25T04:42:17.923 INFO:tasks.rados.rados.0.smithi116.stdout:112: left oid 112 (ObjNum 111 snap 0 seq_num 111) 2023-01-25T04:42:17.923 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 1 to smithi116107171-113 2023-01-25T04:42:17.923 INFO:tasks.rados.rados.0.smithi116.stdout:112: done (15 left) 2023-01-25T04:42:17.924 INFO:tasks.rados.rados.0.smithi116.stdout:128: write initial oid 128 2023-01-25T04:42:17.924 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 2 to smithi116107171-113 2023-01-25T04:42:17.924 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 3 to smithi116107171-113 2023-01-25T04:42:17.924 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 4 to smithi116107171-113 2023-01-25T04:42:17.924 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 5 to smithi116107171-113 2023-01-25T04:42:17.925 INFO:tasks.rados.rados.0.smithi116.stdout:128: seq_num 127 ranges {534489=618271,1565566=568923} 2023-01-25T04:42:17.926 INFO:tasks.rados.rados.0.smithi116.stdout:128: writing smithi116107171-128 from 534489 to 1152760 tid 1 2023-01-25T04:42:17.932 INFO:tasks.rados.rados.0.smithi116.stdout:128: writing smithi116107171-128 from 1565566 to 2134489 tid 2 2023-01-25T04:42:17.932 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.932 INFO:tasks.rados.rados.0.smithi116.stdout:113: finishing write tid 6 to smithi116107171-113 2023-01-25T04:42:17.932 INFO:tasks.rados.rados.0.smithi116.stdout:113: oid 113 updating version 0 to 79 2023-01-25T04:42:17.933 INFO:tasks.rados.rados.0.smithi116.stdout:113: oid 113 version 79 is already newer than 77 2023-01-25T04:42:17.933 INFO:tasks.rados.rados.0.smithi116.stdout:113: oid 113 updating version 79 to 80 2023-01-25T04:42:17.933 INFO:tasks.rados.rados.0.smithi116.stdout:113: oid 113 version 80 is already newer than 78 2023-01-25T04:42:17.933 INFO:tasks.rados.rados.0.smithi116.stdout:113: oid 113 version 80 is already newer than 76 2023-01-25T04:42:17.933 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 113 v 80 (ObjNum 112 snap 0 seq_num 112) dirty exists 2023-01-25T04:42:17.934 INFO:tasks.rados.rados.0.smithi116.stdout:113: left oid 113 (ObjNum 112 snap 0 seq_num 112) 2023-01-25T04:42:17.934 INFO:tasks.rados.rados.0.smithi116.stdout:114: finishing write tid 1 to smithi116107171-114 2023-01-25T04:42:17.934 INFO:tasks.rados.rados.0.smithi116.stdout:114: finishing write tid 2 to smithi116107171-114 2023-01-25T04:42:17.934 INFO:tasks.rados.rados.0.smithi116.stdout:113: done (15 left) 2023-01-25T04:42:17.934 INFO:tasks.rados.rados.0.smithi116.stdout:129: write initial oid 129 2023-01-25T04:42:17.935 INFO:tasks.rados.rados.0.smithi116.stdout:129: seq_num 128 ranges {551296=693520,2024048=127248} 2023-01-25T04:42:17.938 INFO:tasks.rados.rados.0.smithi116.stdout:129: writing smithi116107171-129 from 551296 to 1244816 tid 1 2023-01-25T04:42:17.945 INFO:tasks.rados.rados.0.smithi116.stdout:129: writing smithi116107171-129 from 2024048 to 2151296 tid 2 2023-01-25T04:42:17.945 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.946 INFO:tasks.rados.rados.0.smithi116.stdout:114: finishing write tid 3 to smithi116107171-114 2023-01-25T04:42:17.946 INFO:tasks.rados.rados.0.smithi116.stdout:114: finishing write tid 4 to smithi116107171-114 2023-01-25T04:42:17.946 INFO:tasks.rados.rados.0.smithi116.stdout:114: finishing write tid 5 to smithi116107171-114 2023-01-25T04:42:17.946 INFO:tasks.rados.rados.0.smithi116.stdout:114: oid 114 updating version 0 to 83 2023-01-25T04:42:17.946 INFO:tasks.rados.rados.0.smithi116.stdout:114: oid 114 version 83 is already newer than 82 2023-01-25T04:42:17.947 INFO:tasks.rados.rados.0.smithi116.stdout:114: oid 114 updating version 83 to 84 2023-01-25T04:42:17.947 INFO:tasks.rados.rados.0.smithi116.stdout:114: oid 114 version 84 is already newer than 81 2023-01-25T04:42:17.947 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 114 v 84 (ObjNum 113 snap 0 seq_num 113) dirty exists 2023-01-25T04:42:17.947 INFO:tasks.rados.rados.0.smithi116.stdout:114: left oid 114 (ObjNum 113 snap 0 seq_num 113) 2023-01-25T04:42:17.947 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 1 to smithi116107171-115 2023-01-25T04:42:17.948 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 2 to smithi116107171-115 2023-01-25T04:42:17.948 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 3 to smithi116107171-115 2023-01-25T04:42:17.948 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 4 to smithi116107171-115 2023-01-25T04:42:17.948 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 5 to smithi116107171-115 2023-01-25T04:42:17.948 INFO:tasks.rados.rados.0.smithi116.stdout:115: finishing write tid 6 to smithi116107171-115 2023-01-25T04:42:17.949 INFO:tasks.rados.rados.0.smithi116.stdout:115: oid 115 updating version 0 to 58 2023-01-25T04:42:17.949 INFO:tasks.rados.rados.0.smithi116.stdout:115: oid 115 updating version 58 to 61 2023-01-25T04:42:17.949 INFO:tasks.rados.rados.0.smithi116.stdout:115: oid 115 updating version 61 to 62 2023-01-25T04:42:17.949 INFO:tasks.rados.rados.0.smithi116.stdout:115: oid 115 version 62 is already newer than 60 2023-01-25T04:42:17.950 INFO:tasks.rados.rados.0.smithi116.stdout:115: oid 115 version 62 is already newer than 59 2023-01-25T04:42:17.950 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 115 v 62 (ObjNum 114 snap 0 seq_num 114) dirty exists 2023-01-25T04:42:17.950 INFO:tasks.rados.rados.0.smithi116.stdout:115: left oid 115 (ObjNum 114 snap 0 seq_num 114) 2023-01-25T04:42:17.950 INFO:tasks.rados.rados.0.smithi116.stdout:116: finishing write tid 1 to smithi116107171-116 2023-01-25T04:42:17.951 INFO:tasks.rados.rados.0.smithi116.stdout:116: finishing write tid 2 to smithi116107171-116 2023-01-25T04:42:17.951 INFO:tasks.rados.rados.0.smithi116.stdout:116: finishing write tid 3 to smithi116107171-116 2023-01-25T04:42:17.951 INFO:tasks.rados.rados.0.smithi116.stdout:116: finishing write tid 4 to smithi116107171-116 2023-01-25T04:42:17.952 INFO:tasks.rados.rados.0.smithi116.stdout:116: finishing write tid 5 to smithi116107171-116 2023-01-25T04:42:17.952 INFO:tasks.rados.rados.0.smithi116.stdout:116: oid 116 updating version 0 to 85 2023-01-25T04:42:17.953 INFO:tasks.rados.rados.0.smithi116.stdout:116: oid 116 updating version 85 to 86 2023-01-25T04:42:17.953 INFO:tasks.rados.rados.0.smithi116.stdout:116: oid 116 updating version 86 to 88 2023-01-25T04:42:17.953 INFO:tasks.rados.rados.0.smithi116.stdout:116: oid 116 version 88 is already newer than 87 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 116 v 88 (ObjNum 115 snap 0 seq_num 115) dirty exists 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:116: left oid 116 (ObjNum 115 snap 0 seq_num 115) 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:117: finishing write tid 1 to smithi116107171-117 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:117: finishing write tid 2 to smithi116107171-117 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:117: finishing write tid 3 to smithi116107171-117 2023-01-25T04:42:17.954 INFO:tasks.rados.rados.0.smithi116.stdout:117: finishing write tid 4 to smithi116107171-117 2023-01-25T04:42:17.955 INFO:tasks.rados.rados.0.smithi116.stdout:117: finishing write tid 5 to smithi116107171-117 2023-01-25T04:42:17.955 INFO:tasks.rados.rados.0.smithi116.stdout:117: oid 117 updating version 0 to 85 2023-01-25T04:42:17.955 INFO:tasks.rados.rados.0.smithi116.stdout:117: oid 117 updating version 85 to 87 2023-01-25T04:42:17.955 INFO:tasks.rados.rados.0.smithi116.stdout:117: oid 117 version 87 is already newer than 86 2023-01-25T04:42:17.955 INFO:tasks.rados.rados.0.smithi116.stdout:117: oid 117 updating version 87 to 88 2023-01-25T04:42:17.956 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 117 v 88 (ObjNum 116 snap 0 seq_num 116) dirty exists 2023-01-25T04:42:17.956 INFO:tasks.rados.rados.0.smithi116.stdout:117: left oid 117 (ObjNum 116 snap 0 seq_num 116) 2023-01-25T04:42:17.956 INFO:tasks.rados.rados.0.smithi116.stdout:118: finishing write tid 1 to smithi116107171-118 2023-01-25T04:42:17.956 INFO:tasks.rados.rados.0.smithi116.stdout:114: done (15 left) 2023-01-25T04:42:17.956 INFO:tasks.rados.rados.0.smithi116.stdout:115: done (14 left) 2023-01-25T04:42:17.957 INFO:tasks.rados.rados.0.smithi116.stdout:116: done (13 left) 2023-01-25T04:42:17.957 INFO:tasks.rados.rados.0.smithi116.stdout:117: done (12 left) 2023-01-25T04:42:17.957 INFO:tasks.rados.rados.0.smithi116.stdout:130: write initial oid 130 2023-01-25T04:42:17.957 INFO:tasks.rados.rados.0.smithi116.stdout:130: seq_num 129 ranges {568103=768769,2082530=85573} 2023-01-25T04:42:17.958 INFO:tasks.rados.rados.0.smithi116.stdout:130: writing smithi116107171-130 from 568103 to 1336872 tid 1 2023-01-25T04:42:17.958 INFO:tasks.rados.rados.0.smithi116.stdout:130: writing smithi116107171-130 from 2082530 to 2168103 tid 2 2023-01-25T04:42:17.958 INFO:tasks.rados.rados.0.smithi116.stdout:131: write initial oid 131 2023-01-25T04:42:17.959 INFO:tasks.rados.rados.0.smithi116.stdout:131: seq_num 130 ranges {584910=560371,1857365=327545} 2023-01-25T04:42:17.961 INFO:tasks.rados.rados.0.smithi116.stdout:131: writing smithi116107171-131 from 584910 to 1145281 tid 1 2023-01-25T04:42:17.967 INFO:tasks.rados.rados.0.smithi116.stdout:131: writing smithi116107171-131 from 1857365 to 2184910 tid 2 2023-01-25T04:42:17.968 INFO:tasks.rados.rados.0.smithi116.stdout:132: write initial oid 132 2023-01-25T04:42:17.968 INFO:tasks.rados.rados.0.smithi116.stdout:132: seq_num 131 ranges {601717=635620,1799494=402223} 2023-01-25T04:42:17.974 INFO:tasks.rados.rados.0.smithi116.stdout:132: writing smithi116107171-132 from 601717 to 1237337 tid 1 2023-01-25T04:42:17.980 INFO:tasks.rados.rados.0.smithi116.stdout:132: writing smithi116107171-132 from 1799494 to 2201717 tid 2 2023-01-25T04:42:17.980 INFO:tasks.rados.rados.0.smithi116.stdout:133: write initial oid 133 2023-01-25T04:42:17.980 INFO:tasks.rados.rados.0.smithi116.stdout:133: seq_num 132 ranges {618524=710869,1857976=360548} 2023-01-25T04:42:17.987 INFO:tasks.rados.rados.0.smithi116.stdout:133: writing smithi116107171-133 from 618524 to 1329393 tid 1 2023-01-25T04:42:17.992 INFO:tasks.rados.rados.0.smithi116.stdout:133: writing smithi116107171-133 from 1857976 to 2218524 tid 2 2023-01-25T04:42:17.993 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:17.993 INFO:tasks.rados.rados.0.smithi116.stdout:118: finishing write tid 2 to smithi116107171-118 2023-01-25T04:42:17.993 INFO:tasks.rados.rados.0.smithi116.stdout:118: finishing write tid 3 to smithi116107171-118 2023-01-25T04:42:17.993 INFO:tasks.rados.rados.0.smithi116.stdout:118: finishing write tid 4 to smithi116107171-118 2023-01-25T04:42:17.993 INFO:tasks.rados.rados.0.smithi116.stdout:118: finishing write tid 5 to smithi116107171-118 2023-01-25T04:42:17.994 INFO:tasks.rados.rados.0.smithi116.stdout:118: oid 118 updating version 0 to 89 2023-01-25T04:42:17.994 INFO:tasks.rados.rados.0.smithi116.stdout:118: oid 118 updating version 89 to 90 2023-01-25T04:42:17.994 INFO:tasks.rados.rados.0.smithi116.stdout:118: oid 118 updating version 90 to 92 2023-01-25T04:42:17.994 INFO:tasks.rados.rados.0.smithi116.stdout:118: oid 118 version 92 is already newer than 91 2023-01-25T04:42:17.994 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 118 v 92 (ObjNum 117 snap 0 seq_num 117) dirty exists 2023-01-25T04:42:17.995 INFO:tasks.rados.rados.0.smithi116.stdout:118: left oid 118 (ObjNum 117 snap 0 seq_num 117) 2023-01-25T04:42:17.995 INFO:tasks.rados.rados.0.smithi116.stdout:119: finishing write tid 1 to smithi116107171-119 2023-01-25T04:42:17.995 INFO:tasks.rados.rados.0.smithi116.stdout:119: finishing write tid 2 to smithi116107171-119 2023-01-25T04:42:17.995 INFO:tasks.rados.rados.0.smithi116.stdout:118: done (15 left) 2023-01-25T04:42:17.996 INFO:tasks.rados.rados.0.smithi116.stdout:134: write initial oid 134 2023-01-25T04:42:17.996 INFO:tasks.rados.rados.0.smithi116.stdout:134: seq_num 133 ranges {635331=786118,1916458=318873} 2023-01-25T04:42:18.000 INFO:tasks.rados.rados.0.smithi116.stdout:134: writing smithi116107171-134 from 635331 to 1421449 tid 1 2023-01-25T04:42:18.005 INFO:tasks.rados.rados.0.smithi116.stdout:134: writing smithi116107171-134 from 1916458 to 2235331 tid 2 2023-01-25T04:42:18.005 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.005 INFO:tasks.rados.rados.0.smithi116.stdout:119: finishing write tid 3 to smithi116107171-119 2023-01-25T04:42:18.006 INFO:tasks.rados.rados.0.smithi116.stdout:119: finishing write tid 4 to smithi116107171-119 2023-01-25T04:42:18.006 INFO:tasks.rados.rados.0.smithi116.stdout:119: finishing write tid 5 to smithi116107171-119 2023-01-25T04:42:18.006 INFO:tasks.rados.rados.0.smithi116.stdout:119: oid 119 updating version 0 to 65 2023-01-25T04:42:18.006 INFO:tasks.rados.rados.0.smithi116.stdout:119: oid 119 version 65 is already newer than 64 2023-01-25T04:42:18.006 INFO:tasks.rados.rados.0.smithi116.stdout:119: oid 119 updating version 65 to 66 2023-01-25T04:42:18.007 INFO:tasks.rados.rados.0.smithi116.stdout:119: oid 119 version 66 is already newer than 63 2023-01-25T04:42:18.007 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 119 v 66 (ObjNum 118 snap 0 seq_num 118) dirty exists 2023-01-25T04:42:18.007 INFO:tasks.rados.rados.0.smithi116.stdout:119: left oid 119 (ObjNum 118 snap 0 seq_num 118) 2023-01-25T04:42:18.007 INFO:tasks.rados.rados.0.smithi116.stdout:120: finishing write tid 1 to smithi116107171-120 2023-01-25T04:42:18.007 INFO:tasks.rados.rados.0.smithi116.stdout:120: finishing write tid 2 to smithi116107171-120 2023-01-25T04:42:18.008 INFO:tasks.rados.rados.0.smithi116.stdout:120: finishing write tid 3 to smithi116107171-120 2023-01-25T04:42:18.008 INFO:tasks.rados.rados.0.smithi116.stdout:120: finishing write tid 4 to smithi116107171-120 2023-01-25T04:42:18.008 INFO:tasks.rados.rados.0.smithi116.stdout:120: oid 120 updating version 0 to 58 2023-01-25T04:42:18.008 INFO:tasks.rados.rados.0.smithi116.stdout:120: oid 120 updating version 58 to 59 2023-01-25T04:42:18.008 INFO:tasks.rados.rados.0.smithi116.stdout:120: oid 120 version 59 is already newer than 57 2023-01-25T04:42:18.009 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 120 v 59 (ObjNum 119 snap 0 seq_num 119) dirty exists 2023-01-25T04:42:18.009 INFO:tasks.rados.rados.0.smithi116.stdout:120: left oid 120 (ObjNum 119 snap 0 seq_num 119) 2023-01-25T04:42:18.009 INFO:tasks.rados.rados.0.smithi116.stdout:119: done (15 left) 2023-01-25T04:42:18.009 INFO:tasks.rados.rados.0.smithi116.stdout:120: done (14 left) 2023-01-25T04:42:18.010 INFO:tasks.rados.rados.0.smithi116.stdout:135: write initial oid 135 2023-01-25T04:42:18.010 INFO:tasks.rados.rados.0.smithi116.stdout:135: seq_num 134 ranges {652138=461367,1574940=677198} 2023-01-25T04:42:18.010 INFO:tasks.rados.rados.0.smithi116.stdout:135: writing smithi116107171-135 from 652138 to 1113505 tid 1 2023-01-25T04:42:18.017 INFO:tasks.rados.rados.0.smithi116.stdout:135: writing smithi116107171-135 from 1574940 to 2252138 tid 2 2023-01-25T04:42:18.017 INFO:tasks.rados.rados.0.smithi116.stdout:136: write initial oid 136 2023-01-25T04:42:18.017 INFO:tasks.rados.rados.0.smithi116.stdout:136: seq_num 135 ranges {668945=536616,1633422=491363} 2023-01-25T04:42:18.023 INFO:tasks.rados.rados.0.smithi116.stdout:136: writing smithi116107171-136 from 668945 to 1205561 tid 1 2023-01-25T04:42:18.029 INFO:tasks.rados.rados.0.smithi116.stdout:136: writing smithi116107171-136 from 1633422 to 2124785 tid 2 2023-01-25T04:42:18.029 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.030 INFO:tasks.rados.rados.0.smithi116.stdout:121: finishing write tid 1 to smithi116107171-121 2023-01-25T04:42:18.030 INFO:tasks.rados.rados.0.smithi116.stdout:121: finishing write tid 2 to smithi116107171-121 2023-01-25T04:42:18.030 INFO:tasks.rados.rados.0.smithi116.stdout:121: finishing write tid 3 to smithi116107171-121 2023-01-25T04:42:18.030 INFO:tasks.rados.rados.0.smithi116.stdout:121: finishing write tid 4 to smithi116107171-121 2023-01-25T04:42:18.030 INFO:tasks.rados.rados.0.smithi116.stdout:121: oid 121 updating version 0 to 67 2023-01-25T04:42:18.031 INFO:tasks.rados.rados.0.smithi116.stdout:121: oid 121 updating version 67 to 68 2023-01-25T04:42:18.031 INFO:tasks.rados.rados.0.smithi116.stdout:121: oid 121 updating version 68 to 69 2023-01-25T04:42:18.031 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 121 v 69 (ObjNum 120 snap 0 seq_num 120) dirty exists 2023-01-25T04:42:18.031 INFO:tasks.rados.rados.0.smithi116.stdout:121: left oid 121 (ObjNum 120 snap 0 seq_num 120) 2023-01-25T04:42:18.031 INFO:tasks.rados.rados.0.smithi116.stdout:122: finishing write tid 1 to smithi116107171-122 2023-01-25T04:42:18.032 INFO:tasks.rados.rados.0.smithi116.stdout:122: finishing write tid 2 to smithi116107171-122 2023-01-25T04:42:18.032 INFO:tasks.rados.rados.0.smithi116.stdout:122: finishing write tid 3 to smithi116107171-122 2023-01-25T04:42:18.032 INFO:tasks.rados.rados.0.smithi116.stdout:121: done (15 left) 2023-01-25T04:42:18.032 INFO:tasks.rados.rados.0.smithi116.stdout:137: write initial oid 137 2023-01-25T04:42:18.032 INFO:tasks.rados.rados.0.smithi116.stdout:137: seq_num 136 ranges {685752=611865,1975551=310201} 2023-01-25T04:42:18.035 INFO:tasks.rados.rados.0.smithi116.stdout:137: writing smithi116107171-137 from 685752 to 1297617 tid 1 2023-01-25T04:42:18.042 INFO:tasks.rados.rados.0.smithi116.stdout:137: writing smithi116107171-137 from 1975551 to 2285752 tid 2 2023-01-25T04:42:18.042 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.042 INFO:tasks.rados.rados.0.smithi116.stdout:122: finishing write tid 4 to smithi116107171-122 2023-01-25T04:42:18.043 INFO:tasks.rados.rados.0.smithi116.stdout:122: oid 122 updating version 0 to 60 2023-01-25T04:42:18.043 INFO:tasks.rados.rados.0.smithi116.stdout:122: oid 122 updating version 60 to 62 2023-01-25T04:42:18.043 INFO:tasks.rados.rados.0.smithi116.stdout:122: oid 122 version 62 is already newer than 61 2023-01-25T04:42:18.043 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 122 v 62 (ObjNum 121 snap 0 seq_num 121) dirty exists 2023-01-25T04:42:18.043 INFO:tasks.rados.rados.0.smithi116.stdout:122: left oid 122 (ObjNum 121 snap 0 seq_num 121) 2023-01-25T04:42:18.044 INFO:tasks.rados.rados.0.smithi116.stdout:123: finishing write tid 1 to smithi116107171-123 2023-01-25T04:42:18.044 INFO:tasks.rados.rados.0.smithi116.stdout:123: finishing write tid 2 to smithi116107171-123 2023-01-25T04:42:18.044 INFO:tasks.rados.rados.0.smithi116.stdout:123: finishing write tid 3 to smithi116107171-123 2023-01-25T04:42:18.044 INFO:tasks.rados.rados.0.smithi116.stdout:123: finishing write tid 4 to smithi116107171-123 2023-01-25T04:42:18.045 INFO:tasks.rados.rados.0.smithi116.stdout:123: oid 123 updating version 0 to 89 2023-01-25T04:42:18.045 INFO:tasks.rados.rados.0.smithi116.stdout:123: oid 123 updating version 89 to 90 2023-01-25T04:42:18.045 INFO:tasks.rados.rados.0.smithi116.stdout:123: oid 123 updating version 90 to 91 2023-01-25T04:42:18.045 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 123 v 91 (ObjNum 122 snap 0 seq_num 122) dirty exists 2023-01-25T04:42:18.045 INFO:tasks.rados.rados.0.smithi116.stdout:123: left oid 123 (ObjNum 122 snap 0 seq_num 122) 2023-01-25T04:42:18.046 INFO:tasks.rados.rados.0.smithi116.stdout:124: finishing write tid 1 to smithi116107171-124 2023-01-25T04:42:18.046 INFO:tasks.rados.rados.0.smithi116.stdout:124: finishing write tid 2 to smithi116107171-124 2023-01-25T04:42:18.046 INFO:tasks.rados.rados.0.smithi116.stdout:122: done (15 left) 2023-01-25T04:42:18.046 INFO:tasks.rados.rados.0.smithi116.stdout:123: done (14 left) 2023-01-25T04:42:18.046 INFO:tasks.rados.rados.0.smithi116.stdout:138: write initial oid 138 2023-01-25T04:42:18.047 INFO:tasks.rados.rados.0.smithi116.stdout:138: seq_num 137 ranges {702559=403467,1750386=495032} 2023-01-25T04:42:18.047 INFO:tasks.rados.rados.0.smithi116.stdout:138: writing smithi116107171-138 from 702559 to 1106026 tid 1 2023-01-25T04:42:18.053 INFO:tasks.rados.rados.0.smithi116.stdout:138: writing smithi116107171-138 from 1750386 to 2245418 tid 2 2023-01-25T04:42:18.054 INFO:tasks.rados.rados.0.smithi116.stdout:139: write initial oid 139 2023-01-25T04:42:18.054 INFO:tasks.rados.rados.0.smithi116.stdout:139: seq_num 138 ranges {719366=478716,1808868=510498} 2023-01-25T04:42:18.060 INFO:tasks.rados.rados.0.smithi116.stdout:139: writing smithi116107171-139 from 719366 to 1198082 tid 1 2023-01-25T04:42:18.066 INFO:tasks.rados.rados.0.smithi116.stdout:139: writing smithi116107171-139 from 1808868 to 2319366 tid 2 2023-01-25T04:42:18.067 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.067 INFO:tasks.rados.rados.0.smithi116.stdout:124: finishing write tid 3 to smithi116107171-124 2023-01-25T04:42:18.067 INFO:tasks.rados.rados.0.smithi116.stdout:124: finishing write tid 4 to smithi116107171-124 2023-01-25T04:42:18.067 INFO:tasks.rados.rados.0.smithi116.stdout:124: oid 124 updating version 0 to 64 2023-01-25T04:42:18.068 INFO:tasks.rados.rados.0.smithi116.stdout:124: oid 124 updating version 64 to 65 2023-01-25T04:42:18.068 INFO:tasks.rados.rados.0.smithi116.stdout:124: oid 124 version 65 is already newer than 63 2023-01-25T04:42:18.068 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 124 v 65 (ObjNum 123 snap 0 seq_num 123) dirty exists 2023-01-25T04:42:18.068 INFO:tasks.rados.rados.0.smithi116.stdout:124: left oid 124 (ObjNum 123 snap 0 seq_num 123) 2023-01-25T04:42:18.068 INFO:tasks.rados.rados.0.smithi116.stdout:124: done (15 left) 2023-01-25T04:42:18.069 INFO:tasks.rados.rados.0.smithi116.stdout:140: write initial oid 140 2023-01-25T04:42:18.069 INFO:tasks.rados.rados.0.smithi116.stdout:140: seq_num 139 ranges {736173=553965,1867350=468823} 2023-01-25T04:42:18.073 INFO:tasks.rados.rados.0.smithi116.stdout:140: writing smithi116107171-140 from 736173 to 1290138 tid 1 2023-01-25T04:42:18.080 INFO:tasks.rados.rados.0.smithi116.stdout:140: writing smithi116107171-140 from 1867350 to 2336173 tid 2 2023-01-25T04:42:18.080 INFO:tasks.rados.rados.0.smithi116.stdout:125: finishing write tid 1 to smithi116107171-125 2023-01-25T04:42:18.080 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.080 INFO:tasks.rados.rados.0.smithi116.stdout:125: finishing write tid 2 to smithi116107171-125 2023-01-25T04:42:18.080 INFO:tasks.rados.rados.0.smithi116.stdout:125: finishing write tid 3 to smithi116107171-125 2023-01-25T04:42:18.081 INFO:tasks.rados.rados.0.smithi116.stdout:125: finishing write tid 4 to smithi116107171-125 2023-01-25T04:42:18.081 INFO:tasks.rados.rados.0.smithi116.stdout:125: oid 125 updating version 0 to 94 2023-01-25T04:42:18.081 INFO:tasks.rados.rados.0.smithi116.stdout:125: oid 125 version 94 is already newer than 92 2023-01-25T04:42:18.081 INFO:tasks.rados.rados.0.smithi116.stdout:125: oid 125 version 94 is already newer than 93 2023-01-25T04:42:18.082 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 125 v 94 (ObjNum 124 snap 0 seq_num 124) dirty exists 2023-01-25T04:42:18.082 INFO:tasks.rados.rados.0.smithi116.stdout:125: left oid 125 (ObjNum 124 snap 0 seq_num 124) 2023-01-25T04:42:18.082 INFO:tasks.rados.rados.0.smithi116.stdout:126: finishing write tid 1 to smithi116107171-126 2023-01-25T04:42:18.083 INFO:tasks.rados.rados.0.smithi116.stdout:126: finishing write tid 2 to smithi116107171-126 2023-01-25T04:42:18.083 INFO:tasks.rados.rados.0.smithi116.stdout:126: finishing write tid 3 to smithi116107171-126 2023-01-25T04:42:18.083 INFO:tasks.rados.rados.0.smithi116.stdout:126: finishing write tid 4 to smithi116107171-126 2023-01-25T04:42:18.083 INFO:tasks.rados.rados.0.smithi116.stdout:126: oid 126 updating version 0 to 93 2023-01-25T04:42:18.083 INFO:tasks.rados.rados.0.smithi116.stdout:126: oid 126 updating version 93 to 94 2023-01-25T04:42:18.084 INFO:tasks.rados.rados.0.smithi116.stdout:126: oid 126 updating version 94 to 95 2023-01-25T04:42:18.084 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 126 v 95 (ObjNum 125 snap 0 seq_num 125) dirty exists 2023-01-25T04:42:18.084 INFO:tasks.rados.rados.0.smithi116.stdout:126: left oid 126 (ObjNum 125 snap 0 seq_num 125) 2023-01-25T04:42:18.084 INFO:tasks.rados.rados.0.smithi116.stdout:127: finishing write tid 1 to smithi116107171-127 2023-01-25T04:42:18.084 INFO:tasks.rados.rados.0.smithi116.stdout:127: finishing write tid 2 to smithi116107171-127 2023-01-25T04:42:18.085 INFO:tasks.rados.rados.0.smithi116.stdout:127: finishing write tid 3 to smithi116107171-127 2023-01-25T04:42:18.085 INFO:tasks.rados.rados.0.smithi116.stdout:125: done (15 left) 2023-01-25T04:42:18.085 INFO:tasks.rados.rados.0.smithi116.stdout:126: done (14 left) 2023-01-25T04:42:18.085 INFO:tasks.rados.rados.0.smithi116.stdout:141: write initial oid 141 2023-01-25T04:42:18.086 INFO:tasks.rados.rados.0.smithi116.stdout:141: seq_num 140 ranges {752980=629214,1809479=543501} 2023-01-25T04:42:18.087 INFO:tasks.rados.rados.0.smithi116.stdout:141: writing smithi116107171-141 from 752980 to 1382194 tid 1 2023-01-25T04:42:18.092 INFO:tasks.rados.rados.0.smithi116.stdout:141: writing smithi116107171-141 from 1809479 to 2352980 tid 2 2023-01-25T04:42:18.093 INFO:tasks.rados.rados.0.smithi116.stdout:142: write initial oid 142 2023-01-25T04:42:18.093 INFO:tasks.rados.rados.0.smithi116.stdout:142: seq_num 141 ranges {769787=704463,2267961=101826} 2023-01-25T04:42:18.100 INFO:tasks.rados.rados.0.smithi116.stdout:142: writing smithi116107171-142 from 769787 to 1474250 tid 1 2023-01-25T04:42:18.106 INFO:tasks.rados.rados.0.smithi116.stdout:142: writing smithi116107171-142 from 2267961 to 2369787 tid 2 2023-01-25T04:42:18.106 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.106 INFO:tasks.rados.rados.0.smithi116.stdout:127: finishing write tid 4 to smithi116107171-127 2023-01-25T04:42:18.107 INFO:tasks.rados.rados.0.smithi116.stdout:127: oid 127 updating version 0 to 95 2023-01-25T04:42:18.107 INFO:tasks.rados.rados.0.smithi116.stdout:127: oid 127 updating version 95 to 97 2023-01-25T04:42:18.107 INFO:tasks.rados.rados.0.smithi116.stdout:127: oid 127 version 97 is already newer than 96 2023-01-25T04:42:18.107 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 127 v 97 (ObjNum 126 snap 0 seq_num 126) dirty exists 2023-01-25T04:42:18.107 INFO:tasks.rados.rados.0.smithi116.stdout:127: left oid 127 (ObjNum 126 snap 0 seq_num 126) 2023-01-25T04:42:18.108 INFO:tasks.rados.rados.0.smithi116.stdout:128: finishing write tid 1 to smithi116107171-128 2023-01-25T04:42:18.108 INFO:tasks.rados.rados.0.smithi116.stdout:128: finishing write tid 2 to smithi116107171-128 2023-01-25T04:42:18.108 INFO:tasks.rados.rados.0.smithi116.stdout:127: done (15 left) 2023-01-25T04:42:18.108 INFO:tasks.rados.rados.0.smithi116.stdout:143: write initial oid 143 2023-01-25T04:42:18.108 INFO:tasks.rados.rados.0.smithi116.stdout:143: seq_num 142 ranges {786594=779712,2326443=60151} 2023-01-25T04:42:18.114 INFO:tasks.rados.rados.0.smithi116.stdout:143: writing smithi116107171-143 from 786594 to 1566306 tid 1 2023-01-25T04:42:18.120 INFO:tasks.rados.rados.0.smithi116.stdout:143: writing smithi116107171-143 from 2326443 to 2386594 tid 2 2023-01-25T04:42:18.120 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.120 INFO:tasks.rados.rados.0.smithi116.stdout:128: finishing write tid 3 to smithi116107171-128 2023-01-25T04:42:18.120 INFO:tasks.rados.rados.0.smithi116.stdout:128: finishing write tid 4 to smithi116107171-128 2023-01-25T04:42:18.121 INFO:tasks.rados.rados.0.smithi116.stdout:128: oid 128 updating version 0 to 97 2023-01-25T04:42:18.121 INFO:tasks.rados.rados.0.smithi116.stdout:128: oid 128 updating version 97 to 98 2023-01-25T04:42:18.121 INFO:tasks.rados.rados.0.smithi116.stdout:128: oid 128 version 98 is already newer than 96 2023-01-25T04:42:18.121 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 128 v 98 (ObjNum 127 snap 0 seq_num 127) dirty exists 2023-01-25T04:42:18.122 INFO:tasks.rados.rados.0.smithi116.stdout:128: left oid 128 (ObjNum 127 snap 0 seq_num 127) 2023-01-25T04:42:18.123 INFO:tasks.rados.rados.0.smithi116.stdout:129: finishing write tid 1 to smithi116107171-129 2023-01-25T04:42:18.123 INFO:tasks.rados.rados.0.smithi116.stdout:129: finishing write tid 2 to smithi116107171-129 2023-01-25T04:42:18.123 INFO:tasks.rados.rados.0.smithi116.stdout:129: finishing write tid 3 to smithi116107171-129 2023-01-25T04:42:18.124 INFO:tasks.rados.rados.0.smithi116.stdout:129: finishing write tid 4 to smithi116107171-129 2023-01-25T04:42:18.124 INFO:tasks.rados.rados.0.smithi116.stdout:129: oid 129 updating version 0 to 70 2023-01-25T04:42:18.124 INFO:tasks.rados.rados.0.smithi116.stdout:129: oid 129 updating version 70 to 72 2023-01-25T04:42:18.124 INFO:tasks.rados.rados.0.smithi116.stdout:129: oid 129 version 72 is already newer than 71 2023-01-25T04:42:18.124 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 129 v 72 (ObjNum 128 snap 0 seq_num 128) dirty exists 2023-01-25T04:42:18.125 INFO:tasks.rados.rados.0.smithi116.stdout:129: left oid 129 (ObjNum 128 snap 0 seq_num 128) 2023-01-25T04:42:18.125 INFO:tasks.rados.rados.0.smithi116.stdout:130: finishing write tid 1 to smithi116107171-130 2023-01-25T04:42:18.125 INFO:tasks.rados.rados.0.smithi116.stdout:128: done (15 left) 2023-01-25T04:42:18.125 INFO:tasks.rados.rados.0.smithi116.stdout:129: done (14 left) 2023-01-25T04:42:18.125 INFO:tasks.rados.rados.0.smithi116.stdout:144: write initial oid 144 2023-01-25T04:42:18.126 INFO:tasks.rados.rados.0.smithi116.stdout:144: seq_num 143 ranges {403401=454961,1584925=506039} 2023-01-25T04:42:18.126 INFO:tasks.rados.rados.0.smithi116.stdout:144: writing smithi116107171-144 from 403401 to 858362 tid 1 2023-01-25T04:42:18.130 INFO:tasks.rados.rados.0.smithi116.stdout:144: writing smithi116107171-144 from 1584925 to 2090964 tid 2 2023-01-25T04:42:18.130 INFO:tasks.rados.rados.0.smithi116.stdout:145: write initial oid 145 2023-01-25T04:42:18.130 INFO:tasks.rados.rados.0.smithi116.stdout:145: seq_num 144 ranges {420208=530210,1527054=766050} 2023-01-25T04:42:18.135 INFO:tasks.rados.rados.0.smithi116.stdout:145: writing smithi116107171-145 from 420208 to 950418 tid 1 2023-01-25T04:42:18.143 INFO:tasks.rados.rados.0.smithi116.stdout:145: writing smithi116107171-145 from 1527054 to 2293104 tid 2 2023-01-25T04:42:18.143 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.143 INFO:tasks.rados.rados.0.smithi116.stdout:130: finishing write tid 2 to smithi116107171-130 2023-01-25T04:42:18.143 INFO:tasks.rados.rados.0.smithi116.stdout:130: finishing write tid 3 to smithi116107171-130 2023-01-25T04:42:18.144 INFO:tasks.rados.rados.0.smithi116.stdout:130: finishing write tid 4 to smithi116107171-130 2023-01-25T04:42:18.144 INFO:tasks.rados.rados.0.smithi116.stdout:130: oid 130 updating version 0 to 67 2023-01-25T04:42:18.144 INFO:tasks.rados.rados.0.smithi116.stdout:130: oid 130 version 67 is already newer than 66 2023-01-25T04:42:18.144 INFO:tasks.rados.rados.0.smithi116.stdout:130: oid 130 updating version 67 to 68 2023-01-25T04:42:18.144 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 130 v 68 (ObjNum 129 snap 0 seq_num 129) dirty exists 2023-01-25T04:42:18.145 INFO:tasks.rados.rados.0.smithi116.stdout:130: left oid 130 (ObjNum 129 snap 0 seq_num 129) 2023-01-25T04:42:18.145 INFO:tasks.rados.rados.0.smithi116.stdout:131: finishing write tid 1 to smithi116107171-131 2023-01-25T04:42:18.145 INFO:tasks.rados.rados.0.smithi116.stdout:131: finishing write tid 2 to smithi116107171-131 2023-01-25T04:42:18.145 INFO:tasks.rados.rados.0.smithi116.stdout:131: finishing write tid 3 to smithi116107171-131 2023-01-25T04:42:18.145 INFO:tasks.rados.rados.0.smithi116.stdout:130: done (15 left) 2023-01-25T04:42:18.146 INFO:tasks.rados.rados.0.smithi116.stdout:146: write initial oid 146 2023-01-25T04:42:18.146 INFO:tasks.rados.rados.0.smithi116.stdout:146: seq_num 145 ranges {437015=721812,1701889=509708} 2023-01-25T04:42:18.148 INFO:tasks.rados.rados.0.smithi116.stdout:146: writing smithi116107171-146 from 437015 to 1158827 tid 1 2023-01-25T04:42:18.154 INFO:tasks.rados.rados.0.smithi116.stdout:146: writing smithi116107171-146 from 1701889 to 2211597 tid 2 2023-01-25T04:42:18.155 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.155 INFO:tasks.rados.rados.0.smithi116.stdout:131: finishing write tid 4 to smithi116107171-131 2023-01-25T04:42:18.155 INFO:tasks.rados.rados.0.smithi116.stdout:131: oid 131 updating version 0 to 71 2023-01-25T04:42:18.155 INFO:tasks.rados.rados.0.smithi116.stdout:131: oid 131 version 71 is already newer than 69 2023-01-25T04:42:18.155 INFO:tasks.rados.rados.0.smithi116.stdout:131: oid 131 version 71 is already newer than 70 2023-01-25T04:42:18.156 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 131 v 71 (ObjNum 130 snap 0 seq_num 130) dirty exists 2023-01-25T04:42:18.156 INFO:tasks.rados.rados.0.smithi116.stdout:131: left oid 131 (ObjNum 130 snap 0 seq_num 130) 2023-01-25T04:42:18.156 INFO:tasks.rados.rados.0.smithi116.stdout:132: finishing write tid 1 to smithi116107171-132 2023-01-25T04:42:18.156 INFO:tasks.rados.rados.0.smithi116.stdout:132: finishing write tid 2 to smithi116107171-132 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:132: finishing write tid 3 to smithi116107171-132 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:132: finishing write tid 4 to smithi116107171-132 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:132: oid 132 updating version 0 to 98 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:132: oid 132 updating version 98 to 100 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:132: oid 132 version 100 is already newer than 99 2023-01-25T04:42:18.157 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 132 v 100 (ObjNum 131 snap 0 seq_num 131) dirty exists 2023-01-25T04:42:18.158 INFO:tasks.rados.rados.0.smithi116.stdout:132: left oid 132 (ObjNum 131 snap 0 seq_num 131) 2023-01-25T04:42:18.158 INFO:tasks.rados.rados.0.smithi116.stdout:133: finishing write tid 1 to smithi116107171-133 2023-01-25T04:42:18.158 INFO:tasks.rados.rados.0.smithi116.stdout:133: finishing write tid 2 to smithi116107171-133 2023-01-25T04:42:18.158 INFO:tasks.rados.rados.0.smithi116.stdout:133: finishing write tid 3 to smithi116107171-133 2023-01-25T04:42:18.158 INFO:tasks.rados.rados.0.smithi116.stdout:133: finishing write tid 4 to smithi116107171-133 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:133: oid 133 updating version 0 to 101 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:133: oid 133 updating version 101 to 103 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:133: oid 133 version 103 is already newer than 102 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 133 v 103 (ObjNum 132 snap 0 seq_num 132) dirty exists 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:133: left oid 133 (ObjNum 132 snap 0 seq_num 132) 2023-01-25T04:42:18.159 INFO:tasks.rados.rados.0.smithi116.stdout:134: finishing write tid 1 to smithi116107171-134 2023-01-25T04:42:18.160 INFO:tasks.rados.rados.0.smithi116.stdout:134: finishing write tid 2 to smithi116107171-134 2023-01-25T04:42:18.160 INFO:tasks.rados.rados.0.smithi116.stdout:131: done (15 left) 2023-01-25T04:42:18.160 INFO:tasks.rados.rados.0.smithi116.stdout:132: done (14 left) 2023-01-25T04:42:18.160 INFO:tasks.rados.rados.0.smithi116.stdout:133: done (13 left) 2023-01-25T04:42:18.160 INFO:tasks.rados.rados.0.smithi116.stdout:147: write initial oid 147 2023-01-25T04:42:18.161 INFO:tasks.rados.rados.0.smithi116.stdout:147: seq_num 146 ranges {453822=797061,1760371=653366} 2023-01-25T04:42:18.161 INFO:tasks.rados.rados.0.smithi116.stdout:147: writing smithi116107171-147 from 453822 to 1250883 tid 1 2023-01-25T04:42:18.167 INFO:tasks.rados.rados.0.smithi116.stdout:147: writing smithi116107171-147 from 1760371 to 2413737 tid 2 2023-01-25T04:42:18.168 INFO:tasks.rados.rados.0.smithi116.stdout:148: write initial oid 148 2023-01-25T04:42:18.168 INFO:tasks.rados.rados.0.smithi116.stdout:148: seq_num 147 ranges {470629=472310,1418853=513377} 2023-01-25T04:42:18.172 INFO:tasks.rados.rados.0.smithi116.stdout:148: writing smithi116107171-148 from 470629 to 942939 tid 1 2023-01-25T04:42:18.178 INFO:tasks.rados.rados.0.smithi116.stdout:148: writing smithi116107171-148 from 1418853 to 1932230 tid 2 2023-01-25T04:42:18.178 INFO:tasks.rados.rados.0.smithi116.stdout:149: write initial oid 149 2023-01-25T04:42:18.179 INFO:tasks.rados.rados.0.smithi116.stdout:149: seq_num 148 ranges {487436=547559,1760982=657035} 2023-01-25T04:42:18.184 INFO:tasks.rados.rados.0.smithi116.stdout:149: writing smithi116107171-149 from 487436 to 1034995 tid 1 2023-01-25T04:42:18.192 INFO:tasks.rados.rados.0.smithi116.stdout:149: writing smithi116107171-149 from 1760982 to 2418017 tid 2 2023-01-25T04:42:18.192 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.193 INFO:tasks.rados.rados.0.smithi116.stdout:134: finishing write tid 3 to smithi116107171-134 2023-01-25T04:42:18.193 INFO:tasks.rados.rados.0.smithi116.stdout:134: finishing write tid 4 to smithi116107171-134 2023-01-25T04:42:18.193 INFO:tasks.rados.rados.0.smithi116.stdout:134: oid 134 updating version 0 to 101 2023-01-25T04:42:18.193 INFO:tasks.rados.rados.0.smithi116.stdout:134: oid 134 version 101 is already newer than 99 2023-01-25T04:42:18.193 INFO:tasks.rados.rados.0.smithi116.stdout:134: oid 134 version 101 is already newer than 100 2023-01-25T04:42:18.194 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 134 v 101 (ObjNum 133 snap 0 seq_num 133) dirty exists 2023-01-25T04:42:18.194 INFO:tasks.rados.rados.0.smithi116.stdout:134: left oid 134 (ObjNum 133 snap 0 seq_num 133) 2023-01-25T04:42:18.194 INFO:tasks.rados.rados.0.smithi116.stdout:135: finishing write tid 1 to smithi116107171-135 2023-01-25T04:42:18.194 INFO:tasks.rados.rados.0.smithi116.stdout:134: done (15 left) 2023-01-25T04:42:18.194 INFO:tasks.rados.rados.0.smithi116.stdout:150: write initial oid 150 2023-01-25T04:42:18.195 INFO:tasks.rados.rados.0.smithi116.stdout:150: seq_num 149 ranges {504243=622808,1819464=517046} 2023-01-25T04:42:18.198 INFO:tasks.rados.rados.0.smithi116.stdout:150: writing smithi116107171-150 from 504243 to 1127051 tid 1 2023-01-25T04:42:18.205 INFO:tasks.rados.rados.0.smithi116.stdout:150: writing smithi116107171-150 from 1819464 to 2336510 tid 2 2023-01-25T04:42:18.205 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.205 INFO:tasks.rados.rados.0.smithi116.stdout:135: finishing write tid 2 to smithi116107171-135 2023-01-25T04:42:18.205 INFO:tasks.rados.rados.0.smithi116.stdout:135: finishing write tid 3 to smithi116107171-135 2023-01-25T04:42:18.206 INFO:tasks.rados.rados.0.smithi116.stdout:135: finishing write tid 4 to smithi116107171-135 2023-01-25T04:42:18.206 INFO:tasks.rados.rados.0.smithi116.stdout:135: oid 135 updating version 0 to 75 2023-01-25T04:42:18.206 INFO:tasks.rados.rados.0.smithi116.stdout:135: oid 135 version 75 is already newer than 74 2023-01-25T04:42:18.206 INFO:tasks.rados.rados.0.smithi116.stdout:135: oid 135 version 75 is already newer than 73 2023-01-25T04:42:18.206 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 135 v 75 (ObjNum 134 snap 0 seq_num 134) dirty exists 2023-01-25T04:42:18.207 INFO:tasks.rados.rados.0.smithi116.stdout:135: left oid 135 (ObjNum 134 snap 0 seq_num 134) 2023-01-25T04:42:18.207 INFO:tasks.rados.rados.0.smithi116.stdout:136: finishing write tid 1 to smithi116107171-136 2023-01-25T04:42:18.207 INFO:tasks.rados.rados.0.smithi116.stdout:136: finishing write tid 2 to smithi116107171-136 2023-01-25T04:42:18.207 INFO:tasks.rados.rados.0.smithi116.stdout:136: finishing write tid 3 to smithi116107171-136 2023-01-25T04:42:18.207 INFO:tasks.rados.rados.0.smithi116.stdout:135: done (15 left) 2023-01-25T04:42:18.208 INFO:tasks.rados.rados.0.smithi116.stdout:151: write initial oid 151 2023-01-25T04:42:18.208 INFO:tasks.rados.rados.0.smithi116.stdout:151: seq_num 150 ranges {521050=698057,1877946=643104} 2023-01-25T04:42:18.211 INFO:tasks.rados.rados.0.smithi116.stdout:151: writing smithi116107171-151 from 521050 to 1219107 tid 1 2023-01-25T04:42:18.218 INFO:tasks.rados.rados.0.smithi116.stdout:151: writing smithi116107171-151 from 1877946 to 2521050 tid 2 2023-01-25T04:42:18.219 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.219 INFO:tasks.rados.rados.0.smithi116.stdout:136: finishing write tid 4 to smithi116107171-136 2023-01-25T04:42:18.219 INFO:tasks.rados.rados.0.smithi116.stdout:136: oid 136 updating version 0 to 106 2023-01-25T04:42:18.219 INFO:tasks.rados.rados.0.smithi116.stdout:136: oid 136 version 106 is already newer than 105 2023-01-25T04:42:18.219 INFO:tasks.rados.rados.0.smithi116.stdout:136: oid 136 version 106 is already newer than 104 2023-01-25T04:42:18.220 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 136 v 106 (ObjNum 135 snap 0 seq_num 135) dirty exists 2023-01-25T04:42:18.220 INFO:tasks.rados.rados.0.smithi116.stdout:136: left oid 136 (ObjNum 135 snap 0 seq_num 135) 2023-01-25T04:42:18.220 INFO:tasks.rados.rados.0.smithi116.stdout:137: finishing write tid 1 to smithi116107171-137 2023-01-25T04:42:18.220 INFO:tasks.rados.rados.0.smithi116.stdout:137: finishing write tid 2 to smithi116107171-137 2023-01-25T04:42:18.221 INFO:tasks.rados.rados.0.smithi116.stdout:136: done (15 left) 2023-01-25T04:42:18.221 INFO:tasks.rados.rados.0.smithi116.stdout:152: write initial oid 152 2023-01-25T04:42:18.221 INFO:tasks.rados.rados.0.smithi116.stdout:152: seq_num 151 ranges {537857=773306,1936428=520715} 2023-01-25T04:42:18.225 INFO:tasks.rados.rados.0.smithi116.stdout:152: writing smithi116107171-152 from 537857 to 1311163 tid 1 2023-01-25T04:42:18.232 INFO:tasks.rados.rados.0.smithi116.stdout:152: writing smithi116107171-152 from 1936428 to 2457143 tid 2 2023-01-25T04:42:18.232 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.232 INFO:tasks.rados.rados.0.smithi116.stdout:137: finishing write tid 3 to smithi116107171-137 2023-01-25T04:42:18.233 INFO:tasks.rados.rados.0.smithi116.stdout:137: finishing write tid 4 to smithi116107171-137 2023-01-25T04:42:18.233 INFO:tasks.rados.rados.0.smithi116.stdout:137: oid 137 updating version 0 to 104 2023-01-25T04:42:18.233 INFO:tasks.rados.rados.0.smithi116.stdout:137: oid 137 version 104 is already newer than 103 2023-01-25T04:42:18.233 INFO:tasks.rados.rados.0.smithi116.stdout:137: oid 137 version 104 is already newer than 102 2023-01-25T04:42:18.233 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 137 v 104 (ObjNum 136 snap 0 seq_num 136) dirty exists 2023-01-25T04:42:18.234 INFO:tasks.rados.rados.0.smithi116.stdout:137: left oid 137 (ObjNum 136 snap 0 seq_num 136) 2023-01-25T04:42:18.234 INFO:tasks.rados.rados.0.smithi116.stdout:138: finishing write tid 1 to smithi116107171-138 2023-01-25T04:42:18.234 INFO:tasks.rados.rados.0.smithi116.stdout:137: done (15 left) 2023-01-25T04:42:18.234 INFO:tasks.rados.rados.0.smithi116.stdout:153: write initial oid 153 2023-01-25T04:42:18.234 INFO:tasks.rados.rados.0.smithi116.stdout:153: seq_num 152 ranges {554664=448555,1478557=664373} 2023-01-25T04:42:18.237 INFO:tasks.rados.rados.0.smithi116.stdout:153: writing smithi116107171-153 from 554664 to 1003219 tid 1 2023-01-25T04:42:18.244 INFO:tasks.rados.rados.0.smithi116.stdout:153: writing smithi116107171-153 from 1478557 to 2142930 tid 2 2023-01-25T04:42:18.245 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.245 INFO:tasks.rados.rados.0.smithi116.stdout:138: finishing write tid 2 to smithi116107171-138 2023-01-25T04:42:18.245 INFO:tasks.rados.rados.0.smithi116.stdout:138: finishing write tid 3 to smithi116107171-138 2023-01-25T04:42:18.245 INFO:tasks.rados.rados.0.smithi116.stdout:138: finishing write tid 4 to smithi116107171-138 2023-01-25T04:42:18.245 INFO:tasks.rados.rados.0.smithi116.stdout:138: oid 138 updating version 0 to 73 2023-01-25T04:42:18.246 INFO:tasks.rados.rados.0.smithi116.stdout:138: oid 138 version 73 is already newer than 72 2023-01-25T04:42:18.246 INFO:tasks.rados.rados.0.smithi116.stdout:138: oid 138 updating version 73 to 74 2023-01-25T04:42:18.246 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 138 v 74 (ObjNum 137 snap 0 seq_num 137) dirty exists 2023-01-25T04:42:18.246 INFO:tasks.rados.rados.0.smithi116.stdout:138: left oid 138 (ObjNum 137 snap 0 seq_num 137) 2023-01-25T04:42:18.246 INFO:tasks.rados.rados.0.smithi116.stdout:139: finishing write tid 1 to smithi116107171-139 2023-01-25T04:42:18.247 INFO:tasks.rados.rados.0.smithi116.stdout:138: done (15 left) 2023-01-25T04:42:18.247 INFO:tasks.rados.rados.0.smithi116.stdout:154: write initial oid 154 2023-01-25T04:42:18.247 INFO:tasks.rados.rados.0.smithi116.stdout:154: seq_num 153 ranges {571471=640157,1653392=524384} 2023-01-25T04:42:18.250 INFO:tasks.rados.rados.0.smithi116.stdout:154: writing smithi116107171-154 from 571471 to 1211628 tid 1 2023-01-25T04:42:18.259 INFO:tasks.rados.rados.0.smithi116.stdout:154: writing smithi116107171-154 from 1653392 to 2177776 tid 2 2023-01-25T04:42:18.259 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.259 INFO:tasks.rados.rados.0.smithi116.stdout:139: finishing write tid 2 to smithi116107171-139 2023-01-25T04:42:18.260 INFO:tasks.rados.rados.0.smithi116.stdout:139: finishing write tid 3 to smithi116107171-139 2023-01-25T04:42:18.260 INFO:tasks.rados.rados.0.smithi116.stdout:139: finishing write tid 4 to smithi116107171-139 2023-01-25T04:42:18.260 INFO:tasks.rados.rados.0.smithi116.stdout:139: oid 139 updating version 0 to 75 2023-01-25T04:42:18.260 INFO:tasks.rados.rados.0.smithi116.stdout:139: oid 139 updating version 75 to 77 2023-01-25T04:42:18.260 INFO:tasks.rados.rados.0.smithi116.stdout:139: oid 139 version 77 is already newer than 76 2023-01-25T04:42:18.261 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 139 v 77 (ObjNum 138 snap 0 seq_num 138) dirty exists 2023-01-25T04:42:18.261 INFO:tasks.rados.rados.0.smithi116.stdout:139: left oid 139 (ObjNum 138 snap 0 seq_num 138) 2023-01-25T04:42:18.261 INFO:tasks.rados.rados.0.smithi116.stdout:140: finishing write tid 1 to smithi116107171-140 2023-01-25T04:42:18.261 INFO:tasks.rados.rados.0.smithi116.stdout:140: finishing write tid 2 to smithi116107171-140 2023-01-25T04:42:18.261 INFO:tasks.rados.rados.0.smithi116.stdout:140: finishing write tid 3 to smithi116107171-140 2023-01-25T04:42:18.262 INFO:tasks.rados.rados.0.smithi116.stdout:140: finishing write tid 4 to smithi116107171-140 2023-01-25T04:42:18.262 INFO:tasks.rados.rados.0.smithi116.stdout:140: oid 140 updating version 0 to 109 2023-01-25T04:42:18.262 INFO:tasks.rados.rados.0.smithi116.stdout:140: oid 140 version 109 is already newer than 108 2023-01-25T04:42:18.262 INFO:tasks.rados.rados.0.smithi116.stdout:140: oid 140 version 109 is already newer than 107 2023-01-25T04:42:18.262 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 140 v 109 (ObjNum 139 snap 0 seq_num 139) dirty exists 2023-01-25T04:42:18.263 INFO:tasks.rados.rados.0.smithi116.stdout:140: left oid 140 (ObjNum 139 snap 0 seq_num 139) 2023-01-25T04:42:18.263 INFO:tasks.rados.rados.0.smithi116.stdout:141: finishing write tid 1 to smithi116107171-141 2023-01-25T04:42:18.263 INFO:tasks.rados.rados.0.smithi116.stdout:141: finishing write tid 2 to smithi116107171-141 2023-01-25T04:42:18.263 INFO:tasks.rados.rados.0.smithi116.stdout:141: finishing write tid 3 to smithi116107171-141 2023-01-25T04:42:18.263 INFO:tasks.rados.rados.0.smithi116.stdout:142: finishing write tid 1 to smithi116107171-142 2023-01-25T04:42:18.264 INFO:tasks.rados.rados.0.smithi116.stdout:142: finishing write tid 2 to smithi116107171-142 2023-01-25T04:42:18.264 INFO:tasks.rados.rados.0.smithi116.stdout:141: finishing write tid 4 to smithi116107171-141 2023-01-25T04:42:18.264 INFO:tasks.rados.rados.0.smithi116.stdout:141: oid 141 updating version 0 to 107 2023-01-25T04:42:18.264 INFO:tasks.rados.rados.0.smithi116.stdout:141: oid 141 version 107 is already newer than 106 2023-01-25T04:42:18.264 INFO:tasks.rados.rados.0.smithi116.stdout:141: oid 141 version 107 is already newer than 105 2023-01-25T04:42:18.265 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 141 v 107 (ObjNum 140 snap 0 seq_num 140) dirty exists 2023-01-25T04:42:18.265 INFO:tasks.rados.rados.0.smithi116.stdout:141: left oid 141 (ObjNum 140 snap 0 seq_num 140) 2023-01-25T04:42:18.265 INFO:tasks.rados.rados.0.smithi116.stdout:142: finishing write tid 3 to smithi116107171-142 2023-01-25T04:42:18.265 INFO:tasks.rados.rados.0.smithi116.stdout:142: finishing write tid 4 to smithi116107171-142 2023-01-25T04:42:18.265 INFO:tasks.rados.rados.0.smithi116.stdout:142: oid 142 updating version 0 to 77 2023-01-25T04:42:18.266 INFO:tasks.rados.rados.0.smithi116.stdout:142: oid 142 version 77 is already newer than 76 2023-01-25T04:42:18.266 INFO:tasks.rados.rados.0.smithi116.stdout:142: oid 142 updating version 77 to 78 2023-01-25T04:42:18.266 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 142 v 78 (ObjNum 141 snap 0 seq_num 141) dirty exists 2023-01-25T04:42:18.266 INFO:tasks.rados.rados.0.smithi116.stdout:142: left oid 142 (ObjNum 141 snap 0 seq_num 141) 2023-01-25T04:42:18.266 INFO:tasks.rados.rados.0.smithi116.stdout:143: finishing write tid 1 to smithi116107171-143 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: finishing write tid 2 to smithi116107171-143 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: finishing write tid 3 to smithi116107171-143 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: finishing write tid 4 to smithi116107171-143 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: oid 143 updating version 0 to 78 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: oid 143 updating version 78 to 80 2023-01-25T04:42:18.267 INFO:tasks.rados.rados.0.smithi116.stdout:143: oid 143 version 80 is already newer than 79 2023-01-25T04:42:18.268 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 143 v 80 (ObjNum 142 snap 0 seq_num 142) dirty exists 2023-01-25T04:42:18.268 INFO:tasks.rados.rados.0.smithi116.stdout:143: left oid 143 (ObjNum 142 snap 0 seq_num 142) 2023-01-25T04:42:18.268 INFO:tasks.rados.rados.0.smithi116.stdout:144: finishing write tid 1 to smithi116107171-144 2023-01-25T04:42:18.268 INFO:tasks.rados.rados.0.smithi116.stdout:144: finishing write tid 2 to smithi116107171-144 2023-01-25T04:42:18.268 INFO:tasks.rados.rados.0.smithi116.stdout:144: finishing write tid 3 to smithi116107171-144 2023-01-25T04:42:18.269 INFO:tasks.rados.rados.0.smithi116.stdout:144: finishing write tid 4 to smithi116107171-144 2023-01-25T04:42:18.269 INFO:tasks.rados.rados.0.smithi116.stdout:144: oid 144 updating version 0 to 79 2023-01-25T04:42:18.269 INFO:tasks.rados.rados.0.smithi116.stdout:144: oid 144 updating version 79 to 81 2023-01-25T04:42:18.269 INFO:tasks.rados.rados.0.smithi116.stdout:144: oid 144 version 81 is already newer than 80 2023-01-25T04:42:18.269 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 144 v 81 (ObjNum 143 snap 0 seq_num 143) dirty exists 2023-01-25T04:42:18.270 INFO:tasks.rados.rados.0.smithi116.stdout:144: left oid 144 (ObjNum 143 snap 0 seq_num 143) 2023-01-25T04:42:18.270 INFO:tasks.rados.rados.0.smithi116.stdout:145: finishing write tid 1 to smithi116107171-145 2023-01-25T04:42:18.270 INFO:tasks.rados.rados.0.smithi116.stdout:145: finishing write tid 2 to smithi116107171-145 2023-01-25T04:42:18.270 INFO:tasks.rados.rados.0.smithi116.stdout:145: finishing write tid 3 to smithi116107171-145 2023-01-25T04:42:18.270 INFO:tasks.rados.rados.0.smithi116.stdout:145: finishing write tid 4 to smithi116107171-145 2023-01-25T04:42:18.271 INFO:tasks.rados.rados.0.smithi116.stdout:145: oid 145 updating version 0 to 83 2023-01-25T04:42:18.271 INFO:tasks.rados.rados.0.smithi116.stdout:145: oid 145 updating version 83 to 84 2023-01-25T04:42:18.271 INFO:tasks.rados.rados.0.smithi116.stdout:145: oid 145 version 84 is already newer than 82 2023-01-25T04:42:18.271 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 145 v 84 (ObjNum 144 snap 0 seq_num 144) dirty exists 2023-01-25T04:42:18.271 INFO:tasks.rados.rados.0.smithi116.stdout:145: left oid 145 (ObjNum 144 snap 0 seq_num 144) 2023-01-25T04:42:18.272 INFO:tasks.rados.rados.0.smithi116.stdout:146: finishing write tid 1 to smithi116107171-146 2023-01-25T04:42:18.272 INFO:tasks.rados.rados.0.smithi116.stdout:146: finishing write tid 2 to smithi116107171-146 2023-01-25T04:42:18.272 INFO:tasks.rados.rados.0.smithi116.stdout:146: finishing write tid 3 to smithi116107171-146 2023-01-25T04:42:18.272 INFO:tasks.rados.rados.0.smithi116.stdout:146: finishing write tid 4 to smithi116107171-146 2023-01-25T04:42:18.272 INFO:tasks.rados.rados.0.smithi116.stdout:146: oid 146 updating version 0 to 87 2023-01-25T04:42:18.273 INFO:tasks.rados.rados.0.smithi116.stdout:146: oid 146 version 87 is already newer than 86 2023-01-25T04:42:18.273 INFO:tasks.rados.rados.0.smithi116.stdout:146: oid 146 version 87 is already newer than 85 2023-01-25T04:42:18.273 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 146 v 87 (ObjNum 145 snap 0 seq_num 145) dirty exists 2023-01-25T04:42:18.273 INFO:tasks.rados.rados.0.smithi116.stdout:146: left oid 146 (ObjNum 145 snap 0 seq_num 145) 2023-01-25T04:42:18.273 INFO:tasks.rados.rados.0.smithi116.stdout:147: finishing write tid 1 to smithi116107171-147 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:147: finishing write tid 2 to smithi116107171-147 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:148: finishing write tid 1 to smithi116107171-148 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:147: finishing write tid 3 to smithi116107171-147 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:147: finishing write tid 4 to smithi116107171-147 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:147: oid 147 updating version 0 to 110 2023-01-25T04:42:18.274 INFO:tasks.rados.rados.0.smithi116.stdout:147: oid 147 version 110 is already newer than 109 2023-01-25T04:42:18.275 INFO:tasks.rados.rados.0.smithi116.stdout:147: oid 147 version 110 is already newer than 108 2023-01-25T04:42:18.275 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 147 v 110 (ObjNum 146 snap 0 seq_num 146) dirty exists 2023-01-25T04:42:18.275 INFO:tasks.rados.rados.0.smithi116.stdout:147: left oid 147 (ObjNum 146 snap 0 seq_num 146) 2023-01-25T04:42:18.275 INFO:tasks.rados.rados.0.smithi116.stdout:148: finishing write tid 2 to smithi116107171-148 2023-01-25T04:42:18.275 INFO:tasks.rados.rados.0.smithi116.stdout:148: finishing write tid 3 to smithi116107171-148 2023-01-25T04:42:18.276 INFO:tasks.rados.rados.0.smithi116.stdout:148: finishing write tid 4 to smithi116107171-148 2023-01-25T04:42:18.276 INFO:tasks.rados.rados.0.smithi116.stdout:148: oid 148 updating version 0 to 81 2023-01-25T04:42:18.276 INFO:tasks.rados.rados.0.smithi116.stdout:148: oid 148 updating version 81 to 83 2023-01-25T04:42:18.276 INFO:tasks.rados.rados.0.smithi116.stdout:148: oid 148 version 83 is already newer than 82 2023-01-25T04:42:18.276 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 148 v 83 (ObjNum 147 snap 0 seq_num 147) dirty exists 2023-01-25T04:42:18.277 INFO:tasks.rados.rados.0.smithi116.stdout:148: left oid 148 (ObjNum 147 snap 0 seq_num 147) 2023-01-25T04:42:18.277 INFO:tasks.rados.rados.0.smithi116.stdout:149: finishing write tid 1 to smithi116107171-149 2023-01-25T04:42:18.277 INFO:tasks.rados.rados.0.smithi116.stdout:149: finishing write tid 2 to smithi116107171-149 2023-01-25T04:42:18.277 INFO:tasks.rados.rados.0.smithi116.stdout:149: finishing write tid 3 to smithi116107171-149 2023-01-25T04:42:18.277 INFO:tasks.rados.rados.0.smithi116.stdout:149: finishing write tid 4 to smithi116107171-149 2023-01-25T04:42:18.278 INFO:tasks.rados.rados.0.smithi116.stdout:149: oid 149 updating version 0 to 112 2023-01-25T04:42:18.278 INFO:tasks.rados.rados.0.smithi116.stdout:149: oid 149 version 112 is already newer than 111 2023-01-25T04:42:18.278 INFO:tasks.rados.rados.0.smithi116.stdout:149: oid 149 version 112 is already newer than 110 2023-01-25T04:42:18.278 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 149 v 112 (ObjNum 148 snap 0 seq_num 148) dirty exists 2023-01-25T04:42:18.278 INFO:tasks.rados.rados.0.smithi116.stdout:149: left oid 149 (ObjNum 148 snap 0 seq_num 148) 2023-01-25T04:42:18.279 INFO:tasks.rados.rados.0.smithi116.stdout:150: finishing write tid 1 to smithi116107171-150 2023-01-25T04:42:18.279 INFO:tasks.rados.rados.0.smithi116.stdout:150: finishing write tid 2 to smithi116107171-150 2023-01-25T04:42:18.279 INFO:tasks.rados.rados.0.smithi116.stdout:150: finishing write tid 3 to smithi116107171-150 2023-01-25T04:42:18.279 INFO:tasks.rados.rados.0.smithi116.stdout:150: finishing write tid 4 to smithi116107171-150 2023-01-25T04:42:18.279 INFO:tasks.rados.rados.0.smithi116.stdout:150: oid 150 updating version 0 to 89 2023-01-25T04:42:18.280 INFO:tasks.rados.rados.0.smithi116.stdout:150: oid 150 updating version 89 to 90 2023-01-25T04:42:18.280 INFO:tasks.rados.rados.0.smithi116.stdout:150: oid 150 version 90 is already newer than 88 2023-01-25T04:42:18.280 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 150 v 90 (ObjNum 149 snap 0 seq_num 149) dirty exists 2023-01-25T04:42:18.280 INFO:tasks.rados.rados.0.smithi116.stdout:150: left oid 150 (ObjNum 149 snap 0 seq_num 149) 2023-01-25T04:42:18.280 INFO:tasks.rados.rados.0.smithi116.stdout:151: finishing write tid 1 to smithi116107171-151 2023-01-25T04:42:18.281 INFO:tasks.rados.rados.0.smithi116.stdout:151: finishing write tid 2 to smithi116107171-151 2023-01-25T04:42:18.281 INFO:tasks.rados.rados.0.smithi116.stdout:152: finishing write tid 1 to smithi116107171-152 2023-01-25T04:42:18.281 INFO:tasks.rados.rados.0.smithi116.stdout:151: finishing write tid 3 to smithi116107171-151 2023-01-25T04:42:18.281 INFO:tasks.rados.rados.0.smithi116.stdout:151: finishing write tid 4 to smithi116107171-151 2023-01-25T04:42:18.281 INFO:tasks.rados.rados.0.smithi116.stdout:151: oid 151 updating version 0 to 84 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:151: oid 151 version 84 is already newer than 83 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:151: oid 151 version 84 is already newer than 82 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 151 v 84 (ObjNum 150 snap 0 seq_num 150) dirty exists 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:151: left oid 151 (ObjNum 150 snap 0 seq_num 150) 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:153: finishing write tid 1 to smithi116107171-153 2023-01-25T04:42:18.282 INFO:tasks.rados.rados.0.smithi116.stdout:152: finishing write tid 2 to smithi116107171-152 2023-01-25T04:42:18.283 INFO:tasks.rados.rados.0.smithi116.stdout:152: finishing write tid 3 to smithi116107171-152 2023-01-25T04:42:18.283 INFO:tasks.rados.rados.0.smithi116.stdout:152: finishing write tid 4 to smithi116107171-152 2023-01-25T04:42:18.283 INFO:tasks.rados.rados.0.smithi116.stdout:152: oid 152 updating version 0 to 86 2023-01-25T04:42:18.283 INFO:tasks.rados.rados.0.smithi116.stdout:152: oid 152 version 86 is already newer than 84 2023-01-25T04:42:18.283 INFO:tasks.rados.rados.0.smithi116.stdout:152: oid 152 version 86 is already newer than 85 2023-01-25T04:42:18.284 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 152 v 86 (ObjNum 151 snap 0 seq_num 151) dirty exists 2023-01-25T04:42:18.284 INFO:tasks.rados.rados.0.smithi116.stdout:152: left oid 152 (ObjNum 151 snap 0 seq_num 151) 2023-01-25T04:42:18.284 INFO:tasks.rados.rados.0.smithi116.stdout:153: finishing write tid 2 to smithi116107171-153 2023-01-25T04:42:18.284 INFO:tasks.rados.rados.0.smithi116.stdout:154: finishing write tid 1 to smithi116107171-154 2023-01-25T04:42:18.284 INFO:tasks.rados.rados.0.smithi116.stdout:139: done (15 left) 2023-01-25T04:42:18.285 INFO:tasks.rados.rados.0.smithi116.stdout:140: done (14 left) 2023-01-25T04:42:18.285 INFO:tasks.rados.rados.0.smithi116.stdout:141: done (13 left) 2023-01-25T04:42:18.285 INFO:tasks.rados.rados.0.smithi116.stdout:142: done (12 left) 2023-01-25T04:42:18.285 INFO:tasks.rados.rados.0.smithi116.stdout:143: done (11 left) 2023-01-25T04:42:18.285 INFO:tasks.rados.rados.0.smithi116.stdout:144: done (10 left) 2023-01-25T04:42:18.286 INFO:tasks.rados.rados.0.smithi116.stdout:145: done (9 left) 2023-01-25T04:42:18.286 INFO:tasks.rados.rados.0.smithi116.stdout:146: done (8 left) 2023-01-25T04:42:18.286 INFO:tasks.rados.rados.0.smithi116.stdout:147: done (7 left) 2023-01-25T04:42:18.286 INFO:tasks.rados.rados.0.smithi116.stdout:148: done (6 left) 2023-01-25T04:42:18.286 INFO:tasks.rados.rados.0.smithi116.stdout:149: done (5 left) 2023-01-25T04:42:18.287 INFO:tasks.rados.rados.0.smithi116.stdout:150: done (4 left) 2023-01-25T04:42:18.287 INFO:tasks.rados.rados.0.smithi116.stdout:151: done (3 left) 2023-01-25T04:42:18.287 INFO:tasks.rados.rados.0.smithi116.stdout:152: done (2 left) 2023-01-25T04:42:18.287 INFO:tasks.rados.rados.0.smithi116.stdout:155: write initial oid 155 2023-01-25T04:42:18.287 INFO:tasks.rados.rados.0.smithi116.stdout:155: seq_num 154 ranges {588278=715406,1711874=668042} 2023-01-25T04:42:18.288 INFO:tasks.rados.rados.0.smithi116.stdout:155: writing smithi116107171-155 from 588278 to 1303684 tid 1 2023-01-25T04:42:18.289 INFO:tasks.rados.rados.0.smithi116.stdout:155: writing smithi116107171-155 from 1711874 to 2379916 tid 2 2023-01-25T04:42:18.289 INFO:tasks.rados.rados.0.smithi116.stdout:156: write initial oid 156 2023-01-25T04:42:18.289 INFO:tasks.rados.rados.0.smithi116.stdout:156: seq_num 155 ranges {605085=790655,2170356=434729} 2023-01-25T04:42:18.289 INFO:tasks.rados.rados.0.smithi116.stdout:156: writing smithi116107171-156 from 605085 to 1395740 tid 1 2023-01-25T04:42:18.289 INFO:tasks.rados.rados.0.smithi116.stdout:156: writing smithi116107171-156 from 2170356 to 2605085 tid 2 2023-01-25T04:42:18.290 INFO:tasks.rados.rados.0.smithi116.stdout:157: write initial oid 157 2023-01-25T04:42:18.290 INFO:tasks.rados.rados.0.smithi116.stdout:157: seq_num 156 ranges {621892=465904,1712485=671711} 2023-01-25T04:42:18.290 INFO:tasks.rados.rados.0.smithi116.stdout:157: writing smithi116107171-157 from 621892 to 1087796 tid 1 2023-01-25T04:42:18.298 INFO:tasks.rados.rados.0.smithi116.stdout:157: writing smithi116107171-157 from 1712485 to 2384196 tid 2 2023-01-25T04:42:18.298 INFO:tasks.rados.rados.0.smithi116.stdout:158: write initial oid 158 2023-01-25T04:42:18.298 INFO:tasks.rados.rados.0.smithi116.stdout:158: seq_num 157 ranges {638699=541153,1770967=531722} 2023-01-25T04:42:18.304 INFO:tasks.rados.rados.0.smithi116.stdout:158: writing smithi116107171-158 from 638699 to 1179852 tid 1 2023-01-25T04:42:18.310 INFO:tasks.rados.rados.0.smithi116.stdout:158: writing smithi116107171-158 from 1770967 to 2302689 tid 2 2023-01-25T04:42:18.311 INFO:tasks.rados.rados.0.smithi116.stdout:159: write initial oid 159 2023-01-25T04:42:18.311 INFO:tasks.rados.rados.0.smithi116.stdout:159: seq_num 158 ranges {655506=616402,1829449=675380} 2023-01-25T04:42:18.317 INFO:tasks.rados.rados.0.smithi116.stdout:159: writing smithi116107171-159 from 655506 to 1271908 tid 1 2023-01-25T04:42:18.324 INFO:tasks.rados.rados.0.smithi116.stdout:159: writing smithi116107171-159 from 1829449 to 2504829 tid 2 2023-01-25T04:42:18.325 INFO:tasks.rados.rados.0.smithi116.stdout:160: write initial oid 160 2023-01-25T04:42:18.325 INFO:tasks.rados.rados.0.smithi116.stdout:160: seq_num 159 ranges {672313=691651,1887931=419038} 2023-01-25T04:42:18.332 INFO:tasks.rados.rados.0.smithi116.stdout:160: writing smithi116107171-160 from 672313 to 1363964 tid 1 2023-01-25T04:42:18.337 INFO:tasks.rados.rados.0.smithi116.stdout:160: writing smithi116107171-160 from 1887931 to 2306969 tid 2 2023-01-25T04:42:18.337 INFO:tasks.rados.rados.0.smithi116.stdout:161: write initial oid 161 2023-01-25T04:42:18.338 INFO:tasks.rados.rados.0.smithi116.stdout:161: seq_num 160 ranges {689120=483253,1946413=679049} 2023-01-25T04:42:18.343 INFO:tasks.rados.rados.0.smithi116.stdout:161: writing smithi116107171-161 from 689120 to 1172373 tid 1 2023-01-25T04:42:18.352 INFO:tasks.rados.rados.0.smithi116.stdout:161: writing smithi116107171-161 from 1946413 to 2625462 tid 2 2023-01-25T04:42:18.352 INFO:tasks.rados.rados.0.smithi116.stdout:162: write initial oid 162 2023-01-25T04:42:18.352 INFO:tasks.rados.rados.0.smithi116.stdout:162: seq_num 161 ranges {705927=558502,2004895=422707} 2023-01-25T04:42:18.358 INFO:tasks.rados.rados.0.smithi116.stdout:162: writing smithi116107171-162 from 705927 to 1264429 tid 1 2023-01-25T04:42:18.365 INFO:tasks.rados.rados.0.smithi116.stdout:162: writing smithi116107171-162 from 2004895 to 2427602 tid 2 2023-01-25T04:42:18.365 INFO:tasks.rados.rados.0.smithi116.stdout:163: write initial oid 163 2023-01-25T04:42:18.366 INFO:tasks.rados.rados.0.smithi116.stdout:163: seq_num 162 ranges {722734=633751,2063377=659357} 2023-01-25T04:42:18.372 INFO:tasks.rados.rados.0.smithi116.stdout:163: writing smithi116107171-163 from 722734 to 1356485 tid 1 2023-01-25T04:42:18.379 INFO:tasks.rados.rados.0.smithi116.stdout:163: writing smithi116107171-163 from 2063377 to 2722734 tid 2 2023-01-25T04:42:18.380 INFO:tasks.rados.rados.0.smithi116.stdout:164: write initial oid 164 2023-01-25T04:42:18.380 INFO:tasks.rados.rados.0.smithi116.stdout:164: seq_num 163 ranges {739541=709000,2121859=426376} 2023-01-25T04:42:18.387 INFO:tasks.rados.rados.0.smithi116.stdout:164: writing smithi116107171-164 from 739541 to 1448541 tid 1 2023-01-25T04:42:18.393 INFO:tasks.rados.rados.0.smithi116.stdout:164: writing smithi116107171-164 from 2121859 to 2548235 tid 2 2023-01-25T04:42:18.394 INFO:tasks.rados.rados.0.smithi116.stdout:165: write initial oid 165 2023-01-25T04:42:18.394 INFO:tasks.rados.rados.0.smithi116.stdout:165: seq_num 164 ranges {756348=784249,2063988=686387} 2023-01-25T04:42:18.402 INFO:tasks.rados.rados.0.smithi116.stdout:165: writing smithi116107171-165 from 756348 to 1540597 tid 1 2023-01-25T04:42:18.408 INFO:tasks.rados.rados.0.smithi116.stdout:165: writing smithi116107171-165 from 2063988 to 2750375 tid 2 2023-01-25T04:42:18.409 INFO:tasks.rados.rados.0.smithi116.stdout:166: write initial oid 166 2023-01-25T04:42:18.409 INFO:tasks.rados.rados.0.smithi116.stdout:166: seq_num 165 ranges {773155=459498,1722470=430045,2648676=124479} 2023-01-25T04:42:18.415 INFO:tasks.rados.rados.0.smithi116.stdout:166: writing smithi116107171-166 from 773155 to 1232653 tid 1 2023-01-25T04:42:18.420 INFO:tasks.rados.rados.0.smithi116.stdout:166: writing smithi116107171-166 from 1722470 to 2152515 tid 2 2023-01-25T04:42:18.423 INFO:tasks.rados.rados.0.smithi116.stdout:166: writing smithi116107171-166 from 2648676 to 2773155 tid 3 2023-01-25T04:42:18.423 INFO:tasks.rados.rados.0.smithi116.stdout:167: write initial oid 167 2023-01-25T04:42:18.424 INFO:tasks.rados.rados.0.smithi116.stdout:167: seq_num 166 ranges {789962=534747,1780952=690056} 2023-01-25T04:42:18.430 INFO:tasks.rados.rados.0.smithi116.stdout:167: writing smithi116107171-167 from 789962 to 1324709 tid 1 2023-01-25T04:42:18.437 INFO:tasks.rados.rados.0.smithi116.stdout:167: writing smithi116107171-167 from 1780952 to 2471008 tid 2 2023-01-25T04:42:18.437 INFO:tasks.rados.rados.0.smithi116.stdout:168: write initial oid 168 2023-01-25T04:42:18.437 INFO:tasks.rados.rados.0.smithi116.stdout:168: seq_num 167 ranges {406769=609996,1439434=433714,2303522=503247} 2023-01-25T04:42:18.442 INFO:tasks.rados.rados.0.smithi116.stdout:168: writing smithi116107171-168 from 406769 to 1016765 tid 1 2023-01-25T04:42:18.447 INFO:tasks.rados.rados.0.smithi116.stdout:168: writing smithi116107171-168 from 1439434 to 1873148 tid 2 2023-01-25T04:42:18.452 INFO:tasks.rados.rados.0.smithi116.stdout:168: writing smithi116107171-168 from 2303522 to 2806769 tid 3 2023-01-25T04:42:18.453 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.453 INFO:tasks.rados.rados.0.smithi116.stdout:153: finishing write tid 3 to smithi116107171-153 2023-01-25T04:42:18.453 INFO:tasks.rados.rados.0.smithi116.stdout:153: finishing write tid 4 to smithi116107171-153 2023-01-25T04:42:18.453 INFO:tasks.rados.rados.0.smithi116.stdout:153: oid 153 updating version 0 to 112 2023-01-25T04:42:18.453 INFO:tasks.rados.rados.0.smithi116.stdout:153: oid 153 updating version 112 to 113 2023-01-25T04:42:18.454 INFO:tasks.rados.rados.0.smithi116.stdout:153: oid 153 version 113 is already newer than 111 2023-01-25T04:42:18.454 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 153 v 113 (ObjNum 152 snap 0 seq_num 152) dirty exists 2023-01-25T04:42:18.454 INFO:tasks.rados.rados.0.smithi116.stdout:153: left oid 153 (ObjNum 152 snap 0 seq_num 152) 2023-01-25T04:42:18.454 INFO:tasks.rados.rados.0.smithi116.stdout:154: finishing write tid 2 to smithi116107171-154 2023-01-25T04:42:18.454 INFO:tasks.rados.rados.0.smithi116.stdout:153: done (15 left) 2023-01-25T04:42:18.455 INFO:tasks.rados.rados.0.smithi116.stdout:169: write initial oid 169 2023-01-25T04:42:18.455 INFO:tasks.rados.rados.0.smithi116.stdout:169: seq_num 168 ranges {423576=401598,1497916=693725} 2023-01-25T04:42:18.456 INFO:tasks.rados.rados.0.smithi116.stdout:169: writing smithi116107171-169 from 423576 to 825174 tid 1 2023-01-25T04:42:18.464 INFO:tasks.rados.rados.0.smithi116.stdout:169: writing smithi116107171-169 from 1497916 to 2191641 tid 2 2023-01-25T04:42:18.464 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.465 INFO:tasks.rados.rados.0.smithi116.stdout:154: finishing write tid 3 to smithi116107171-154 2023-01-25T04:42:18.465 INFO:tasks.rados.rados.0.smithi116.stdout:154: finishing write tid 4 to smithi116107171-154 2023-01-25T04:42:18.465 INFO:tasks.rados.rados.0.smithi116.stdout:154: oid 154 updating version 0 to 109 2023-01-25T04:42:18.465 INFO:tasks.rados.rados.0.smithi116.stdout:154: oid 154 updating version 109 to 111 2023-01-25T04:42:18.465 INFO:tasks.rados.rados.0.smithi116.stdout:154: oid 154 updating version 111 to 112 2023-01-25T04:42:18.466 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 154 v 112 (ObjNum 153 snap 0 seq_num 153) dirty exists 2023-01-25T04:42:18.466 INFO:tasks.rados.rados.0.smithi116.stdout:154: left oid 154 (ObjNum 153 snap 0 seq_num 153) 2023-01-25T04:42:18.466 INFO:tasks.rados.rados.0.smithi116.stdout:155: finishing write tid 1 to smithi116107171-155 2023-01-25T04:42:18.466 INFO:tasks.rados.rados.0.smithi116.stdout:155: finishing write tid 2 to smithi116107171-155 2023-01-25T04:42:18.466 INFO:tasks.rados.rados.0.smithi116.stdout:155: finishing write tid 3 to smithi116107171-155 2023-01-25T04:42:18.467 INFO:tasks.rados.rados.0.smithi116.stdout:155: finishing write tid 4 to smithi116107171-155 2023-01-25T04:42:18.467 INFO:tasks.rados.rados.0.smithi116.stdout:155: oid 155 updating version 0 to 112 2023-01-25T04:42:18.467 INFO:tasks.rados.rados.0.smithi116.stdout:155: oid 155 version 112 is already newer than 110 2023-01-25T04:42:18.467 INFO:tasks.rados.rados.0.smithi116.stdout:155: oid 155 version 112 is already newer than 111 2023-01-25T04:42:18.467 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 155 v 112 (ObjNum 154 snap 0 seq_num 154) dirty exists 2023-01-25T04:42:18.468 INFO:tasks.rados.rados.0.smithi116.stdout:155: left oid 155 (ObjNum 154 snap 0 seq_num 154) 2023-01-25T04:42:18.468 INFO:tasks.rados.rados.0.smithi116.stdout:156: finishing write tid 1 to smithi116107171-156 2023-01-25T04:42:18.468 INFO:tasks.rados.rados.0.smithi116.stdout:156: finishing write tid 2 to smithi116107171-156 2023-01-25T04:42:18.468 INFO:tasks.rados.rados.0.smithi116.stdout:156: finishing write tid 3 to smithi116107171-156 2023-01-25T04:42:18.468 INFO:tasks.rados.rados.0.smithi116.stdout:156: finishing write tid 4 to smithi116107171-156 2023-01-25T04:42:18.469 INFO:tasks.rados.rados.0.smithi116.stdout:156: oid 156 updating version 0 to 85 2023-01-25T04:42:18.469 INFO:tasks.rados.rados.0.smithi116.stdout:156: oid 156 updating version 85 to 86 2023-01-25T04:42:18.469 INFO:tasks.rados.rados.0.smithi116.stdout:156: oid 156 updating version 86 to 87 2023-01-25T04:42:18.469 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 156 v 87 (ObjNum 155 snap 0 seq_num 155) dirty exists 2023-01-25T04:42:18.469 INFO:tasks.rados.rados.0.smithi116.stdout:156: left oid 156 (ObjNum 155 snap 0 seq_num 155) 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:157: finishing write tid 1 to smithi116107171-157 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:157: finishing write tid 2 to smithi116107171-157 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:154: done (15 left) 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:155: done (14 left) 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:156: done (13 left) 2023-01-25T04:42:18.470 INFO:tasks.rados.rados.0.smithi116.stdout:170: write initial oid 170 2023-01-25T04:42:18.471 INFO:tasks.rados.rados.0.smithi116.stdout:170: seq_num 169 ranges {440383=476847,1556398=437383,2474721=365662} 2023-01-25T04:42:18.471 INFO:tasks.rados.rados.0.smithi116.stdout:170: writing smithi116107171-170 from 440383 to 917230 tid 1 2023-01-25T04:42:18.475 INFO:tasks.rados.rados.0.smithi116.stdout:170: writing smithi116107171-170 from 1556398 to 1993781 tid 2 2023-01-25T04:42:18.480 INFO:tasks.rados.rados.0.smithi116.stdout:170: writing smithi116107171-170 from 2474721 to 2840383 tid 3 2023-01-25T04:42:18.480 INFO:tasks.rados.rados.0.smithi116.stdout:171: write initial oid 171 2023-01-25T04:42:18.480 INFO:tasks.rados.rados.0.smithi116.stdout:171: seq_num 170 ranges {457190=552096,1614880=581041,2785791=71399} 2023-01-25T04:42:18.485 INFO:tasks.rados.rados.0.smithi116.stdout:171: writing smithi116107171-171 from 457190 to 1009286 tid 1 2023-01-25T04:42:18.492 INFO:tasks.rados.rados.0.smithi116.stdout:171: writing smithi116107171-171 from 1614880 to 2195921 tid 2 2023-01-25T04:42:18.496 INFO:tasks.rados.rados.0.smithi116.stdout:171: writing smithi116107171-171 from 2785791 to 2857190 tid 3 2023-01-25T04:42:18.496 INFO:tasks.rados.rados.0.smithi116.stdout:172: write initial oid 172 2023-01-25T04:42:18.496 INFO:tasks.rados.rados.0.smithi116.stdout:172: seq_num 171 ranges {473997=627345,1673362=441052,2529567=344430} 2023-01-25T04:42:18.501 INFO:tasks.rados.rados.0.smithi116.stdout:172: writing smithi116107171-172 from 473997 to 1101342 tid 1 2023-01-25T04:42:18.507 INFO:tasks.rados.rados.0.smithi116.stdout:172: writing smithi116107171-172 from 1673362 to 2114414 tid 2 2023-01-25T04:42:18.512 INFO:tasks.rados.rados.0.smithi116.stdout:172: writing smithi116107171-172 from 2529567 to 2873997 tid 3 2023-01-25T04:42:18.512 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.512 INFO:tasks.rados.rados.0.smithi116.stdout:158: finishing write tid 1 to smithi116107171-158 2023-01-25T04:42:18.512 INFO:tasks.rados.rados.0.smithi116.stdout:157: finishing write tid 3 to smithi116107171-157 2023-01-25T04:42:18.513 INFO:tasks.rados.rados.0.smithi116.stdout:157: finishing write tid 4 to smithi116107171-157 2023-01-25T04:42:18.513 INFO:tasks.rados.rados.0.smithi116.stdout:157: oid 157 updating version 0 to 114 2023-01-25T04:42:18.513 INFO:tasks.rados.rados.0.smithi116.stdout:157: oid 157 version 114 is already newer than 113 2023-01-25T04:42:18.513 INFO:tasks.rados.rados.0.smithi116.stdout:157: oid 157 updating version 114 to 115 2023-01-25T04:42:18.513 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 157 v 115 (ObjNum 156 snap 0 seq_num 156) dirty exists 2023-01-25T04:42:18.514 INFO:tasks.rados.rados.0.smithi116.stdout:157: left oid 157 (ObjNum 156 snap 0 seq_num 156) 2023-01-25T04:42:18.514 INFO:tasks.rados.rados.0.smithi116.stdout:158: finishing write tid 2 to smithi116107171-158 2023-01-25T04:42:18.514 INFO:tasks.rados.rados.0.smithi116.stdout:157: done (15 left) 2023-01-25T04:42:18.514 INFO:tasks.rados.rados.0.smithi116.stdout:173: write initial oid 173 2023-01-25T04:42:18.514 INFO:tasks.rados.rados.0.smithi116.stdout:173: seq_num 172 ranges {490804=702594,1615491=584710,2724284=166520} 2023-01-25T04:42:18.518 INFO:tasks.rados.rados.0.smithi116.stdout:173: writing smithi116107171-173 from 490804 to 1193398 tid 1 2023-01-25T04:42:18.523 INFO:tasks.rados.rados.0.smithi116.stdout:173: writing smithi116107171-173 from 1615491 to 2200201 tid 2 2023-01-25T04:42:18.530 INFO:tasks.rados.rados.0.smithi116.stdout:173: writing smithi116107171-173 from 2724284 to 2890804 tid 3 2023-01-25T04:42:18.530 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.530 INFO:tasks.rados.rados.0.smithi116.stdout:158: finishing write tid 3 to smithi116107171-158 2023-01-25T04:42:18.530 INFO:tasks.rados.rados.0.smithi116.stdout:158: finishing write tid 4 to smithi116107171-158 2023-01-25T04:42:18.531 INFO:tasks.rados.rados.0.smithi116.stdout:158: oid 158 updating version 0 to 93 2023-01-25T04:42:18.531 INFO:tasks.rados.rados.0.smithi116.stdout:158: oid 158 version 93 is already newer than 91 2023-01-25T04:42:18.531 INFO:tasks.rados.rados.0.smithi116.stdout:158: oid 158 version 93 is already newer than 92 2023-01-25T04:42:18.531 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 158 v 93 (ObjNum 157 snap 0 seq_num 157) dirty exists 2023-01-25T04:42:18.531 INFO:tasks.rados.rados.0.smithi116.stdout:158: left oid 158 (ObjNum 157 snap 0 seq_num 157) 2023-01-25T04:42:18.532 INFO:tasks.rados.rados.0.smithi116.stdout:159: finishing write tid 1 to smithi116107171-159 2023-01-25T04:42:18.532 INFO:tasks.rados.rados.0.smithi116.stdout:159: finishing write tid 2 to smithi116107171-159 2023-01-25T04:42:18.532 INFO:tasks.rados.rados.0.smithi116.stdout:159: finishing write tid 3 to smithi116107171-159 2023-01-25T04:42:18.532 INFO:tasks.rados.rados.0.smithi116.stdout:159: finishing write tid 4 to smithi116107171-159 2023-01-25T04:42:18.532 INFO:tasks.rados.rados.0.smithi116.stdout:159: oid 159 updating version 0 to 116 2023-01-25T04:42:18.533 INFO:tasks.rados.rados.0.smithi116.stdout:159: oid 159 version 116 is already newer than 115 2023-01-25T04:42:18.533 INFO:tasks.rados.rados.0.smithi116.stdout:159: oid 159 updating version 116 to 117 2023-01-25T04:42:18.533 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 159 v 117 (ObjNum 158 snap 0 seq_num 158) dirty exists 2023-01-25T04:42:18.533 INFO:tasks.rados.rados.0.smithi116.stdout:159: left oid 159 (ObjNum 158 snap 0 seq_num 158) 2023-01-25T04:42:18.533 INFO:tasks.rados.rados.0.smithi116.stdout:160: finishing write tid 1 to smithi116107171-160 2023-01-25T04:42:18.534 INFO:tasks.rados.rados.0.smithi116.stdout:160: finishing write tid 2 to smithi116107171-160 2023-01-25T04:42:18.534 INFO:tasks.rados.rados.0.smithi116.stdout:160: finishing write tid 3 to smithi116107171-160 2023-01-25T04:42:18.534 INFO:tasks.rados.rados.0.smithi116.stdout:160: finishing write tid 4 to smithi116107171-160 2023-01-25T04:42:18.534 INFO:tasks.rados.rados.0.smithi116.stdout:160: oid 160 updating version 0 to 120 2023-01-25T04:42:18.534 INFO:tasks.rados.rados.0.smithi116.stdout:160: oid 160 version 120 is already newer than 119 2023-01-25T04:42:18.535 INFO:tasks.rados.rados.0.smithi116.stdout:160: oid 160 version 120 is already newer than 118 2023-01-25T04:42:18.535 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 160 v 120 (ObjNum 159 snap 0 seq_num 159) dirty exists 2023-01-25T04:42:18.535 INFO:tasks.rados.rados.0.smithi116.stdout:160: left oid 160 (ObjNum 159 snap 0 seq_num 159) 2023-01-25T04:42:18.535 INFO:tasks.rados.rados.0.smithi116.stdout:161: finishing write tid 1 to smithi116107171-161 2023-01-25T04:42:18.535 INFO:tasks.rados.rados.0.smithi116.stdout:161: finishing write tid 2 to smithi116107171-161 2023-01-25T04:42:18.536 INFO:tasks.rados.rados.0.smithi116.stdout:161: finishing write tid 3 to smithi116107171-161 2023-01-25T04:42:18.536 INFO:tasks.rados.rados.0.smithi116.stdout:161: finishing write tid 4 to smithi116107171-161 2023-01-25T04:42:18.536 INFO:tasks.rados.rados.0.smithi116.stdout:161: oid 161 updating version 0 to 114 2023-01-25T04:42:18.536 INFO:tasks.rados.rados.0.smithi116.stdout:161: oid 161 version 114 is already newer than 113 2023-01-25T04:42:18.536 INFO:tasks.rados.rados.0.smithi116.stdout:161: oid 161 updating version 114 to 115 2023-01-25T04:42:18.537 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 161 v 115 (ObjNum 160 snap 0 seq_num 160) dirty exists 2023-01-25T04:42:18.537 INFO:tasks.rados.rados.0.smithi116.stdout:161: left oid 161 (ObjNum 160 snap 0 seq_num 160) 2023-01-25T04:42:18.537 INFO:tasks.rados.rados.0.smithi116.stdout:162: finishing write tid 1 to smithi116107171-162 2023-01-25T04:42:18.537 INFO:tasks.rados.rados.0.smithi116.stdout:162: finishing write tid 2 to smithi116107171-162 2023-01-25T04:42:18.537 INFO:tasks.rados.rados.0.smithi116.stdout:162: finishing write tid 3 to smithi116107171-162 2023-01-25T04:42:18.538 INFO:tasks.rados.rados.0.smithi116.stdout:162: finishing write tid 4 to smithi116107171-162 2023-01-25T04:42:18.538 INFO:tasks.rados.rados.0.smithi116.stdout:162: oid 162 updating version 0 to 117 2023-01-25T04:42:18.538 INFO:tasks.rados.rados.0.smithi116.stdout:162: oid 162 updating version 117 to 118 2023-01-25T04:42:18.538 INFO:tasks.rados.rados.0.smithi116.stdout:162: oid 162 version 118 is already newer than 116 2023-01-25T04:42:18.538 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 162 v 118 (ObjNum 161 snap 0 seq_num 161) dirty exists 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:162: left oid 162 (ObjNum 161 snap 0 seq_num 161) 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:163: finishing write tid 1 to smithi116107171-163 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:163: finishing write tid 2 to smithi116107171-163 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:163: finishing write tid 3 to smithi116107171-163 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:163: finishing write tid 4 to smithi116107171-163 2023-01-25T04:42:18.539 INFO:tasks.rados.rados.0.smithi116.stdout:163: oid 163 updating version 0 to 95 2023-01-25T04:42:18.540 INFO:tasks.rados.rados.0.smithi116.stdout:163: oid 163 version 95 is already newer than 94 2023-01-25T04:42:18.540 INFO:tasks.rados.rados.0.smithi116.stdout:163: oid 163 updating version 95 to 96 2023-01-25T04:42:18.540 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 163 v 96 (ObjNum 162 snap 0 seq_num 162) dirty exists 2023-01-25T04:42:18.540 INFO:tasks.rados.rados.0.smithi116.stdout:163: left oid 163 (ObjNum 162 snap 0 seq_num 162) 2023-01-25T04:42:18.540 INFO:tasks.rados.rados.0.smithi116.stdout:164: finishing write tid 1 to smithi116107171-164 2023-01-25T04:42:18.541 INFO:tasks.rados.rados.0.smithi116.stdout:164: finishing write tid 2 to smithi116107171-164 2023-01-25T04:42:18.541 INFO:tasks.rados.rados.0.smithi116.stdout:164: finishing write tid 3 to smithi116107171-164 2023-01-25T04:42:18.541 INFO:tasks.rados.rados.0.smithi116.stdout:164: finishing write tid 4 to smithi116107171-164 2023-01-25T04:42:18.541 INFO:tasks.rados.rados.0.smithi116.stdout:164: oid 164 updating version 0 to 119 2023-01-25T04:42:18.541 INFO:tasks.rados.rados.0.smithi116.stdout:164: oid 164 updating version 119 to 120 2023-01-25T04:42:18.542 INFO:tasks.rados.rados.0.smithi116.stdout:164: oid 164 updating version 120 to 121 2023-01-25T04:42:18.542 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 164 v 121 (ObjNum 163 snap 0 seq_num 163) dirty exists 2023-01-25T04:42:18.542 INFO:tasks.rados.rados.0.smithi116.stdout:164: left oid 164 (ObjNum 163 snap 0 seq_num 163) 2023-01-25T04:42:18.542 INFO:tasks.rados.rados.0.smithi116.stdout:165: finishing write tid 1 to smithi116107171-165 2023-01-25T04:42:18.543 INFO:tasks.rados.rados.0.smithi116.stdout:165: finishing write tid 2 to smithi116107171-165 2023-01-25T04:42:18.543 INFO:tasks.rados.rados.0.smithi116.stdout:165: finishing write tid 3 to smithi116107171-165 2023-01-25T04:42:18.543 INFO:tasks.rados.rados.0.smithi116.stdout:166: finishing write tid 1 to smithi116107171-166 2023-01-25T04:42:18.543 INFO:tasks.rados.rados.0.smithi116.stdout:165: finishing write tid 4 to smithi116107171-165 2023-01-25T04:42:18.543 INFO:tasks.rados.rados.0.smithi116.stdout:165: oid 165 updating version 0 to 96 2023-01-25T04:42:18.544 INFO:tasks.rados.rados.0.smithi116.stdout:165: oid 165 version 96 is already newer than 95 2023-01-25T04:42:18.544 INFO:tasks.rados.rados.0.smithi116.stdout:165: oid 165 updating version 96 to 97 2023-01-25T04:42:18.544 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 165 v 97 (ObjNum 164 snap 0 seq_num 164) dirty exists 2023-01-25T04:42:18.544 INFO:tasks.rados.rados.0.smithi116.stdout:165: left oid 165 (ObjNum 164 snap 0 seq_num 164) 2023-01-25T04:42:18.544 INFO:tasks.rados.rados.0.smithi116.stdout:166: finishing write tid 2 to smithi116107171-166 2023-01-25T04:42:18.545 INFO:tasks.rados.rados.0.smithi116.stdout:158: done (15 left) 2023-01-25T04:42:18.545 INFO:tasks.rados.rados.0.smithi116.stdout:159: done (14 left) 2023-01-25T04:42:18.545 INFO:tasks.rados.rados.0.smithi116.stdout:160: done (13 left) 2023-01-25T04:42:18.545 INFO:tasks.rados.rados.0.smithi116.stdout:161: done (12 left) 2023-01-25T04:42:18.546 INFO:tasks.rados.rados.0.smithi116.stdout:162: done (11 left) 2023-01-25T04:42:18.546 INFO:tasks.rados.rados.0.smithi116.stdout:163: done (10 left) 2023-01-25T04:42:18.546 INFO:tasks.rados.rados.0.smithi116.stdout:164: done (9 left) 2023-01-25T04:42:18.546 INFO:tasks.rados.rados.0.smithi116.stdout:165: done (8 left) 2023-01-25T04:42:18.546 INFO:tasks.rados.rados.0.smithi116.stdout:174: write initial oid 174 2023-01-25T04:42:18.547 INFO:tasks.rados.rados.0.smithi116.stdout:174: seq_num 173 ranges {507611=777843,2073973=444721} 2023-01-25T04:42:18.548 INFO:tasks.rados.rados.0.smithi116.stdout:174: writing smithi116107171-174 from 507611 to 1285454 tid 1 2023-01-25T04:42:18.548 INFO:tasks.rados.rados.0.smithi116.stdout:174: writing smithi116107171-174 from 2073973 to 2518694 tid 2 2023-01-25T04:42:18.548 INFO:tasks.rados.rados.0.smithi116.stdout:175: write initial oid 175 2023-01-25T04:42:18.548 INFO:tasks.rados.rados.0.smithi116.stdout:175: seq_num 174 ranges {524418=453092,1732455=588379,2779130=145288} 2023-01-25T04:42:18.548 INFO:tasks.rados.rados.0.smithi116.stdout:175: writing smithi116107171-175 from 524418 to 977510 tid 1 2023-01-25T04:42:18.554 INFO:tasks.rados.rados.0.smithi116.stdout:175: writing smithi116107171-175 from 1732455 to 2320834 tid 2 2023-01-25T04:42:18.558 INFO:tasks.rados.rados.0.smithi116.stdout:175: writing smithi116107171-175 from 2779130 to 2924418 tid 3 2023-01-25T04:42:18.558 INFO:tasks.rados.rados.0.smithi116.stdout:176: write initial oid 176 2023-01-25T04:42:18.558 INFO:tasks.rados.rados.0.smithi116.stdout:176: seq_num 175 ranges {541225=644694,1907290=448390} 2023-01-25T04:42:18.564 INFO:tasks.rados.rados.0.smithi116.stdout:176: writing smithi116107171-176 from 541225 to 1185919 tid 1 2023-01-25T04:42:18.570 INFO:tasks.rados.rados.0.smithi116.stdout:176: writing smithi116107171-176 from 1907290 to 2355680 tid 2 2023-01-25T04:42:18.570 INFO:tasks.rados.rados.0.smithi116.stdout:177: write initial oid 177 2023-01-25T04:42:18.571 INFO:tasks.rados.rados.0.smithi116.stdout:177: seq_num 176 ranges {558032=719943,1849419=592048} 2023-01-25T04:42:18.577 INFO:tasks.rados.rados.0.smithi116.stdout:177: writing smithi116107171-177 from 558032 to 1277975 tid 1 2023-01-25T04:42:18.583 INFO:tasks.rados.rados.0.smithi116.stdout:177: writing smithi116107171-177 from 1849419 to 2441467 tid 2 2023-01-25T04:42:18.584 INFO:tasks.rados.rados.0.smithi116.stdout:178: write initial oid 178 2023-01-25T04:42:18.584 INFO:tasks.rados.rados.0.smithi116.stdout:178: seq_num 177 ranges {574839=795192,1907901=452059} 2023-01-25T04:42:18.591 INFO:tasks.rados.rados.0.smithi116.stdout:178: writing smithi116107171-178 from 574839 to 1370031 tid 1 2023-01-25T04:42:18.596 INFO:tasks.rados.rados.0.smithi116.stdout:178: writing smithi116107171-178 from 1907901 to 2359960 tid 2 2023-01-25T04:42:18.597 INFO:tasks.rados.rados.0.smithi116.stdout:179: write initial oid 179 2023-01-25T04:42:18.597 INFO:tasks.rados.rados.0.smithi116.stdout:179: seq_num 178 ranges {591646=470441,1566383=595717,2888822=102824} 2023-01-25T04:42:18.602 INFO:tasks.rados.rados.0.smithi116.stdout:179: writing smithi116107171-179 from 591646 to 1062087 tid 1 2023-01-25T04:42:18.608 INFO:tasks.rados.rados.0.smithi116.stdout:179: writing smithi116107171-179 from 1566383 to 2162100 tid 2 2023-01-25T04:42:18.613 INFO:tasks.rados.rados.0.smithi116.stdout:179: writing smithi116107171-179 from 2888822 to 2991646 tid 3 2023-01-25T04:42:18.613 INFO:tasks.rados.rados.0.smithi116.stdout:180: write initial oid 180 2023-01-25T04:42:18.613 INFO:tasks.rados.rados.0.smithi116.stdout:180: seq_num 179 ranges {608453=545690,1624865=455728,2632598=375855} 2023-01-25T04:42:18.619 INFO:tasks.rados.rados.0.smithi116.stdout:180: writing smithi116107171-180 from 608453 to 1154143 tid 1 2023-01-25T04:42:18.624 INFO:tasks.rados.rados.0.smithi116.stdout:180: writing smithi116107171-180 from 1624865 to 2080593 tid 2 2023-01-25T04:42:18.630 INFO:tasks.rados.rados.0.smithi116.stdout:180: writing smithi116107171-180 from 2632598 to 3008453 tid 3 2023-01-25T04:42:18.630 INFO:tasks.rados.rados.0.smithi116.stdout:181: write initial oid 181 2023-01-25T04:42:18.630 INFO:tasks.rados.rados.0.smithi116.stdout:181: seq_num 180 ranges {625260=620939,1683347=599386,2943668=81592} 2023-01-25T04:42:18.636 INFO:tasks.rados.rados.0.smithi116.stdout:181: writing smithi116107171-181 from 625260 to 1246199 tid 1 2023-01-25T04:42:18.642 INFO:tasks.rados.rados.0.smithi116.stdout:181: writing smithi116107171-181 from 1683347 to 2282733 tid 2 2023-01-25T04:42:18.646 INFO:tasks.rados.rados.0.smithi116.stdout:181: writing smithi116107171-181 from 2943668 to 3025260 tid 3 2023-01-25T04:42:18.646 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.647 INFO:tasks.rados.rados.0.smithi116.stdout:166: finishing write tid 3 to smithi116107171-166 2023-01-25T04:42:18.647 INFO:tasks.rados.rados.0.smithi116.stdout:166: finishing write tid 4 to smithi116107171-166 2023-01-25T04:42:18.647 INFO:tasks.rados.rados.0.smithi116.stdout:166: finishing write tid 5 to smithi116107171-166 2023-01-25T04:42:18.647 INFO:tasks.rados.rados.0.smithi116.stdout:166: oid 166 updating version 0 to 121 2023-01-25T04:42:18.647 INFO:tasks.rados.rados.0.smithi116.stdout:166: oid 166 updating version 121 to 123 2023-01-25T04:42:18.648 INFO:tasks.rados.rados.0.smithi116.stdout:166: oid 166 updating version 123 to 124 2023-01-25T04:42:18.648 INFO:tasks.rados.rados.0.smithi116.stdout:166: oid 166 version 124 is already newer than 122 2023-01-25T04:42:18.648 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 166 v 124 (ObjNum 165 snap 0 seq_num 165) dirty exists 2023-01-25T04:42:18.648 INFO:tasks.rados.rados.0.smithi116.stdout:166: left oid 166 (ObjNum 165 snap 0 seq_num 165) 2023-01-25T04:42:18.648 INFO:tasks.rados.rados.0.smithi116.stdout:167: finishing write tid 1 to smithi116107171-167 2023-01-25T04:42:18.649 INFO:tasks.rados.rados.0.smithi116.stdout:166: done (15 left) 2023-01-25T04:42:18.649 INFO:tasks.rados.rados.0.smithi116.stdout:182: write initial oid 182 2023-01-25T04:42:18.649 INFO:tasks.rados.rados.0.smithi116.stdout:182: seq_num 181 ranges {642067=696188,2025476=459397,2971091=70976} 2023-01-25T04:42:18.653 INFO:tasks.rados.rados.0.smithi116.stdout:182: writing smithi116107171-182 from 642067 to 1338255 tid 1 2023-01-25T04:42:18.659 INFO:tasks.rados.rados.0.smithi116.stdout:182: writing smithi116107171-182 from 2025476 to 2484873 tid 2 2023-01-25T04:42:18.663 INFO:tasks.rados.rados.0.smithi116.stdout:182: writing smithi116107171-182 from 2971091 to 3042067 tid 3 2023-01-25T04:42:18.663 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.663 INFO:tasks.rados.rados.0.smithi116.stdout:167: finishing write tid 2 to smithi116107171-167 2023-01-25T04:42:18.664 INFO:tasks.rados.rados.0.smithi116.stdout:167: finishing write tid 3 to smithi116107171-167 2023-01-25T04:42:18.664 INFO:tasks.rados.rados.0.smithi116.stdout:167: finishing write tid 4 to smithi116107171-167 2023-01-25T04:42:18.664 INFO:tasks.rados.rados.0.smithi116.stdout:167: oid 167 updating version 0 to 122 2023-01-25T04:42:18.665 INFO:tasks.rados.rados.0.smithi116.stdout:167: oid 167 updating version 122 to 124 2023-01-25T04:42:18.665 INFO:tasks.rados.rados.0.smithi116.stdout:167: oid 167 version 124 is already newer than 123 2023-01-25T04:42:18.665 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 167 v 124 (ObjNum 166 snap 0 seq_num 166) dirty exists 2023-01-25T04:42:18.665 INFO:tasks.rados.rados.0.smithi116.stdout:167: left oid 167 (ObjNum 166 snap 0 seq_num 166) 2023-01-25T04:42:18.665 INFO:tasks.rados.rados.0.smithi116.stdout:168: finishing write tid 1 to smithi116107171-168 2023-01-25T04:42:18.666 INFO:tasks.rados.rados.0.smithi116.stdout:167: done (15 left) 2023-01-25T04:42:18.666 INFO:tasks.rados.rados.0.smithi116.stdout:183: write initial oid 183 2023-01-25T04:42:18.666 INFO:tasks.rados.rados.0.smithi116.stdout:183: seq_num 182 ranges {658874=771437,2083958=603055} 2023-01-25T04:42:18.670 INFO:tasks.rados.rados.0.smithi116.stdout:183: writing smithi116107171-183 from 658874 to 1430311 tid 1 2023-01-25T04:42:18.677 INFO:tasks.rados.rados.0.smithi116.stdout:183: writing smithi116107171-183 from 2083958 to 2687013 tid 2 2023-01-25T04:42:18.678 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.678 INFO:tasks.rados.rados.0.smithi116.stdout:168: finishing write tid 2 to smithi116107171-168 2023-01-25T04:42:18.678 INFO:tasks.rados.rados.0.smithi116.stdout:168: finishing write tid 3 to smithi116107171-168 2023-01-25T04:42:18.678 INFO:tasks.rados.rados.0.smithi116.stdout:168: finishing write tid 4 to smithi116107171-168 2023-01-25T04:42:18.679 INFO:tasks.rados.rados.0.smithi116.stdout:168: finishing write tid 5 to smithi116107171-168 2023-01-25T04:42:18.679 INFO:tasks.rados.rados.0.smithi116.stdout:168: oid 168 updating version 0 to 100 2023-01-25T04:42:18.679 INFO:tasks.rados.rados.0.smithi116.stdout:168: oid 168 version 100 is already newer than 99 2023-01-25T04:42:18.679 INFO:tasks.rados.rados.0.smithi116.stdout:168: oid 168 updating version 100 to 101 2023-01-25T04:42:18.679 INFO:tasks.rados.rados.0.smithi116.stdout:168: oid 168 version 101 is already newer than 98 2023-01-25T04:42:18.680 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 168 v 101 (ObjNum 167 snap 0 seq_num 167) dirty exists 2023-01-25T04:42:18.680 INFO:tasks.rados.rados.0.smithi116.stdout:168: left oid 168 (ObjNum 167 snap 0 seq_num 167) 2023-01-25T04:42:18.680 INFO:tasks.rados.rados.0.smithi116.stdout:169: finishing write tid 1 to smithi116107171-169 2023-01-25T04:42:18.680 INFO:tasks.rados.rados.0.smithi116.stdout:168: done (15 left) 2023-01-25T04:42:18.681 INFO:tasks.rados.rados.0.smithi116.stdout:184: write initial oid 184 2023-01-25T04:42:18.681 INFO:tasks.rados.rados.0.smithi116.stdout:184: seq_num 183 ranges {675681=563039,1858793=746713,3025937=49744} 2023-01-25T04:42:18.684 INFO:tasks.rados.rados.0.smithi116.stdout:184: writing smithi116107171-184 from 675681 to 1238720 tid 1 2023-01-25T04:42:18.692 INFO:tasks.rados.rados.0.smithi116.stdout:184: writing smithi116107171-184 from 1858793 to 2605506 tid 2 2023-01-25T04:42:18.695 INFO:tasks.rados.rados.0.smithi116.stdout:184: writing smithi116107171-184 from 3025937 to 3075681 tid 3 2023-01-25T04:42:18.695 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.695 INFO:tasks.rados.rados.0.smithi116.stdout:169: finishing write tid 2 to smithi116107171-169 2023-01-25T04:42:18.695 INFO:tasks.rados.rados.0.smithi116.stdout:169: finishing write tid 3 to smithi116107171-169 2023-01-25T04:42:18.695 INFO:tasks.rados.rados.0.smithi116.stdout:169: finishing write tid 4 to smithi116107171-169 2023-01-25T04:42:18.696 INFO:tasks.rados.rados.0.smithi116.stdout:169: oid 169 updating version 0 to 90 2023-01-25T04:42:18.696 INFO:tasks.rados.rados.0.smithi116.stdout:169: oid 169 version 90 is already newer than 89 2023-01-25T04:42:18.696 INFO:tasks.rados.rados.0.smithi116.stdout:169: oid 169 version 90 is already newer than 88 2023-01-25T04:42:18.696 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 169 v 90 (ObjNum 168 snap 0 seq_num 168) dirty exists 2023-01-25T04:42:18.697 INFO:tasks.rados.rados.0.smithi116.stdout:169: left oid 169 (ObjNum 168 snap 0 seq_num 168) 2023-01-25T04:42:18.697 INFO:tasks.rados.rados.0.smithi116.stdout:170: finishing write tid 1 to smithi116107171-170 2023-01-25T04:42:18.697 INFO:tasks.rados.rados.0.smithi116.stdout:169: done (15 left) 2023-01-25T04:42:18.697 INFO:tasks.rados.rados.0.smithi116.stdout:185: write initial oid 185 2023-01-25T04:42:18.697 INFO:tasks.rados.rados.0.smithi116.stdout:185: seq_num 184 ranges {692488=638288,1917275=606724} 2023-01-25T04:42:18.702 INFO:tasks.rados.rados.0.smithi116.stdout:185: writing smithi116107171-185 from 692488 to 1330776 tid 1 2023-01-25T04:42:18.709 INFO:tasks.rados.rados.0.smithi116.stdout:185: writing smithi116107171-185 from 1917275 to 2523999 tid 2 2023-01-25T04:42:18.709 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.709 INFO:tasks.rados.rados.0.smithi116.stdout:170: finishing write tid 2 to smithi116107171-170 2023-01-25T04:42:18.710 INFO:tasks.rados.rados.0.smithi116.stdout:170: finishing write tid 3 to smithi116107171-170 2023-01-25T04:42:18.710 INFO:tasks.rados.rados.0.smithi116.stdout:170: finishing write tid 4 to smithi116107171-170 2023-01-25T04:42:18.710 INFO:tasks.rados.rados.0.smithi116.stdout:170: finishing write tid 5 to smithi116107171-170 2023-01-25T04:42:18.710 INFO:tasks.rados.rados.0.smithi116.stdout:170: oid 170 updating version 0 to 92 2023-01-25T04:42:18.710 INFO:tasks.rados.rados.0.smithi116.stdout:170: oid 170 updating version 92 to 94 2023-01-25T04:42:18.711 INFO:tasks.rados.rados.0.smithi116.stdout:170: oid 170 version 94 is already newer than 93 2023-01-25T04:42:18.711 INFO:tasks.rados.rados.0.smithi116.stdout:170: oid 170 version 94 is already newer than 91 2023-01-25T04:42:18.711 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 170 v 94 (ObjNum 169 snap 0 seq_num 169) dirty exists 2023-01-25T04:42:18.711 INFO:tasks.rados.rados.0.smithi116.stdout:170: left oid 170 (ObjNum 169 snap 0 seq_num 169) 2023-01-25T04:42:18.711 INFO:tasks.rados.rados.0.smithi116.stdout:171: finishing write tid 1 to smithi116107171-171 2023-01-25T04:42:18.712 INFO:tasks.rados.rados.0.smithi116.stdout:171: finishing write tid 2 to smithi116107171-171 2023-01-25T04:42:18.712 INFO:tasks.rados.rados.0.smithi116.stdout:171: finishing write tid 3 to smithi116107171-171 2023-01-25T04:42:18.712 INFO:tasks.rados.rados.0.smithi116.stdout:171: finishing write tid 4 to smithi116107171-171 2023-01-25T04:42:18.712 INFO:tasks.rados.rados.0.smithi116.stdout:171: finishing write tid 5 to smithi116107171-171 2023-01-25T04:42:18.713 INFO:tasks.rados.rados.0.smithi116.stdout:171: oid 171 updating version 0 to 98 2023-01-25T04:42:18.713 INFO:tasks.rados.rados.0.smithi116.stdout:171: oid 171 version 98 is already newer than 96 2023-01-25T04:42:18.713 INFO:tasks.rados.rados.0.smithi116.stdout:171: oid 171 version 98 is already newer than 97 2023-01-25T04:42:18.713 INFO:tasks.rados.rados.0.smithi116.stdout:171: oid 171 version 98 is already newer than 95 2023-01-25T04:42:18.713 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 171 v 98 (ObjNum 170 snap 0 seq_num 170) dirty exists 2023-01-25T04:42:18.714 INFO:tasks.rados.rados.0.smithi116.stdout:171: left oid 171 (ObjNum 170 snap 0 seq_num 170) 2023-01-25T04:42:18.714 INFO:tasks.rados.rados.0.smithi116.stdout:170: done (15 left) 2023-01-25T04:42:18.714 INFO:tasks.rados.rados.0.smithi116.stdout:171: done (14 left) 2023-01-25T04:42:18.714 INFO:tasks.rados.rados.0.smithi116.stdout:186: write initial oid 186 2023-01-25T04:42:18.714 INFO:tasks.rados.rados.0.smithi116.stdout:186: seq_num 185 ranges {709295=713537,1859404=750382} 2023-01-25T04:42:18.716 INFO:tasks.rados.rados.0.smithi116.stdout:186: writing smithi116107171-186 from 709295 to 1422832 tid 1 2023-01-25T04:42:18.723 INFO:tasks.rados.rados.0.smithi116.stdout:186: writing smithi116107171-186 from 1859404 to 2609786 tid 2 2023-01-25T04:42:18.723 INFO:tasks.rados.rados.0.smithi116.stdout:187: write initial oid 187 2023-01-25T04:42:18.723 INFO:tasks.rados.rados.0.smithi116.stdout:187: seq_num 186 ranges {726102=788786,1917886=610393,3108206=17896} 2023-01-25T04:42:18.731 INFO:tasks.rados.rados.0.smithi116.stdout:187: writing smithi116107171-187 from 726102 to 1514888 tid 1 2023-01-25T04:42:18.736 INFO:tasks.rados.rados.0.smithi116.stdout:187: writing smithi116107171-187 from 1917886 to 2528279 tid 2 2023-01-25T04:42:18.742 INFO:tasks.rados.rados.0.smithi116.stdout:187: writing smithi116107171-187 from 3108206 to 3126102 tid 3 2023-01-25T04:42:18.742 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.742 INFO:tasks.rados.rados.0.smithi116.stdout:172: finishing write tid 1 to smithi116107171-172 2023-01-25T04:42:18.743 INFO:tasks.rados.rados.0.smithi116.stdout:172: finishing write tid 2 to smithi116107171-172 2023-01-25T04:42:18.743 INFO:tasks.rados.rados.0.smithi116.stdout:172: finishing write tid 3 to smithi116107171-172 2023-01-25T04:42:18.743 INFO:tasks.rados.rados.0.smithi116.stdout:172: finishing write tid 4 to smithi116107171-172 2023-01-25T04:42:18.743 INFO:tasks.rados.rados.0.smithi116.stdout:172: finishing write tid 5 to smithi116107171-172 2023-01-25T04:42:18.743 INFO:tasks.rados.rados.0.smithi116.stdout:172: oid 172 updating version 0 to 126 2023-01-25T04:42:18.744 INFO:tasks.rados.rados.0.smithi116.stdout:172: oid 172 version 126 is already newer than 125 2023-01-25T04:42:18.744 INFO:tasks.rados.rados.0.smithi116.stdout:172: oid 172 updating version 126 to 128 2023-01-25T04:42:18.744 INFO:tasks.rados.rados.0.smithi116.stdout:172: oid 172 version 128 is already newer than 127 2023-01-25T04:42:18.744 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 172 v 128 (ObjNum 171 snap 0 seq_num 171) dirty exists 2023-01-25T04:42:18.744 INFO:tasks.rados.rados.0.smithi116.stdout:172: left oid 172 (ObjNum 171 snap 0 seq_num 171) 2023-01-25T04:42:18.745 INFO:tasks.rados.rados.0.smithi116.stdout:173: finishing write tid 1 to smithi116107171-173 2023-01-25T04:42:18.745 INFO:tasks.rados.rados.0.smithi116.stdout:173: finishing write tid 2 to smithi116107171-173 2023-01-25T04:42:18.745 INFO:tasks.rados.rados.0.smithi116.stdout:173: finishing write tid 3 to smithi116107171-173 2023-01-25T04:42:18.745 INFO:tasks.rados.rados.0.smithi116.stdout:173: finishing write tid 4 to smithi116107171-173 2023-01-25T04:42:18.746 INFO:tasks.rados.rados.0.smithi116.stdout:173: finishing write tid 5 to smithi116107171-173 2023-01-25T04:42:18.746 INFO:tasks.rados.rados.0.smithi116.stdout:173: oid 173 updating version 0 to 132 2023-01-25T04:42:18.746 INFO:tasks.rados.rados.0.smithi116.stdout:173: oid 173 version 132 is already newer than 129 2023-01-25T04:42:18.746 INFO:tasks.rados.rados.0.smithi116.stdout:173: oid 173 version 132 is already newer than 131 2023-01-25T04:42:18.746 INFO:tasks.rados.rados.0.smithi116.stdout:173: oid 173 version 132 is already newer than 130 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 173 v 132 (ObjNum 172 snap 0 seq_num 172) dirty exists 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:173: left oid 173 (ObjNum 172 snap 0 seq_num 172) 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:174: finishing write tid 1 to smithi116107171-174 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:174: finishing write tid 2 to smithi116107171-174 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:174: finishing write tid 3 to smithi116107171-174 2023-01-25T04:42:18.747 INFO:tasks.rados.rados.0.smithi116.stdout:174: finishing write tid 4 to smithi116107171-174 2023-01-25T04:42:18.748 INFO:tasks.rados.rados.0.smithi116.stdout:174: oid 174 updating version 0 to 127 2023-01-25T04:42:18.748 INFO:tasks.rados.rados.0.smithi116.stdout:174: oid 174 version 127 is already newer than 125 2023-01-25T04:42:18.748 INFO:tasks.rados.rados.0.smithi116.stdout:174: oid 174 version 127 is already newer than 126 2023-01-25T04:42:18.748 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 174 v 127 (ObjNum 173 snap 0 seq_num 173) dirty exists 2023-01-25T04:42:18.749 INFO:tasks.rados.rados.0.smithi116.stdout:174: left oid 174 (ObjNum 173 snap 0 seq_num 173) 2023-01-25T04:42:18.749 INFO:tasks.rados.rados.0.smithi116.stdout:175: finishing write tid 1 to smithi116107171-175 2023-01-25T04:42:18.749 INFO:tasks.rados.rados.0.smithi116.stdout:175: finishing write tid 2 to smithi116107171-175 2023-01-25T04:42:18.749 INFO:tasks.rados.rados.0.smithi116.stdout:175: finishing write tid 3 to smithi116107171-175 2023-01-25T04:42:18.749 INFO:tasks.rados.rados.0.smithi116.stdout:175: finishing write tid 4 to smithi116107171-175 2023-01-25T04:42:18.750 INFO:tasks.rados.rados.0.smithi116.stdout:175: finishing write tid 5 to smithi116107171-175 2023-01-25T04:42:18.750 INFO:tasks.rados.rados.0.smithi116.stdout:175: oid 175 updating version 0 to 135 2023-01-25T04:42:18.750 INFO:tasks.rados.rados.0.smithi116.stdout:175: oid 175 version 135 is already newer than 134 2023-01-25T04:42:18.750 INFO:tasks.rados.rados.0.smithi116.stdout:175: oid 175 updating version 135 to 136 2023-01-25T04:42:18.750 INFO:tasks.rados.rados.0.smithi116.stdout:175: oid 175 version 136 is already newer than 133 2023-01-25T04:42:18.751 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 175 v 136 (ObjNum 174 snap 0 seq_num 174) dirty exists 2023-01-25T04:42:18.751 INFO:tasks.rados.rados.0.smithi116.stdout:175: left oid 175 (ObjNum 174 snap 0 seq_num 174) 2023-01-25T04:42:18.751 INFO:tasks.rados.rados.0.smithi116.stdout:176: finishing write tid 1 to smithi116107171-176 2023-01-25T04:42:18.751 INFO:tasks.rados.rados.0.smithi116.stdout:176: finishing write tid 2 to smithi116107171-176 2023-01-25T04:42:18.751 INFO:tasks.rados.rados.0.smithi116.stdout:176: finishing write tid 3 to smithi116107171-176 2023-01-25T04:42:18.752 INFO:tasks.rados.rados.0.smithi116.stdout:176: finishing write tid 4 to smithi116107171-176 2023-01-25T04:42:18.752 INFO:tasks.rados.rados.0.smithi116.stdout:176: oid 176 updating version 0 to 102 2023-01-25T04:42:18.752 INFO:tasks.rados.rados.0.smithi116.stdout:176: oid 176 updating version 102 to 103 2023-01-25T04:42:18.752 INFO:tasks.rados.rados.0.smithi116.stdout:176: oid 176 updating version 103 to 104 2023-01-25T04:42:18.752 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 176 v 104 (ObjNum 175 snap 0 seq_num 175) dirty exists 2023-01-25T04:42:18.753 INFO:tasks.rados.rados.0.smithi116.stdout:176: left oid 176 (ObjNum 175 snap 0 seq_num 175) 2023-01-25T04:42:18.753 INFO:tasks.rados.rados.0.smithi116.stdout:177: finishing write tid 1 to smithi116107171-177 2023-01-25T04:42:18.753 INFO:tasks.rados.rados.0.smithi116.stdout:172: done (15 left) 2023-01-25T04:42:18.753 INFO:tasks.rados.rados.0.smithi116.stdout:173: done (14 left) 2023-01-25T04:42:18.753 INFO:tasks.rados.rados.0.smithi116.stdout:174: done (13 left) 2023-01-25T04:42:18.754 INFO:tasks.rados.rados.0.smithi116.stdout:175: done (12 left) 2023-01-25T04:42:18.754 INFO:tasks.rados.rados.0.smithi116.stdout:176: done (11 left) 2023-01-25T04:42:18.755 INFO:tasks.rados.rados.0.smithi116.stdout:188: write initial oid 188 2023-01-25T04:42:18.755 INFO:tasks.rados.rados.0.smithi116.stdout:188: seq_num 187 ranges {742909=464035,1976368=754051} 2023-01-25T04:42:18.755 INFO:tasks.rados.rados.0.smithi116.stdout:188: writing smithi116107171-188 from 742909 to 1206944 tid 1 2023-01-25T04:42:18.756 INFO:tasks.rados.rados.0.smithi116.stdout:188: writing smithi116107171-188 from 1976368 to 2730419 tid 2 2023-01-25T04:42:18.756 INFO:tasks.rados.rados.0.smithi116.stdout:189: write initial oid 189 2023-01-25T04:42:18.756 INFO:tasks.rados.rados.0.smithi116.stdout:189: seq_num 188 ranges {759716=539284,2034850=614062} 2023-01-25T04:42:18.762 INFO:tasks.rados.rados.0.smithi116.stdout:189: writing smithi116107171-189 from 759716 to 1299000 tid 1 2023-01-25T04:42:18.769 INFO:tasks.rados.rados.0.smithi116.stdout:189: writing smithi116107171-189 from 2034850 to 2648912 tid 2 2023-01-25T04:42:18.769 INFO:tasks.rados.rados.0.smithi116.stdout:190: write initial oid 190 2023-01-25T04:42:18.770 INFO:tasks.rados.rados.0.smithi116.stdout:190: seq_num 189 ranges {776523=614533,1976979=757720} 2023-01-25T04:42:18.776 INFO:tasks.rados.rados.0.smithi116.stdout:190: writing smithi116107171-190 from 776523 to 1391056 tid 1 2023-01-25T04:42:18.784 INFO:tasks.rados.rados.0.smithi116.stdout:190: writing smithi116107171-190 from 1976979 to 2734699 tid 2 2023-01-25T04:42:18.784 INFO:tasks.rados.rados.0.smithi116.stdout:191: write initial oid 191 2023-01-25T04:42:18.784 INFO:tasks.rados.rados.0.smithi116.stdout:191: seq_num 190 ranges {793330=689782,2035461=617731,3101545=91785} 2023-01-25T04:42:18.792 INFO:tasks.rados.rados.0.smithi116.stdout:191: writing smithi116107171-191 from 793330 to 1483112 tid 1 2023-01-25T04:42:18.798 INFO:tasks.rados.rados.0.smithi116.stdout:191: writing smithi116107171-191 from 2035461 to 2653192 tid 2 2023-01-25T04:42:18.802 INFO:tasks.rados.rados.0.smithi116.stdout:191: writing smithi116107171-191 from 3101545 to 3193330 tid 3 2023-01-25T04:42:18.802 INFO:tasks.rados.rados.0.smithi116.stdout:192: write initial oid 192 2023-01-25T04:42:18.802 INFO:tasks.rados.rados.0.smithi116.stdout:192: seq_num 191 ranges {410137=481384,1410296=761389,2728968=481169} 2023-01-25T04:42:18.806 INFO:tasks.rados.rados.0.smithi116.stdout:192: writing smithi116107171-192 from 410137 to 891521 tid 1 2023-01-25T04:42:18.815 INFO:tasks.rados.rados.0.smithi116.stdout:192: writing smithi116107171-192 from 1410296 to 2171685 tid 2 2023-01-25T04:42:18.820 INFO:tasks.rados.rados.0.smithi116.stdout:192: writing smithi116107171-192 from 2728968 to 3210137 tid 3 2023-01-25T04:42:18.820 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.821 INFO:tasks.rados.rados.0.smithi116.stdout:177: finishing write tid 2 to smithi116107171-177 2023-01-25T04:42:18.821 INFO:tasks.rados.rados.0.smithi116.stdout:177: finishing write tid 3 to smithi116107171-177 2023-01-25T04:42:18.821 INFO:tasks.rados.rados.0.smithi116.stdout:177: finishing write tid 4 to smithi116107171-177 2023-01-25T04:42:18.821 INFO:tasks.rados.rados.0.smithi116.stdout:177: oid 177 updating version 0 to 137 2023-01-25T04:42:18.821 INFO:tasks.rados.rados.0.smithi116.stdout:177: oid 177 updating version 137 to 138 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:177: oid 177 updating version 138 to 139 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 177 v 139 (ObjNum 176 snap 0 seq_num 176) dirty exists 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:177: left oid 177 (ObjNum 176 snap 0 seq_num 176) 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:178: finishing write tid 1 to smithi116107171-178 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:178: finishing write tid 2 to smithi116107171-178 2023-01-25T04:42:18.822 INFO:tasks.rados.rados.0.smithi116.stdout:177: done (15 left) 2023-01-25T04:42:18.823 INFO:tasks.rados.rados.0.smithi116.stdout:193: write initial oid 193 2023-01-25T04:42:18.823 INFO:tasks.rados.rados.0.smithi116.stdout:193: seq_num 192 ranges {426944=556633,1468778=621400,2872744=354200} 2023-01-25T04:42:18.825 INFO:tasks.rados.rados.0.smithi116.stdout:193: writing smithi116107171-193 from 426944 to 983577 tid 1 2023-01-25T04:42:18.831 INFO:tasks.rados.rados.0.smithi116.stdout:193: writing smithi116107171-193 from 1468778 to 2090178 tid 2 2023-01-25T04:42:18.838 INFO:tasks.rados.rados.0.smithi116.stdout:193: writing smithi116107171-193 from 2872744 to 3226944 tid 3 2023-01-25T04:42:18.838 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.838 INFO:tasks.rados.rados.0.smithi116.stdout:178: finishing write tid 3 to smithi116107171-178 2023-01-25T04:42:18.839 INFO:tasks.rados.rados.0.smithi116.stdout:178: finishing write tid 4 to smithi116107171-178 2023-01-25T04:42:18.839 INFO:tasks.rados.rados.0.smithi116.stdout:178: oid 178 updating version 0 to 99 2023-01-25T04:42:18.839 INFO:tasks.rados.rados.0.smithi116.stdout:178: oid 178 updating version 99 to 101 2023-01-25T04:42:18.839 INFO:tasks.rados.rados.0.smithi116.stdout:178: oid 178 version 101 is already newer than 100 2023-01-25T04:42:18.839 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 178 v 101 (ObjNum 177 snap 0 seq_num 177) dirty exists 2023-01-25T04:42:18.840 INFO:tasks.rados.rados.0.smithi116.stdout:178: left oid 178 (ObjNum 177 snap 0 seq_num 177) 2023-01-25T04:42:18.840 INFO:tasks.rados.rados.0.smithi116.stdout:179: finishing write tid 1 to smithi116107171-179 2023-01-25T04:42:18.840 INFO:tasks.rados.rados.0.smithi116.stdout:179: finishing write tid 2 to smithi116107171-179 2023-01-25T04:42:18.840 INFO:tasks.rados.rados.0.smithi116.stdout:178: done (15 left) 2023-01-25T04:42:18.840 INFO:tasks.rados.rados.0.smithi116.stdout:194: write initial oid 194 2023-01-25T04:42:18.841 INFO:tasks.rados.rados.0.smithi116.stdout:194: seq_num 193 ranges {443751=631882,1810907=765058,3067461=176290} 2023-01-25T04:42:18.844 INFO:tasks.rados.rados.0.smithi116.stdout:194: writing smithi116107171-194 from 443751 to 1075633 tid 1 2023-01-25T04:42:18.852 INFO:tasks.rados.rados.0.smithi116.stdout:194: writing smithi116107171-194 from 1810907 to 2575965 tid 2 2023-01-25T04:42:18.856 INFO:tasks.rados.rados.0.smithi116.stdout:194: writing smithi116107171-194 from 3067461 to 3243751 tid 3 2023-01-25T04:42:18.856 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.857 INFO:tasks.rados.rados.0.smithi116.stdout:179: finishing write tid 3 to smithi116107171-179 2023-01-25T04:42:18.857 INFO:tasks.rados.rados.0.smithi116.stdout:179: finishing write tid 4 to smithi116107171-179 2023-01-25T04:42:18.857 INFO:tasks.rados.rados.0.smithi116.stdout:179: finishing write tid 5 to smithi116107171-179 2023-01-25T04:42:18.857 INFO:tasks.rados.rados.0.smithi116.stdout:179: oid 179 updating version 0 to 104 2023-01-25T04:42:18.857 INFO:tasks.rados.rados.0.smithi116.stdout:179: oid 179 updating version 104 to 105 2023-01-25T04:42:18.858 INFO:tasks.rados.rados.0.smithi116.stdout:179: oid 179 version 105 is already newer than 103 2023-01-25T04:42:18.858 INFO:tasks.rados.rados.0.smithi116.stdout:179: oid 179 version 105 is already newer than 102 2023-01-25T04:42:18.858 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 179 v 105 (ObjNum 178 snap 0 seq_num 178) dirty exists 2023-01-25T04:42:18.858 INFO:tasks.rados.rados.0.smithi116.stdout:179: left oid 179 (ObjNum 178 snap 0 seq_num 178) 2023-01-25T04:42:18.858 INFO:tasks.rados.rados.0.smithi116.stdout:180: finishing write tid 1 to smithi116107171-180 2023-01-25T04:42:18.859 INFO:tasks.rados.rados.0.smithi116.stdout:179: done (15 left) 2023-01-25T04:42:18.859 INFO:tasks.rados.rados.0.smithi116.stdout:195: write initial oid 195 2023-01-25T04:42:18.859 INFO:tasks.rados.rados.0.smithi116.stdout:195: seq_num 194 ranges {460558=707131,1869389=508716,3094884=165674} 2023-01-25T04:42:18.862 INFO:tasks.rados.rados.0.smithi116.stdout:195: writing smithi116107171-195 from 460558 to 1167689 tid 1 2023-01-25T04:42:18.869 INFO:tasks.rados.rados.0.smithi116.stdout:195: writing smithi116107171-195 from 1869389 to 2378105 tid 2 2023-01-25T04:42:18.875 INFO:tasks.rados.rados.0.smithi116.stdout:195: writing smithi116107171-195 from 3094884 to 3260558 tid 3 2023-01-25T04:42:18.875 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.875 INFO:tasks.rados.rados.0.smithi116.stdout:180: finishing write tid 2 to smithi116107171-180 2023-01-25T04:42:18.876 INFO:tasks.rados.rados.0.smithi116.stdout:180: finishing write tid 3 to smithi116107171-180 2023-01-25T04:42:18.876 INFO:tasks.rados.rados.0.smithi116.stdout:180: finishing write tid 4 to smithi116107171-180 2023-01-25T04:42:18.876 INFO:tasks.rados.rados.0.smithi116.stdout:180: finishing write tid 5 to smithi116107171-180 2023-01-25T04:42:18.876 INFO:tasks.rados.rados.0.smithi116.stdout:180: oid 180 updating version 0 to 129 2023-01-25T04:42:18.877 INFO:tasks.rados.rados.0.smithi116.stdout:180: oid 180 version 129 is already newer than 128 2023-01-25T04:42:18.877 INFO:tasks.rados.rados.0.smithi116.stdout:180: oid 180 updating version 129 to 130 2023-01-25T04:42:18.877 INFO:tasks.rados.rados.0.smithi116.stdout:180: oid 180 updating version 130 to 131 2023-01-25T04:42:18.877 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 180 v 131 (ObjNum 179 snap 0 seq_num 179) dirty exists 2023-01-25T04:42:18.877 INFO:tasks.rados.rados.0.smithi116.stdout:180: left oid 180 (ObjNum 179 snap 0 seq_num 179) 2023-01-25T04:42:18.878 INFO:tasks.rados.rados.0.smithi116.stdout:181: finishing write tid 1 to smithi116107171-181 2023-01-25T04:42:18.878 INFO:tasks.rados.rados.0.smithi116.stdout:181: finishing write tid 2 to smithi116107171-181 2023-01-25T04:42:18.878 INFO:tasks.rados.rados.0.smithi116.stdout:181: finishing write tid 3 to smithi116107171-181 2023-01-25T04:42:18.878 INFO:tasks.rados.rados.0.smithi116.stdout:181: finishing write tid 4 to smithi116107171-181 2023-01-25T04:42:18.878 INFO:tasks.rados.rados.0.smithi116.stdout:181: finishing write tid 5 to smithi116107171-181 2023-01-25T04:42:18.879 INFO:tasks.rados.rados.0.smithi116.stdout:181: oid 181 updating version 0 to 105 2023-01-25T04:42:18.879 INFO:tasks.rados.rados.0.smithi116.stdout:181: oid 181 updating version 105 to 107 2023-01-25T04:42:18.879 INFO:tasks.rados.rados.0.smithi116.stdout:181: oid 181 version 107 is already newer than 106 2023-01-25T04:42:18.879 INFO:tasks.rados.rados.0.smithi116.stdout:181: oid 181 updating version 107 to 108 2023-01-25T04:42:18.879 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 181 v 108 (ObjNum 180 snap 0 seq_num 180) dirty exists 2023-01-25T04:42:18.880 INFO:tasks.rados.rados.0.smithi116.stdout:181: left oid 181 (ObjNum 180 snap 0 seq_num 180) 2023-01-25T04:42:18.880 INFO:tasks.rados.rados.0.smithi116.stdout:182: finishing write tid 1 to smithi116107171-182 2023-01-25T04:42:18.880 INFO:tasks.rados.rados.0.smithi116.stdout:182: finishing write tid 2 to smithi116107171-182 2023-01-25T04:42:18.880 INFO:tasks.rados.rados.0.smithi116.stdout:182: finishing write tid 3 to smithi116107171-182 2023-01-25T04:42:18.880 INFO:tasks.rados.rados.0.smithi116.stdout:182: finishing write tid 4 to smithi116107171-182 2023-01-25T04:42:18.881 INFO:tasks.rados.rados.0.smithi116.stdout:182: finishing write tid 5 to smithi116107171-182 2023-01-25T04:42:18.881 INFO:tasks.rados.rados.0.smithi116.stdout:182: oid 182 updating version 0 to 134 2023-01-25T04:42:18.881 INFO:tasks.rados.rados.0.smithi116.stdout:182: oid 182 version 134 is already newer than 133 2023-01-25T04:42:18.881 INFO:tasks.rados.rados.0.smithi116.stdout:182: oid 182 version 134 is already newer than 132 2023-01-25T04:42:18.881 INFO:tasks.rados.rados.0.smithi116.stdout:182: oid 182 updating version 134 to 135 2023-01-25T04:42:18.882 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 182 v 135 (ObjNum 181 snap 0 seq_num 181) dirty exists 2023-01-25T04:42:18.882 INFO:tasks.rados.rados.0.smithi116.stdout:182: left oid 182 (ObjNum 181 snap 0 seq_num 181) 2023-01-25T04:42:18.882 INFO:tasks.rados.rados.0.smithi116.stdout:183: finishing write tid 1 to smithi116107171-183 2023-01-25T04:42:18.882 INFO:tasks.rados.rados.0.smithi116.stdout:180: done (15 left) 2023-01-25T04:42:18.882 INFO:tasks.rados.rados.0.smithi116.stdout:181: done (14 left) 2023-01-25T04:42:18.883 INFO:tasks.rados.rados.0.smithi116.stdout:182: done (13 left) 2023-01-25T04:42:18.883 INFO:tasks.rados.rados.0.smithi116.stdout:196: write initial oid 196 2023-01-25T04:42:18.883 INFO:tasks.rados.rados.0.smithi116.stdout:196: seq_num 195 ranges {477365=782380,1927871=768727,3122307=155058} 2023-01-25T04:42:18.883 INFO:tasks.rados.rados.0.smithi116.stdout:196: writing smithi116107171-196 from 477365 to 1259745 tid 1 2023-01-25T04:42:18.888 INFO:tasks.rados.rados.0.smithi116.stdout:196: writing smithi116107171-196 from 1927871 to 2696598 tid 2 2023-01-25T04:42:18.892 INFO:tasks.rados.rados.0.smithi116.stdout:196: writing smithi116107171-196 from 3122307 to 3277365 tid 3 2023-01-25T04:42:18.892 INFO:tasks.rados.rados.0.smithi116.stdout:197: write initial oid 197 2023-01-25T04:42:18.892 INFO:tasks.rados.rados.0.smithi116.stdout:197: seq_num 196 ranges {494172=457629,1586353=512385,2749730=544442} 2023-01-25T04:42:18.897 INFO:tasks.rados.rados.0.smithi116.stdout:197: writing smithi116107171-197 from 494172 to 951801 tid 1 2023-01-25T04:42:18.903 INFO:tasks.rados.rados.0.smithi116.stdout:197: writing smithi116107171-197 from 1586353 to 2098738 tid 2 2023-01-25T04:42:18.910 INFO:tasks.rados.rados.0.smithi116.stdout:197: writing smithi116107171-197 from 2749730 to 3294172 tid 3 2023-01-25T04:42:18.910 INFO:tasks.rados.rados.0.smithi116.stdout:198: write initial oid 198 2023-01-25T04:42:18.910 INFO:tasks.rados.rados.0.smithi116.stdout:198: seq_num 197 ranges {510979=532878,1528482=772396,3060800=250179} 2023-01-25T04:42:18.915 INFO:tasks.rados.rados.0.smithi116.stdout:198: writing smithi116107171-198 from 510979 to 1043857 tid 1 2023-01-25T04:42:18.922 INFO:tasks.rados.rados.0.smithi116.stdout:198: writing smithi116107171-198 from 1528482 to 2300878 tid 2 2023-01-25T04:42:18.930 INFO:tasks.rados.rados.0.smithi116.stdout:198: writing smithi116107171-198 from 3060800 to 3310979 tid 3 2023-01-25T04:42:18.931 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:18.931 INFO:tasks.rados.rados.0.smithi116.stdout:183: finishing write tid 2 to smithi116107171-183 2023-01-25T04:42:18.931 INFO:tasks.rados.rados.0.smithi116.stdout:183: finishing write tid 3 to smithi116107171-183 2023-01-25T04:42:18.931 INFO:tasks.rados.rados.0.smithi116.stdout:183: finishing write tid 4 to smithi116107171-183 2023-01-25T04:42:18.932 INFO:tasks.rados.rados.0.smithi116.stdout:183: oid 183 updating version 0 to 142 2023-01-25T04:42:18.932 INFO:tasks.rados.rados.0.smithi116.stdout:183: oid 183 version 142 is already newer than 141 2023-01-25T04:42:18.932 INFO:tasks.rados.rados.0.smithi116.stdout:183: oid 183 version 142 is already newer than 140 2023-01-25T04:42:18.932 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 183 v 142 (ObjNum 182 snap 0 seq_num 182) dirty exists 2023-01-25T04:42:18.932 INFO:tasks.rados.rados.0.smithi116.stdout:183: left oid 183 (ObjNum 182 snap 0 seq_num 182) 2023-01-25T04:42:18.933 INFO:tasks.rados.rados.0.smithi116.stdout:184: finishing write tid 1 to smithi116107171-184 2023-01-25T04:42:18.933 INFO:tasks.rados.rados.0.smithi116.stdout:184: finishing write tid 2 to smithi116107171-184 2023-01-25T04:42:18.933 INFO:tasks.rados.rados.0.smithi116.stdout:184: finishing write tid 3 to smithi116107171-184 2023-01-25T04:42:18.933 INFO:tasks.rados.rados.0.smithi116.stdout:184: finishing write tid 4 to smithi116107171-184 2023-01-25T04:42:18.933 INFO:tasks.rados.rados.0.smithi116.stdout:184: finishing write tid 5 to smithi116107171-184 2023-01-25T04:42:18.934 INFO:tasks.rados.rados.0.smithi116.stdout:184: oid 184 updating version 0 to 144 2023-01-25T04:42:18.934 INFO:tasks.rados.rados.0.smithi116.stdout:184: oid 184 version 144 is already newer than 143 2023-01-25T04:42:18.934 INFO:tasks.rados.rados.0.smithi116.stdout:184: oid 184 updating version 144 to 146 2023-01-25T04:42:18.934 INFO:tasks.rados.rados.0.smithi116.stdout:184: oid 184 version 146 is already newer than 145 2023-01-25T04:42:18.934 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 184 v 146 (ObjNum 183 snap 0 seq_num 183) dirty exists 2023-01-25T04:42:18.935 INFO:tasks.rados.rados.0.smithi116.stdout:184: left oid 184 (ObjNum 183 snap 0 seq_num 183) 2023-01-25T04:42:18.935 INFO:tasks.rados.rados.0.smithi116.stdout:185: finishing write tid 1 to smithi116107171-185 2023-01-25T04:42:18.935 INFO:tasks.rados.rados.0.smithi116.stdout:185: finishing write tid 2 to smithi116107171-185 2023-01-25T04:42:18.935 INFO:tasks.rados.rados.0.smithi116.stdout:185: finishing write tid 3 to smithi116107171-185 2023-01-25T04:42:18.935 INFO:tasks.rados.rados.0.smithi116.stdout:185: finishing write tid 4 to smithi116107171-185 2023-01-25T04:42:18.936 INFO:tasks.rados.rados.0.smithi116.stdout:185: oid 185 updating version 0 to 149 2023-01-25T04:42:18.936 INFO:tasks.rados.rados.0.smithi116.stdout:185: oid 185 version 149 is already newer than 147 2023-01-25T04:42:18.936 INFO:tasks.rados.rados.0.smithi116.stdout:185: oid 185 version 149 is already newer than 148 2023-01-25T04:42:18.936 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 185 v 149 (ObjNum 184 snap 0 seq_num 184) dirty exists 2023-01-25T04:42:18.936 INFO:tasks.rados.rados.0.smithi116.stdout:185: left oid 185 (ObjNum 184 snap 0 seq_num 184) 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: finishing write tid 1 to smithi116107171-186 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: finishing write tid 2 to smithi116107171-186 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: finishing write tid 3 to smithi116107171-186 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: finishing write tid 4 to smithi116107171-186 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: oid 186 updating version 0 to 108 2023-01-25T04:42:18.937 INFO:tasks.rados.rados.0.smithi116.stdout:186: oid 186 version 108 is already newer than 106 2023-01-25T04:42:18.938 INFO:tasks.rados.rados.0.smithi116.stdout:186: oid 186 version 108 is already newer than 107 2023-01-25T04:42:18.938 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 186 v 108 (ObjNum 185 snap 0 seq_num 185) dirty exists 2023-01-25T04:42:18.938 INFO:tasks.rados.rados.0.smithi116.stdout:186: left oid 186 (ObjNum 185 snap 0 seq_num 185) 2023-01-25T04:42:18.938 INFO:tasks.rados.rados.0.smithi116.stdout:187: finishing write tid 1 to smithi116107171-187 2023-01-25T04:42:18.938 INFO:tasks.rados.rados.0.smithi116.stdout:187: finishing write tid 2 to smithi116107171-187 2023-01-25T04:42:18.939 INFO:tasks.rados.rados.0.smithi116.stdout:187: finishing write tid 3 to smithi116107171-187 2023-01-25T04:42:18.939 INFO:tasks.rados.rados.0.smithi116.stdout:187: finishing write tid 4 to smithi116107171-187 2023-01-25T04:42:18.939 INFO:tasks.rados.rados.0.smithi116.stdout:187: finishing write tid 5 to smithi116107171-187 2023-01-25T04:42:18.939 INFO:tasks.rados.rados.0.smithi116.stdout:187: oid 187 updating version 0 to 150 2023-01-25T04:42:18.939 INFO:tasks.rados.rados.0.smithi116.stdout:187: oid 187 updating version 150 to 151 2023-01-25T04:42:18.940 INFO:tasks.rados.rados.0.smithi116.stdout:187: oid 187 updating version 151 to 152 2023-01-25T04:42:18.940 INFO:tasks.rados.rados.0.smithi116.stdout:187: oid 187 updating version 152 to 153 2023-01-25T04:42:18.940 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 187 v 153 (ObjNum 186 snap 0 seq_num 186) dirty exists 2023-01-25T04:42:18.940 INFO:tasks.rados.rados.0.smithi116.stdout:187: left oid 187 (ObjNum 186 snap 0 seq_num 186) 2023-01-25T04:42:18.940 INFO:tasks.rados.rados.0.smithi116.stdout:188: finishing write tid 1 to smithi116107171-188 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: finishing write tid 2 to smithi116107171-188 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: finishing write tid 3 to smithi116107171-188 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: finishing write tid 4 to smithi116107171-188 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: oid 188 updating version 0 to 110 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: oid 188 version 110 is already newer than 109 2023-01-25T04:42:18.941 INFO:tasks.rados.rados.0.smithi116.stdout:188: oid 188 updating version 110 to 111 2023-01-25T04:42:18.942 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 188 v 111 (ObjNum 187 snap 0 seq_num 187) dirty exists 2023-01-25T04:42:18.942 INFO:tasks.rados.rados.0.smithi116.stdout:188: left oid 188 (ObjNum 187 snap 0 seq_num 187) 2023-01-25T04:42:18.942 INFO:tasks.rados.rados.0.smithi116.stdout:189: finishing write tid 1 to smithi116107171-189 2023-01-25T04:42:18.942 INFO:tasks.rados.rados.0.smithi116.stdout:183: done (15 left) 2023-01-25T04:42:18.942 INFO:tasks.rados.rados.0.smithi116.stdout:184: done (14 left) 2023-01-25T04:42:18.943 INFO:tasks.rados.rados.0.smithi116.stdout:185: done (13 left) 2023-01-25T04:42:18.943 INFO:tasks.rados.rados.0.smithi116.stdout:186: done (12 left) 2023-01-25T04:42:18.943 INFO:tasks.rados.rados.0.smithi116.stdout:187: done (11 left) 2023-01-25T04:42:18.943 INFO:tasks.rados.rados.0.smithi116.stdout:188: done (10 left) 2023-01-25T04:42:18.943 INFO:tasks.rados.rados.0.smithi116.stdout:199: write initial oid 199 2023-01-25T04:42:18.944 INFO:tasks.rados.rados.0.smithi116.stdout:199: seq_num 198 ranges {527786=724480,1703317=516054,2804576=435035} 2023-01-25T04:42:18.944 INFO:tasks.rados.rados.0.smithi116.stdout:199: writing smithi116107171-199 from 527786 to 1252266 tid 1 2023-01-25T04:42:18.944 INFO:tasks.rados.rados.0.smithi116.stdout:199: writing smithi116107171-199 from 1703317 to 2219371 tid 2 2023-01-25T04:42:18.945 INFO:tasks.rados.rados.0.smithi116.stdout:199: writing smithi116107171-199 from 2804576 to 3239611 tid 3 2023-01-25T04:42:18.946 INFO:tasks.rados.rados.0.smithi116.stdout:200: write initial oid 200 2023-01-25T04:42:18.946 INFO:tasks.rados.rados.0.smithi116.stdout:200: seq_num 199 ranges {544593=799729,1761799=776065,2948352=396241} 2023-01-25T04:42:18.952 INFO:tasks.rados.rados.0.smithi116.stdout:200: writing smithi116107171-200 from 544593 to 1344322 tid 1 2023-01-25T04:42:18.959 INFO:tasks.rados.rados.0.smithi116.stdout:200: writing smithi116107171-200 from 1761799 to 2537864 tid 2 2023-01-25T04:42:18.964 INFO:tasks.rados.rados.0.smithi116.stdout:200: writing smithi116107171-200 from 2948352 to 3344593 tid 3 2023-01-25T04:42:18.964 INFO:tasks.rados.rados.0.smithi116.stdout:201: write initial oid 201 2023-01-25T04:42:18.964 INFO:tasks.rados.rados.0.smithi116.stdout:201: seq_num 200 ranges {561400=474978,1820281=519723,2859422=457579} 2023-01-25T04:42:18.969 INFO:tasks.rados.rados.0.smithi116.stdout:201: writing smithi116107171-201 from 561400 to 1036378 tid 1 2023-01-25T04:42:18.976 INFO:tasks.rados.rados.0.smithi116.stdout:201: writing smithi116107171-201 from 1820281 to 2340004 tid 2 2023-01-25T04:42:18.982 INFO:tasks.rados.rados.0.smithi116.stdout:201: writing smithi116107171-201 from 2859422 to 3317001 tid 3 2023-01-25T04:42:18.982 INFO:tasks.rados.rados.0.smithi116.stdout:202: write initial oid 202 2023-01-25T04:42:18.982 INFO:tasks.rados.rados.0.smithi116.stdout:202: seq_num 201 ranges {578207=550227,1762410=779734,3286845=91362} 2023-01-25T04:42:18.988 INFO:tasks.rados.rados.0.smithi116.stdout:202: writing smithi116107171-202 from 578207 to 1128434 tid 1 2023-01-25T04:42:18.996 INFO:tasks.rados.rados.0.smithi116.stdout:202: writing smithi116107171-202 from 1762410 to 2542144 tid 2 2023-01-25T04:42:19.001 INFO:tasks.rados.rados.0.smithi116.stdout:202: writing smithi116107171-202 from 3286845 to 3378207 tid 3 2023-01-25T04:42:19.001 INFO:tasks.rados.rados.0.smithi116.stdout:203: write initial oid 203 2023-01-25T04:42:19.002 INFO:tasks.rados.rados.0.smithi116.stdout:203: seq_num 202 ranges {595014=625476,1820892=523392,2797915=596476} 2023-01-25T04:42:19.007 INFO:tasks.rados.rados.0.smithi116.stdout:203: writing smithi116107171-203 from 595014 to 1220490 tid 1 2023-01-25T04:42:19.013 INFO:tasks.rados.rados.0.smithi116.stdout:203: writing smithi116107171-203 from 1820892 to 2344284 tid 2 2023-01-25T04:42:19.019 INFO:tasks.rados.rados.0.smithi116.stdout:203: writing smithi116107171-203 from 2797915 to 3394391 tid 3 2023-01-25T04:42:19.020 INFO:tasks.rados.rados.0.smithi116.stdout:204: write initial oid 204 2023-01-25T04:42:19.020 INFO:tasks.rados.rados.0.smithi116.stdout:204: seq_num 203 ranges {611821=700725,1879374=783403,3341691=70130} 2023-01-25T04:42:19.025 INFO:tasks.rados.rados.0.smithi116.stdout:204: writing smithi116107171-204 from 611821 to 1312546 tid 1 2023-01-25T04:42:19.033 INFO:tasks.rados.rados.0.smithi116.stdout:204: writing smithi116107171-204 from 1879374 to 2662777 tid 2 2023-01-25T04:42:19.037 INFO:tasks.rados.rados.0.smithi116.stdout:204: writing smithi116107171-204 from 3341691 to 3411821 tid 3 2023-01-25T04:42:19.038 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.038 INFO:tasks.rados.rados.0.smithi116.stdout:189: finishing write tid 2 to smithi116107171-189 2023-01-25T04:42:19.038 INFO:tasks.rados.rados.0.smithi116.stdout:189: finishing write tid 3 to smithi116107171-189 2023-01-25T04:42:19.038 INFO:tasks.rados.rados.0.smithi116.stdout:189: finishing write tid 4 to smithi116107171-189 2023-01-25T04:42:19.038 INFO:tasks.rados.rados.0.smithi116.stdout:189: oid 189 updating version 0 to 111 2023-01-25T04:42:19.039 INFO:tasks.rados.rados.0.smithi116.stdout:189: oid 189 version 111 is already newer than 109 2023-01-25T04:42:19.039 INFO:tasks.rados.rados.0.smithi116.stdout:189: oid 189 version 111 is already newer than 110 2023-01-25T04:42:19.039 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 189 v 111 (ObjNum 188 snap 0 seq_num 188) dirty exists 2023-01-25T04:42:19.039 INFO:tasks.rados.rados.0.smithi116.stdout:189: left oid 189 (ObjNum 188 snap 0 seq_num 188) 2023-01-25T04:42:19.040 INFO:tasks.rados.rados.0.smithi116.stdout:190: finishing write tid 1 to smithi116107171-190 2023-01-25T04:42:19.040 INFO:tasks.rados.rados.0.smithi116.stdout:190: finishing write tid 2 to smithi116107171-190 2023-01-25T04:42:19.040 INFO:tasks.rados.rados.0.smithi116.stdout:189: done (15 left) 2023-01-25T04:42:19.041 INFO:tasks.rados.rados.0.smithi116.stdout:205: write initial oid 205 2023-01-25T04:42:19.041 INFO:tasks.rados.rados.0.smithi116.stdout:205: seq_num 204 ranges {628628=775974,1937856=527061,3252761=175867} 2023-01-25T04:42:19.044 INFO:tasks.rados.rados.0.smithi116.stdout:205: writing smithi116107171-205 from 628628 to 1404602 tid 1 2023-01-25T04:42:19.050 INFO:tasks.rados.rados.0.smithi116.stdout:205: writing smithi116107171-205 from 1937856 to 2464917 tid 2 2023-01-25T04:42:19.056 INFO:tasks.rados.rados.0.smithi116.stdout:205: writing smithi116107171-205 from 3252761 to 3428628 tid 3 2023-01-25T04:42:19.057 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.057 INFO:tasks.rados.rados.0.smithi116.stdout:190: finishing write tid 3 to smithi116107171-190 2023-01-25T04:42:19.057 INFO:tasks.rados.rados.0.smithi116.stdout:190: finishing write tid 4 to smithi116107171-190 2023-01-25T04:42:19.058 INFO:tasks.rados.rados.0.smithi116.stdout:190: oid 190 updating version 0 to 113 2023-01-25T04:42:19.058 INFO:tasks.rados.rados.0.smithi116.stdout:190: oid 190 version 113 is already newer than 112 2023-01-25T04:42:19.058 INFO:tasks.rados.rados.0.smithi116.stdout:190: oid 190 updating version 113 to 114 2023-01-25T04:42:19.059 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 190 v 114 (ObjNum 189 snap 0 seq_num 189) dirty exists 2023-01-25T04:42:19.059 INFO:tasks.rados.rados.0.smithi116.stdout:190: left oid 190 (ObjNum 189 snap 0 seq_num 189) 2023-01-25T04:42:19.059 INFO:tasks.rados.rados.0.smithi116.stdout:191: finishing write tid 1 to smithi116107171-191 2023-01-25T04:42:19.060 INFO:tasks.rados.rados.0.smithi116.stdout:191: finishing write tid 2 to smithi116107171-191 2023-01-25T04:42:19.060 INFO:tasks.rados.rados.0.smithi116.stdout:190: done (15 left) 2023-01-25T04:42:19.060 INFO:tasks.rados.rados.0.smithi116.stdout:206: write initial oid 206 2023-01-25T04:42:19.061 INFO:tasks.rados.rados.0.smithi116.stdout:206: seq_num 205 ranges {645435=451223,1879985=787072,3280184=165251} 2023-01-25T04:42:19.061 INFO:tasks.rados.rados.0.smithi116.stdout:206: writing smithi116107171-206 from 645435 to 1096658 tid 1 2023-01-25T04:42:19.070 INFO:tasks.rados.rados.0.smithi116.stdout:206: writing smithi116107171-206 from 1879985 to 2667057 tid 2 2023-01-25T04:42:19.076 INFO:tasks.rados.rados.0.smithi116.stdout:206: writing smithi116107171-206 from 3280184 to 3445435 tid 3 2023-01-25T04:42:19.076 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.076 INFO:tasks.rados.rados.0.smithi116.stdout:191: finishing write tid 3 to smithi116107171-191 2023-01-25T04:42:19.076 INFO:tasks.rados.rados.0.smithi116.stdout:191: finishing write tid 4 to smithi116107171-191 2023-01-25T04:42:19.076 INFO:tasks.rados.rados.0.smithi116.stdout:191: finishing write tid 5 to smithi116107171-191 2023-01-25T04:42:19.077 INFO:tasks.rados.rados.0.smithi116.stdout:191: oid 191 updating version 0 to 157 2023-01-25T04:42:19.077 INFO:tasks.rados.rados.0.smithi116.stdout:191: oid 191 version 157 is already newer than 155 2023-01-25T04:42:19.077 INFO:tasks.rados.rados.0.smithi116.stdout:191: oid 191 version 157 is already newer than 154 2023-01-25T04:42:19.078 INFO:tasks.rados.rados.0.smithi116.stdout:191: oid 191 version 157 is already newer than 156 2023-01-25T04:42:19.078 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 191 v 157 (ObjNum 190 snap 0 seq_num 190) dirty exists 2023-01-25T04:42:19.078 INFO:tasks.rados.rados.0.smithi116.stdout:191: left oid 191 (ObjNum 190 snap 0 seq_num 190) 2023-01-25T04:42:19.078 INFO:tasks.rados.rados.0.smithi116.stdout:192: finishing write tid 1 to smithi116107171-192 2023-01-25T04:42:19.078 INFO:tasks.rados.rados.0.smithi116.stdout:191: done (15 left) 2023-01-25T04:42:19.079 INFO:tasks.rados.rados.0.smithi116.stdout:207: write initial oid 207 2023-01-25T04:42:19.079 INFO:tasks.rados.rados.0.smithi116.stdout:207: seq_num 206 ranges {662242=642825,2054820=530730,3307607=154635} 2023-01-25T04:42:19.082 INFO:tasks.rados.rados.0.smithi116.stdout:207: writing smithi116107171-207 from 662242 to 1305067 tid 1 2023-01-25T04:42:19.088 INFO:tasks.rados.rados.0.smithi116.stdout:207: writing smithi116107171-207 from 2054820 to 2585550 tid 2 2023-01-25T04:42:19.094 INFO:tasks.rados.rados.0.smithi116.stdout:207: writing smithi116107171-207 from 3307607 to 3462242 tid 3 2023-01-25T04:42:19.094 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.094 INFO:tasks.rados.rados.0.smithi116.stdout:192: finishing write tid 2 to smithi116107171-192 2023-01-25T04:42:19.094 INFO:tasks.rados.rados.0.smithi116.stdout:192: finishing write tid 3 to smithi116107171-192 2023-01-25T04:42:19.094 INFO:tasks.rados.rados.0.smithi116.stdout:192: finishing write tid 4 to smithi116107171-192 2023-01-25T04:42:19.095 INFO:tasks.rados.rados.0.smithi116.stdout:192: finishing write tid 5 to smithi116107171-192 2023-01-25T04:42:19.095 INFO:tasks.rados.rados.0.smithi116.stdout:192: oid 192 updating version 0 to 117 2023-01-25T04:42:19.095 INFO:tasks.rados.rados.0.smithi116.stdout:192: oid 192 version 117 is already newer than 116 2023-01-25T04:42:19.095 INFO:tasks.rados.rados.0.smithi116.stdout:192: oid 192 updating version 117 to 118 2023-01-25T04:42:19.095 INFO:tasks.rados.rados.0.smithi116.stdout:192: oid 192 version 118 is already newer than 115 2023-01-25T04:42:19.096 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 192 v 118 (ObjNum 191 snap 0 seq_num 191) dirty exists 2023-01-25T04:42:19.096 INFO:tasks.rados.rados.0.smithi116.stdout:192: left oid 192 (ObjNum 191 snap 0 seq_num 191) 2023-01-25T04:42:19.096 INFO:tasks.rados.rados.0.smithi116.stdout:193: finishing write tid 1 to smithi116107171-193 2023-01-25T04:42:19.096 INFO:tasks.rados.rados.0.smithi116.stdout:192: done (15 left) 2023-01-25T04:42:19.096 INFO:tasks.rados.rados.0.smithi116.stdout:208: write initial oid 208 2023-01-25T04:42:19.097 INFO:tasks.rados.rados.0.smithi116.stdout:208: seq_num 207 ranges {679049=718074,2113302=674388,3335030=144019} 2023-01-25T04:42:19.100 INFO:tasks.rados.rados.0.smithi116.stdout:208: writing smithi116107171-208 from 679049 to 1397123 tid 1 2023-01-25T04:42:19.108 INFO:tasks.rados.rados.0.smithi116.stdout:208: writing smithi116107171-208 from 2113302 to 2787690 tid 2 2023-01-25T04:42:19.113 INFO:tasks.rados.rados.0.smithi116.stdout:208: writing smithi116107171-208 from 3335030 to 3479049 tid 3 2023-01-25T04:42:19.113 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.113 INFO:tasks.rados.rados.0.smithi116.stdout:193: finishing write tid 2 to smithi116107171-193 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: finishing write tid 3 to smithi116107171-193 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: finishing write tid 4 to smithi116107171-193 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: finishing write tid 5 to smithi116107171-193 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: oid 193 updating version 0 to 120 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: oid 193 updating version 120 to 121 2023-01-25T04:42:19.114 INFO:tasks.rados.rados.0.smithi116.stdout:193: oid 193 updating version 121 to 122 2023-01-25T04:42:19.115 INFO:tasks.rados.rados.0.smithi116.stdout:193: oid 193 version 122 is already newer than 119 2023-01-25T04:42:19.115 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 193 v 122 (ObjNum 192 snap 0 seq_num 192) dirty exists 2023-01-25T04:42:19.115 INFO:tasks.rados.rados.0.smithi116.stdout:193: left oid 193 (ObjNum 192 snap 0 seq_num 192) 2023-01-25T04:42:19.115 INFO:tasks.rados.rados.0.smithi116.stdout:194: finishing write tid 1 to smithi116107171-194 2023-01-25T04:42:19.115 INFO:tasks.rados.rados.0.smithi116.stdout:194: finishing write tid 2 to smithi116107171-194 2023-01-25T04:42:19.116 INFO:tasks.rados.rados.0.smithi116.stdout:194: finishing write tid 3 to smithi116107171-194 2023-01-25T04:42:19.116 INFO:tasks.rados.rados.0.smithi116.stdout:193: done (15 left) 2023-01-25T04:42:19.116 INFO:tasks.rados.rados.0.smithi116.stdout:209: write initial oid 209 2023-01-25T04:42:19.116 INFO:tasks.rados.rados.0.smithi116.stdout:209: seq_num 208 ranges {695856=793323,2171784=534399,3362453=133403} 2023-01-25T04:42:19.120 INFO:tasks.rados.rados.0.smithi116.stdout:209: writing smithi116107171-209 from 695856 to 1489179 tid 1 2023-01-25T04:42:19.127 INFO:tasks.rados.rados.0.smithi116.stdout:209: writing smithi116107171-209 from 2171784 to 2706183 tid 2 2023-01-25T04:42:19.132 INFO:tasks.rados.rados.0.smithi116.stdout:209: writing smithi116107171-209 from 3362453 to 3495856 tid 3 2023-01-25T04:42:19.132 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.133 INFO:tasks.rados.rados.0.smithi116.stdout:194: finishing write tid 4 to smithi116107171-194 2023-01-25T04:42:19.133 INFO:tasks.rados.rados.0.smithi116.stdout:194: finishing write tid 5 to smithi116107171-194 2023-01-25T04:42:19.133 INFO:tasks.rados.rados.0.smithi116.stdout:194: oid 194 updating version 0 to 136 2023-01-25T04:42:19.133 INFO:tasks.rados.rados.0.smithi116.stdout:194: oid 194 updating version 136 to 139 2023-01-25T04:42:19.133 INFO:tasks.rados.rados.0.smithi116.stdout:194: oid 194 version 139 is already newer than 137 2023-01-25T04:42:19.134 INFO:tasks.rados.rados.0.smithi116.stdout:194: oid 194 version 139 is already newer than 138 2023-01-25T04:42:19.134 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 194 v 139 (ObjNum 193 snap 0 seq_num 193) dirty exists 2023-01-25T04:42:19.134 INFO:tasks.rados.rados.0.smithi116.stdout:194: left oid 194 (ObjNum 193 snap 0 seq_num 193) 2023-01-25T04:42:19.134 INFO:tasks.rados.rados.0.smithi116.stdout:195: finishing write tid 1 to smithi116107171-195 2023-01-25T04:42:19.135 INFO:tasks.rados.rados.0.smithi116.stdout:195: finishing write tid 2 to smithi116107171-195 2023-01-25T04:42:19.135 INFO:tasks.rados.rados.0.smithi116.stdout:195: finishing write tid 3 to smithi116107171-195 2023-01-25T04:42:19.135 INFO:tasks.rados.rados.0.smithi116.stdout:194: done (15 left) 2023-01-25T04:42:19.135 INFO:tasks.rados.rados.0.smithi116.stdout:210: write initial oid 210 2023-01-25T04:42:19.135 INFO:tasks.rados.rados.0.smithi116.stdout:210: seq_num 209 ranges {712663=468572,1713913=678057,2873523=591733} 2023-01-25T04:42:19.138 INFO:tasks.rados.rados.0.smithi116.stdout:210: writing smithi116107171-210 from 712663 to 1181235 tid 1 2023-01-25T04:42:19.145 INFO:tasks.rados.rados.0.smithi116.stdout:210: writing smithi116107171-210 from 1713913 to 2391970 tid 2 2023-01-25T04:42:19.151 INFO:tasks.rados.rados.0.smithi116.stdout:210: writing smithi116107171-210 from 2873523 to 3465256 tid 3 2023-01-25T04:42:19.152 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.152 INFO:tasks.rados.rados.0.smithi116.stdout:195: finishing write tid 4 to smithi116107171-195 2023-01-25T04:42:19.152 INFO:tasks.rados.rados.0.smithi116.stdout:195: finishing write tid 5 to smithi116107171-195 2023-01-25T04:42:19.152 INFO:tasks.rados.rados.0.smithi116.stdout:195: oid 195 updating version 0 to 158 2023-01-25T04:42:19.153 INFO:tasks.rados.rados.0.smithi116.stdout:195: oid 195 updating version 158 to 161 2023-01-25T04:42:19.153 INFO:tasks.rados.rados.0.smithi116.stdout:195: oid 195 version 161 is already newer than 160 2023-01-25T04:42:19.153 INFO:tasks.rados.rados.0.smithi116.stdout:195: oid 195 version 161 is already newer than 159 2023-01-25T04:42:19.153 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 195 v 161 (ObjNum 194 snap 0 seq_num 194) dirty exists 2023-01-25T04:42:19.153 INFO:tasks.rados.rados.0.smithi116.stdout:195: left oid 195 (ObjNum 194 snap 0 seq_num 194) 2023-01-25T04:42:19.154 INFO:tasks.rados.rados.0.smithi116.stdout:196: finishing write tid 1 to smithi116107171-196 2023-01-25T04:42:19.154 INFO:tasks.rados.rados.0.smithi116.stdout:195: done (15 left) 2023-01-25T04:42:19.154 INFO:tasks.rados.rados.0.smithi116.stdout:211: write initial oid 211 2023-01-25T04:42:19.154 INFO:tasks.rados.rados.0.smithi116.stdout:211: seq_num 210 ranges {729470=543821,1772395=538068,2900946=403005} 2023-01-25T04:42:19.162 INFO:tasks.rados.rados.0.smithi116.stdout:211: writing smithi116107171-211 from 729470 to 1273291 tid 1 2023-01-25T04:42:19.163 INFO:tasks.rados.rados.0.smithi116.stdout:211: writing smithi116107171-211 from 1772395 to 2310463 tid 2 2023-01-25T04:42:19.170 INFO:tasks.rados.rados.0.smithi116.stdout:211: writing smithi116107171-211 from 2900946 to 3303951 tid 3 2023-01-25T04:42:19.171 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.171 INFO:tasks.rados.rados.0.smithi116.stdout:196: finishing write tid 2 to smithi116107171-196 2023-01-25T04:42:19.173 INFO:tasks.rados.rados.0.smithi116.stdout:196: finishing write tid 3 to smithi116107171-196 2023-01-25T04:42:19.174 INFO:tasks.rados.rados.0.smithi116.stdout:196: finishing write tid 4 to smithi116107171-196 2023-01-25T04:42:19.174 INFO:tasks.rados.rados.0.smithi116.stdout:196: finishing write tid 5 to smithi116107171-196 2023-01-25T04:42:19.174 INFO:tasks.rados.rados.0.smithi116.stdout:196: oid 196 updating version 0 to 164 2023-01-25T04:42:19.176 INFO:tasks.rados.rados.0.smithi116.stdout:196: oid 196 version 164 is already newer than 162 2023-01-25T04:42:19.176 INFO:tasks.rados.rados.0.smithi116.stdout:196: oid 196 updating version 164 to 165 2023-01-25T04:42:19.177 INFO:tasks.rados.rados.0.smithi116.stdout:196: oid 196 version 165 is already newer than 163 2023-01-25T04:42:19.177 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 196 v 165 (ObjNum 195 snap 0 seq_num 195) dirty exists 2023-01-25T04:42:19.178 INFO:tasks.rados.rados.0.smithi116.stdout:196: left oid 196 (ObjNum 195 snap 0 seq_num 195) 2023-01-25T04:42:19.178 INFO:tasks.rados.rados.0.smithi116.stdout:196: done (15 left) 2023-01-25T04:42:19.178 INFO:tasks.rados.rados.0.smithi116.stdout:212: write initial oid 212 2023-01-25T04:42:19.179 INFO:tasks.rados.rados.0.smithi116.stdout:212: seq_num 211 ranges {746277=619070,1830877=681726,2928369=617908} 2023-01-25T04:42:19.179 INFO:tasks.rados.rados.0.smithi116.stdout:212: writing smithi116107171-212 from 746277 to 1365347 tid 1 2023-01-25T04:42:19.183 INFO:tasks.rados.rados.0.smithi116.stdout:212: writing smithi116107171-212 from 1830877 to 2512603 tid 2 2023-01-25T04:42:19.190 INFO:tasks.rados.rados.0.smithi116.stdout:212: writing smithi116107171-212 from 2928369 to 3546277 tid 3 2023-01-25T04:42:19.190 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.191 INFO:tasks.rados.rados.0.smithi116.stdout:197: finishing write tid 1 to smithi116107171-197 2023-01-25T04:42:19.191 INFO:tasks.rados.rados.0.smithi116.stdout:197: finishing write tid 2 to smithi116107171-197 2023-01-25T04:42:19.191 INFO:tasks.rados.rados.0.smithi116.stdout:197: finishing write tid 3 to smithi116107171-197 2023-01-25T04:42:19.192 INFO:tasks.rados.rados.0.smithi116.stdout:197: finishing write tid 4 to smithi116107171-197 2023-01-25T04:42:19.192 INFO:tasks.rados.rados.0.smithi116.stdout:197: finishing write tid 5 to smithi116107171-197 2023-01-25T04:42:19.192 INFO:tasks.rados.rados.0.smithi116.stdout:197: oid 197 updating version 0 to 167 2023-01-25T04:42:19.193 INFO:tasks.rados.rados.0.smithi116.stdout:197: oid 197 version 167 is already newer than 166 2023-01-25T04:42:19.193 INFO:tasks.rados.rados.0.smithi116.stdout:197: oid 197 updating version 167 to 168 2023-01-25T04:42:19.193 INFO:tasks.rados.rados.0.smithi116.stdout:197: oid 197 updating version 168 to 169 2023-01-25T04:42:19.194 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 197 v 169 (ObjNum 196 snap 0 seq_num 196) dirty exists 2023-01-25T04:42:19.194 INFO:tasks.rados.rados.0.smithi116.stdout:197: left oid 197 (ObjNum 196 snap 0 seq_num 196) 2023-01-25T04:42:19.194 INFO:tasks.rados.rados.0.smithi116.stdout:198: finishing write tid 1 to smithi116107171-198 2023-01-25T04:42:19.194 INFO:tasks.rados.rados.0.smithi116.stdout:198: finishing write tid 2 to smithi116107171-198 2023-01-25T04:42:19.195 INFO:tasks.rados.rados.0.smithi116.stdout:198: finishing write tid 3 to smithi116107171-198 2023-01-25T04:42:19.195 INFO:tasks.rados.rados.0.smithi116.stdout:198: finishing write tid 4 to smithi116107171-198 2023-01-25T04:42:19.195 INFO:tasks.rados.rados.0.smithi116.stdout:198: finishing write tid 5 to smithi116107171-198 2023-01-25T04:42:19.195 INFO:tasks.rados.rados.0.smithi116.stdout:198: oid 198 updating version 0 to 172 2023-01-25T04:42:19.195 INFO:tasks.rados.rados.0.smithi116.stdout:198: oid 198 version 172 is already newer than 171 2023-01-25T04:42:19.196 INFO:tasks.rados.rados.0.smithi116.stdout:198: oid 198 version 172 is already newer than 170 2023-01-25T04:42:19.196 INFO:tasks.rados.rados.0.smithi116.stdout:198: oid 198 updating version 172 to 173 2023-01-25T04:42:19.196 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 198 v 173 (ObjNum 197 snap 0 seq_num 197) dirty exists 2023-01-25T04:42:19.196 INFO:tasks.rados.rados.0.smithi116.stdout:198: left oid 198 (ObjNum 197 snap 0 seq_num 197) 2023-01-25T04:42:19.197 INFO:tasks.rados.rados.0.smithi116.stdout:199: finishing write tid 1 to smithi116107171-199 2023-01-25T04:42:19.197 INFO:tasks.rados.rados.0.smithi116.stdout:197: done (15 left) 2023-01-25T04:42:19.197 INFO:tasks.rados.rados.0.smithi116.stdout:198: done (14 left) 2023-01-25T04:42:19.197 INFO:tasks.rados.rados.0.smithi116.stdout:213: write initial oid 213 2023-01-25T04:42:19.197 INFO:tasks.rados.rados.0.smithi116.stdout:213: seq_num 212 ranges {763084=694319,1889359=541737,2955792=541902} 2023-01-25T04:42:19.198 INFO:tasks.rados.rados.0.smithi116.stdout:213: writing smithi116107171-213 from 763084 to 1457403 tid 1 2023-01-25T04:42:19.203 INFO:tasks.rados.rados.0.smithi116.stdout:213: writing smithi116107171-213 from 1889359 to 2431096 tid 2 2023-01-25T04:42:19.209 INFO:tasks.rados.rados.0.smithi116.stdout:213: writing smithi116107171-213 from 2955792 to 3497694 tid 3 2023-01-25T04:42:19.209 INFO:tasks.rados.rados.0.smithi116.stdout:214: write initial oid 214 2023-01-25T04:42:19.209 INFO:tasks.rados.rados.0.smithi116.stdout:214: seq_num 213 ranges {779891=485921,1947841=685395,3383215=196676} 2023-01-25T04:42:19.216 INFO:tasks.rados.rados.0.smithi116.stdout:214: writing smithi116107171-214 from 779891 to 1265812 tid 1 2023-01-25T04:42:19.223 INFO:tasks.rados.rados.0.smithi116.stdout:214: writing smithi116107171-214 from 1947841 to 2633236 tid 2 2023-01-25T04:42:19.229 INFO:tasks.rados.rados.0.smithi116.stdout:214: writing smithi116107171-214 from 3383215 to 3579891 tid 3 2023-01-25T04:42:19.229 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.229 INFO:tasks.rados.rados.0.smithi116.stdout:199: finishing write tid 2 to smithi116107171-199 2023-01-25T04:42:19.229 INFO:tasks.rados.rados.0.smithi116.stdout:199: finishing write tid 3 to smithi116107171-199 2023-01-25T04:42:19.230 INFO:tasks.rados.rados.0.smithi116.stdout:199: finishing write tid 4 to smithi116107171-199 2023-01-25T04:42:19.230 INFO:tasks.rados.rados.0.smithi116.stdout:199: finishing write tid 5 to smithi116107171-199 2023-01-25T04:42:19.230 INFO:tasks.rados.rados.0.smithi116.stdout:199: oid 199 updating version 0 to 113 2023-01-25T04:42:19.230 INFO:tasks.rados.rados.0.smithi116.stdout:199: oid 199 updating version 113 to 115 2023-01-25T04:42:19.230 INFO:tasks.rados.rados.0.smithi116.stdout:199: oid 199 version 115 is already newer than 114 2023-01-25T04:42:19.231 INFO:tasks.rados.rados.0.smithi116.stdout:199: oid 199 version 115 is already newer than 112 2023-01-25T04:42:19.231 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 199 v 115 (ObjNum 198 snap 0 seq_num 198) dirty exists 2023-01-25T04:42:19.231 INFO:tasks.rados.rados.0.smithi116.stdout:199: left oid 199 (ObjNum 198 snap 0 seq_num 198) 2023-01-25T04:42:19.231 INFO:tasks.rados.rados.0.smithi116.stdout:200: finishing write tid 1 to smithi116107171-200 2023-01-25T04:42:19.232 INFO:tasks.rados.rados.0.smithi116.stdout:200: finishing write tid 2 to smithi116107171-200 2023-01-25T04:42:19.232 INFO:tasks.rados.rados.0.smithi116.stdout:200: finishing write tid 3 to smithi116107171-200 2023-01-25T04:42:19.232 INFO:tasks.rados.rados.0.smithi116.stdout:199: done (15 left) 2023-01-25T04:42:19.233 INFO:tasks.rados.rados.0.smithi116.stdout:215: write initial oid 215 2023-01-25T04:42:19.233 INFO:tasks.rados.rados.0.smithi116.stdout:215: seq_num 214 ranges {796698=561170,2006323=545406,3126991=469707} 2023-01-25T04:42:19.235 INFO:tasks.rados.rados.0.smithi116.stdout:215: writing smithi116107171-215 from 796698 to 1357868 tid 1 2023-01-25T04:42:19.241 INFO:tasks.rados.rados.0.smithi116.stdout:215: writing smithi116107171-215 from 2006323 to 2551729 tid 2 2023-01-25T04:42:19.247 INFO:tasks.rados.rados.0.smithi116.stdout:215: writing smithi116107171-215 from 3126991 to 3596698 tid 3 2023-01-25T04:42:19.248 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.248 INFO:tasks.rados.rados.0.smithi116.stdout:200: finishing write tid 4 to smithi116107171-200 2023-01-25T04:42:19.248 INFO:tasks.rados.rados.0.smithi116.stdout:200: finishing write tid 5 to smithi116107171-200 2023-01-25T04:42:19.249 INFO:tasks.rados.rados.0.smithi116.stdout:200: oid 200 updating version 0 to 175 2023-01-25T04:42:19.249 INFO:tasks.rados.rados.0.smithi116.stdout:200: oid 200 updating version 175 to 176 2023-01-25T04:42:19.249 INFO:tasks.rados.rados.0.smithi116.stdout:200: oid 200 version 176 is already newer than 174 2023-01-25T04:42:19.249 INFO:tasks.rados.rados.0.smithi116.stdout:200: oid 200 updating version 176 to 177 2023-01-25T04:42:19.250 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 200 v 177 (ObjNum 199 snap 0 seq_num 199) dirty exists 2023-01-25T04:42:19.250 INFO:tasks.rados.rados.0.smithi116.stdout:200: left oid 200 (ObjNum 199 snap 0 seq_num 199) 2023-01-25T04:42:19.250 INFO:tasks.rados.rados.0.smithi116.stdout:201: finishing write tid 1 to smithi116107171-201 2023-01-25T04:42:19.251 INFO:tasks.rados.rados.0.smithi116.stdout:200: done (15 left) 2023-01-25T04:42:19.251 INFO:tasks.rados.rados.0.smithi116.stdout:216: write initial oid 216 2023-01-25T04:42:19.251 INFO:tasks.rados.rados.0.smithi116.stdout:216: seq_num 215 ranges {413505=636419,1664805=689064,3038061=492071} 2023-01-25T04:42:19.253 INFO:tasks.rados.rados.0.smithi116.stdout:216: writing smithi116107171-216 from 413505 to 1049924 tid 1 2023-01-25T04:42:19.259 INFO:tasks.rados.rados.0.smithi116.stdout:216: writing smithi116107171-216 from 1664805 to 2353869 tid 2 2023-01-25T04:42:19.267 INFO:tasks.rados.rados.0.smithi116.stdout:216: writing smithi116107171-216 from 3038061 to 3530132 tid 3 2023-01-25T04:42:19.267 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.267 INFO:tasks.rados.rados.0.smithi116.stdout:201: finishing write tid 2 to smithi116107171-201 2023-01-25T04:42:19.267 INFO:tasks.rados.rados.0.smithi116.stdout:201: finishing write tid 3 to smithi116107171-201 2023-01-25T04:42:19.267 INFO:tasks.rados.rados.0.smithi116.stdout:201: finishing write tid 4 to smithi116107171-201 2023-01-25T04:42:19.268 INFO:tasks.rados.rados.0.smithi116.stdout:201: finishing write tid 5 to smithi116107171-201 2023-01-25T04:42:19.268 INFO:tasks.rados.rados.0.smithi116.stdout:201: oid 201 updating version 0 to 179 2023-01-25T04:42:19.268 INFO:tasks.rados.rados.0.smithi116.stdout:201: oid 201 updating version 179 to 181 2023-01-25T04:42:19.268 INFO:tasks.rados.rados.0.smithi116.stdout:201: oid 201 version 181 is already newer than 178 2023-01-25T04:42:19.269 INFO:tasks.rados.rados.0.smithi116.stdout:201: oid 201 version 181 is already newer than 180 2023-01-25T04:42:19.269 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 201 v 181 (ObjNum 200 snap 0 seq_num 200) dirty exists 2023-01-25T04:42:19.269 INFO:tasks.rados.rados.0.smithi116.stdout:201: left oid 201 (ObjNum 200 snap 0 seq_num 200) 2023-01-25T04:42:19.269 INFO:tasks.rados.rados.0.smithi116.stdout:201: done (15 left) 2023-01-25T04:42:19.269 INFO:tasks.rados.rados.0.smithi116.stdout:217: write initial oid 217 2023-01-25T04:42:19.270 INFO:tasks.rados.rados.0.smithi116.stdout:217: seq_num 216 ranges {430312=711668,1723287=549075,2781837=703343} 2023-01-25T04:42:19.272 INFO:tasks.rados.rados.0.smithi116.stdout:217: writing smithi116107171-217 from 430312 to 1141980 tid 1 2023-01-25T04:42:19.279 INFO:tasks.rados.rados.0.smithi116.stdout:217: writing smithi116107171-217 from 1723287 to 2272362 tid 2 2023-01-25T04:42:19.286 INFO:tasks.rados.rados.0.smithi116.stdout:217: writing smithi116107171-217 from 2781837 to 3485180 tid 3 2023-01-25T04:42:19.286 INFO:tasks.rados.rados.0.smithi116.stdout: waiting on 16 2023-01-25T04:42:19.287 INFO:tasks.rados.rados.0.smithi116.stdout:202: finishing write tid 1 to smithi116107171-202 2023-01-25T04:42:19.287 INFO:tasks.rados.rados.0.smithi116.stdout:202: finishing write tid 2 to smithi116107171-202 2023-01-25T04:42:19.287 INFO:tasks.rados.rados.0.smithi116.stdout:202: finishing write tid 3 to smithi116107171-202 2023-01-25T04:42:19.287 INFO:tasks.rados.rados.0.smithi116.stdout:202: finishing write tid 4 to smithi116107171-202 2023-01-25T04:42:19.287 INFO:tasks.rados.rados.0.smithi116.stdout:202: finishing write tid 5 to smithi116107171-202 2023-01-25T04:42:19.288 INFO:tasks.rados.rados.0.smithi116.stdout:202: oid 202 updating version 0 to 141 2023-01-25T04:42:19.288 INFO:tasks.rados.rados.0.smithi116.stdout:202: oid 202 version 141 is already newer than 140 2023-01-25T04:42:19.288 INFO:tasks.rados.rados.0.smithi116.stdout:202: oid 202 updating version 141 to 143 2023-01-25T04:42:19.289 INFO:tasks.rados.rados.0.smithi116.stdout:202: oid 202 version 143 is already newer than 142 2023-01-25T04:42:19.289 INFO:tasks.rados.rados.0.smithi116.stdout:update_object_version oid 202 v 143 (ObjNum 201 snap 0 seq_num 201) dirty exists 2023-01-25T04:42:19.289 INFO:tasks.rados.rados.0.smithi116.stdout:202: left oid 202 (ObjNum 201 snap 0 seq_num 201) 2023-01-25T04:42:19.289 INFO:tasks.rados.rados.0.smithi116.stdout:203: finishing write tid 1 to smithi116107171-203 2023-01-25T04:42:19.290 INFO:tasks.rados.rados.0.smithi116.stdout:203: finishing write tid 2 to smithi116107171-203 2023-01-25T04:42:19.290 INFO:tasks.rados.rados.0.smithi116.stdout:202: done (15 left) 2023-01-25T04:42:19.290