2023-01-25T09:38:22.024 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T09:38:22.025 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198 --owner scheduled_yuriw@teuthology --verbose --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} -- /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198/orig.config.yaml 2023-01-25T09:38:22.071 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T09:38:22.147 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198 branch: wip-yuri6-testing-2023-01-24-0746 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} email: yweinstein@radhat.com first_in_suite: false job_id: '7137198' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri6-testing-2023-01-24-0746 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_object_clean_region_max_num_intervals: 1000 osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd inject bad map crc probability: 0.1 osd max markdown count: 1000 osd max scrubs: 2 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2023-01-24-0746 sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri6-testing-2023-01-24-0746 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c targets: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5VdgV4UpoIWV/yQs3TM3IUO21oySyHh/8SGyoQcBYT1lFkqK+GMf2XpBphGaieP2Rrc1qK0F4Jo3gpaSf+4QymvI4g6ne9kb3tq4qG2wsKDxvqzbs7Dg448M/o5Y3qLzDLwdAXXxEawYV4UloR1rOvw0yMIz0lZtBhzjnmCySaxzUBtiUWFMi+3z464+6uDV++36ve2hvraDDHMtW1ClRiMfkw4Zc92y4c3KI41zrFAuvfBaa0aKTnqjHENN1bbV+XT9zrMZlYTU4g6JHEBus8Y/UmhGJ20kE03vytNxNpBrEj7DlXMqAYqeS41HtNCfQOFgz9GfUDj5lkjysbvgYgPlT1MmpRVKhre4y4/tYtYKiTKXkXq4AXooaetF85fyfnSAlKBdgQ1tJUMW9AM3UXVlAgxzKH0xGt4gmgjTfT/Bw+TnRuvfHwR0bwGIrWoWZK858oKqS4aUntPT5i4DpMStrltsl0kKdBI9Lu39AEc/QO4FejLfoVuT1HJc7gy8= smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBtNoOxD66iMY1Uz3dfwMA8itEM4UGTF1rlYG0ksqompS6NfJDde/Q02NNxUOX8F6/oNhvwEfQMdCB/j/lHvzUi9zOPn551I9TRTBBwfH5NJEFeIyM2sAkHGe7e5A773iUfy5pmnSr/iSflcL9AHDbKtxcNgEDembDS+4Odt5/UzOkRhrPtnEyJayLP2kVjlPwUEZLn8146M+KMDLc6XmeFMibuHUNEBpzfHAhYnrDoF3KMiNhBKQsZ1dntrKwJE7SOJQSP8nLQ87arlIuO6r+HcocsvBm3j5+RQX1acZHp8fadGoBcuUC2HE4exvoP5y9vMUGOrlDXuuW2tUIniSSSPW/LbKq7Vp8xyWJGy6SAV8YyfpNqcZzHBWFMIpGn1D9idgyBD30tU40we5QARI/6DnWmitHGL8jhL98doOLpmj+tRAOR+Qa+2n2uyR9f9T+d42Vp+GJFHXnmOENPlhGQAoSWyXEgpmcFkqbNbELzPd4v8KngXESSwvzfQ9ydrE= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache min_read_recency_for_promote 0 - sudo ceph osd pool set cache min_write_recency_for_promote 0 - rados: clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:27:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T09:38:22.148 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa; will attempt to use it 2023-01-25T09:38:22.148 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa/tasks 2023-01-25T09:38:22.149 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T09:38:22.151 INFO:teuthology.task.internal:Checking packages... 2023-01-25T09:38:22.178 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '44e4095da12a8269eb6cfe163cbb0d00b1a6412c' 2023-01-25T09:38:22.179 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T09:38:22.179 INFO:teuthology.packaging:ref: None 2023-01-25T09:38:22.180 INFO:teuthology.packaging:tag: None 2023-01-25T09:38:22.180 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:38:22.180 INFO:teuthology.packaging:sha1: 44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:38:22.181 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri6-testing-2023-01-24-0746 2023-01-25T09:38:22.469 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1986.g44e4095d 2023-01-25T09:38:22.470 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T09:38:22.476 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T09:38:22.477 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T09:38:22.482 INFO:teuthology.task.internal:Saving configuration 2023-01-25T09:38:22.502 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T09:38:22.513 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T09:38:22.536 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi085.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:33:03.356229', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM3HN8OryoMU5O6EmtbenI8mPyazD16J/9bzGn0iPqYYRN4j3OFQpNa3BymM+mW09XH3idsKyq5eJVJsW1dQfG0='} 2023-01-25T09:38:22.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi165.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 09:33:03.354803', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMag1r3FMhASgNKpkk0ApaT35U4BLxIollqJN458XlOWaFdaDTSWcJyrPXUw2mwQzmY9AiLJIhVl8ouaPBIAO+E='} 2023-01-25T09:38:22.562 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T09:38:22.568 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T09:38:22.568 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T09:38:22.568 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T09:38:22.634 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c9a444670>, signals=[15]) 2023-01-25T09:38:22.635 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T09:38:22.641 INFO:teuthology.task.internal:Opening connections... 2023-01-25T09:38:22.642 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:38:22.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:38:22.711 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:38:22.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:38:22.779 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T09:38:22.785 DEBUG:teuthology.orchestra.run.smithi085:> uname -m 2023-01-25T09:38:22.805 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2023-01-25T09:38:22.805 DEBUG:teuthology.orchestra.run.smithi085:> cat /etc/os-release 2023-01-25T09:38:22.862 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream" 2023-01-25T09:38:22.862 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8" 2023-01-25T09:38:22.862 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos" 2023-01-25T09:38:22.863 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora" 2023-01-25T09:38:22.863 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8" 2023-01-25T09:38:22.863 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2023-01-25T09:38:22.863 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T09:38:22.863 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2023-01-25T09:38:22.864 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T09:38:22.864 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/" 2023-01-25T09:38:22.864 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T09:38:22.864 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T09:38:22.865 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T09:38:22.865 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2023-01-25T09:38:22.923 DEBUG:teuthology.orchestra.run.smithi165:> uname -m 2023-01-25T09:38:22.941 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64 2023-01-25T09:38:22.942 DEBUG:teuthology.orchestra.run.smithi165:> cat /etc/os-release 2023-01-25T09:38:22.999 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream" 2023-01-25T09:38:22.999 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8" 2023-01-25T09:38:22.999 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos" 2023-01-25T09:38:23.000 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora" 2023-01-25T09:38:23.000 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8" 2023-01-25T09:38:23.000 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8" 2023-01-25T09:38:23.001 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T09:38:23.001 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31" 2023-01-25T09:38:23.001 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T09:38:23.001 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/" 2023-01-25T09:38:23.001 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T09:38:23.002 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T09:38:23.002 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T09:38:23.002 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server 2023-01-25T09:38:23.016 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T09:38:23.027 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T09:38:23.033 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T09:38:23.034 DEBUG:teuthology.orchestra.run.smithi085:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:38:23.036 DEBUG:teuthology.orchestra.run.smithi165:> test '!' -e /home/ubuntu/cephtest 2023-01-25T09:38:23.055 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T09:38:23.061 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T09:38:23.062 DEBUG:teuthology.orchestra.run.smithi085:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:38:23.093 DEBUG:teuthology.orchestra.run.smithi165:> test -z $(ls -A /var/lib/ceph) 2023-01-25T09:38:23.233 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T09:38:23.284 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T09:38:23.298 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T09:38:23.299 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T09:38:23.299 DEBUG:teuthology.orchestra.run.smithi085:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:38:23.300 DEBUG:teuthology.orchestra.run.smithi165:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T09:38:23.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:38:23.317 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2023-01-25T09:38:23.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:38:23.318 DEBUG:teuthology.orchestra.run.smithi085:> uname -r 2023-01-25T09:38:23.374 INFO:teuthology.orchestra.run.smithi165.stdout:4.18.0-408.el8.x86_64 2023-01-25T09:38:23.374 INFO:teuthology.task.kernel:Running kernel on smithi165: 4.18.0-408.el8.x86_64 2023-01-25T09:38:23.374 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum install -y kernel 2023-01-25T09:38:23.376 INFO:teuthology.orchestra.run.smithi085.stdout:4.18.0-408.el8.x86_64 2023-01-25T09:38:23.376 INFO:teuthology.task.kernel:Running kernel on smithi085: 4.18.0-408.el8.x86_64 2023-01-25T09:38:23.376 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum install -y kernel 2023-01-25T09:38:26.939 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - AppStream 35 MB/s | 27 MB 00:00 2023-01-25T09:38:27.179 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - AppStream 29 MB/s | 27 MB 00:00 2023-01-25T09:38:32.589 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - BaseOS 39 MB/s | 27 MB 00:00 2023-01-25T09:38:33.187 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - BaseOS 25 MB/s | 27 MB 00:01 2023-01-25T09:38:36.896 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - Extras 164 kB/s | 18 kB 00:00 2023-01-25T09:38:37.307 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T09:38:37.403 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - Extras 151 kB/s | 18 kB 00:00 2023-01-25T09:38:37.813 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T09:38:38.573 INFO:teuthology.orchestra.run.smithi165.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-01-25T09:38:39.021 INFO:teuthology.orchestra.run.smithi085.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-01-25T09:38:40.406 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 13 MB 00:01 2023-01-25T09:38:41.346 INFO:teuthology.orchestra.run.smithi085.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 13 MB 00:02 2023-01-25T09:38:43.715 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 376 kB/s | 24 kB 00:00 2023-01-25T09:38:44.621 INFO:teuthology.orchestra.run.smithi085.stdout:lab-extras 540 kB/s | 24 kB 00:00 2023-01-25T09:38:46.829 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T09:38:46.830 INFO:teuthology.orchestra.run.smithi165.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T09:38:47.000 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:38:47.000 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:38:47.000 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:38:47.000 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:38:47.001 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:38:47.001 INFO:teuthology.orchestra.run.smithi165.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T09:38:47.001 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T09:38:47.001 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T09:38:47.001 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:38:47.002 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:38:47.002 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:38:47.002 INFO:teuthology.orchestra.run.smithi165.stdout:Install 3 Packages 2023-01-25T09:38:47.002 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:38:47.003 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 85 M 2023-01-25T09:38:47.003 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 94 M 2023-01-25T09:38:47.003 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:38:47.274 INFO:teuthology.orchestra.run.smithi165.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 34 MB/s | 9.2 MB 00:00 2023-01-25T09:38:47.677 INFO:teuthology.orchestra.run.smithi085.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T09:38:47.678 INFO:teuthology.orchestra.run.smithi085.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T09:38:47.873 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:38:47.874 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:38:47.874 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:38:47.874 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:38:47.874 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:38:47.874 INFO:teuthology.orchestra.run.smithi085.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T09:38:47.875 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T09:38:47.875 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T09:38:47.875 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:38:47.875 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:38:47.875 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:38:47.876 INFO:teuthology.orchestra.run.smithi085.stdout:Install 3 Packages 2023-01-25T09:38:47.876 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:38:47.876 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 85 M 2023-01-25T09:38:47.877 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 94 M 2023-01-25T09:38:47.877 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:38:48.199 INFO:teuthology.orchestra.run.smithi165.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 28 MB/s | 34 MB 00:01 2023-01-25T09:38:48.541 INFO:teuthology.orchestra.run.smithi165.stdout:(3/3): kernel-core-4.18.0-448.el8.x86_64.rpm 27 MB/s | 41 MB 00:01 2023-01-25T09:38:48.544 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:38:48.544 INFO:teuthology.orchestra.run.smithi165.stdout:Total 55 MB/s | 85 MB 00:01 2023-01-25T09:38:48.656 INFO:teuthology.orchestra.run.smithi085.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 12 MB/s | 9.2 MB 00:00 2023-01-25T09:38:49.072 INFO:teuthology.orchestra.run.smithi085.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 28 MB/s | 34 MB 00:01 2023-01-25T09:38:49.180 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:38:49.464 INFO:teuthology.orchestra.run.smithi085.stdout:(3/3): kernel-core-4.18.0-448.el8.x86_64.rpm 26 MB/s | 41 MB 00:01 2023-01-25T09:38:49.467 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:38:49.467 INFO:teuthology.orchestra.run.smithi085.stdout:Total 53 MB/s | 85 MB 00:01 2023-01-25T09:38:49.568 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:38:49.568 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:38:50.109 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:38:50.533 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:38:50.534 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:38:51.898 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:38:51.923 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:38:52.551 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:38:52.580 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:38:54.670 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:38:55.229 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:38:55.304 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:38:55.992 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:38:59.085 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:38:59.528 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:38:59.844 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:39:00.292 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:39:02.852 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:39:03.094 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:03.615 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:39:03.857 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:24.795 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:24.822 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:39:25.241 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:39:25.508 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.534 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.818 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.818 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:39:25.818 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:39:25.818 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T09:39:25.819 INFO:teuthology.orchestra.run.smithi165.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T09:39:25.819 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:39:25.819 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:39:25.930 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel --last | head -n 1 2023-01-25T09:39:25.962 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:25.962 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T09:39:25.963 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T09:39:26.125 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 09:39:02 AM UTC 2023-01-25T09:39:26.127 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.128 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.128 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:39:26.128 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:39:26.128 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-25T09:39:26.129 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi165.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:39:26.129 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q kernel --last | head -n 1 2023-01-25T09:39:26.317 INFO:teuthology.orchestra.run.smithi165.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 09:39:02 AM UTC 2023-01-25T09:39:26.319 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.319 DEBUG:teuthology.orchestra.run.smithi165:> sudo rpm -qi grub2-tools 2023-01-25T09:39:26.352 INFO:teuthology.orchestra.run.smithi165.stdout:Name : grub2-tools 2023-01-25T09:39:26.352 INFO:teuthology.orchestra.run.smithi165.stdout:Epoch : 1 2023-01-25T09:39:26.353 INFO:teuthology.orchestra.run.smithi165.stdout:Version : 2.02 2023-01-25T09:39:26.353 INFO:teuthology.orchestra.run.smithi165.stdout:Release : 129.el8 2023-01-25T09:39:26.353 INFO:teuthology.orchestra.run.smithi165.stdout:Architecture: x86_64 2023-01-25T09:39:26.353 INFO:teuthology.orchestra.run.smithi165.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T09:39:26.353 INFO:teuthology.orchestra.run.smithi165.stdout:Group : System Environment/Base 2023-01-25T09:39:26.354 INFO:teuthology.orchestra.run.smithi165.stdout:Size : 9265586 2023-01-25T09:39:26.354 INFO:teuthology.orchestra.run.smithi165.stdout:License : GPLv3+ 2023-01-25T09:39:26.354 INFO:teuthology.orchestra.run.smithi165.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T09:39:26.354 INFO:teuthology.orchestra.run.smithi165.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T09:39:26.354 INFO:teuthology.orchestra.run.smithi165.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:Relocations : (not relocatable) 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:Packager : CentOS BuildSystem 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:Vendor : CentOS 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T09:39:26.355 INFO:teuthology.orchestra.run.smithi165.stdout:Summary : Support tools for GRUB. 2023-01-25T09:39:26.356 INFO:teuthology.orchestra.run.smithi165.stdout:Description : 2023-01-25T09:39:26.356 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:39:26.356 INFO:teuthology.orchestra.run.smithi165.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T09:39:26.356 INFO:teuthology.orchestra.run.smithi165.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T09:39:26.357 INFO:teuthology.orchestra.run.smithi165.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T09:39:26.357 INFO:teuthology.orchestra.run.smithi165.stdout:hardware devices. 2023-01-25T09:39:26.357 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:39:26.357 INFO:teuthology.orchestra.run.smithi165.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T09:39:26.358 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T09:39:26.358 INFO:teuthology.task.kernel:Updating grub on smithi165 to boot 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T09:39:26.526 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T09:39:26.526 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:39:26.526 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:39:26.527 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T09:39:26.527 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T09:39:26.527 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:39:26.527 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:39:26.631 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q kernel --last | head -n 1 2023-01-25T09:39:26.838 INFO:teuthology.orchestra.run.smithi085.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 09:39:03 AM UTC 2023-01-25T09:39:26.840 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.840 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T09:39:26.840 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T09:39:26.840 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T09:39:26.841 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T09:39:26.841 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi085.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T09:39:26.841 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q kernel --last | head -n 1 2023-01-25T09:39:27.028 INFO:teuthology.orchestra.run.smithi085.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 09:39:03 AM UTC 2023-01-25T09:39:27.030 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T09:39:27.030 DEBUG:teuthology.orchestra.run.smithi085:> sudo rpm -qi grub2-tools 2023-01-25T09:39:27.063 INFO:teuthology.orchestra.run.smithi085.stdout:Name : grub2-tools 2023-01-25T09:39:27.064 INFO:teuthology.orchestra.run.smithi085.stdout:Epoch : 1 2023-01-25T09:39:27.064 INFO:teuthology.orchestra.run.smithi085.stdout:Version : 2.02 2023-01-25T09:39:27.064 INFO:teuthology.orchestra.run.smithi085.stdout:Release : 129.el8 2023-01-25T09:39:27.064 INFO:teuthology.orchestra.run.smithi085.stdout:Architecture: x86_64 2023-01-25T09:39:27.064 INFO:teuthology.orchestra.run.smithi085.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T09:39:27.065 INFO:teuthology.orchestra.run.smithi085.stdout:Group : System Environment/Base 2023-01-25T09:39:27.065 INFO:teuthology.orchestra.run.smithi085.stdout:Size : 9265586 2023-01-25T09:39:27.065 INFO:teuthology.orchestra.run.smithi085.stdout:License : GPLv3+ 2023-01-25T09:39:27.065 INFO:teuthology.orchestra.run.smithi085.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T09:39:27.065 INFO:teuthology.orchestra.run.smithi085.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:Relocations : (not relocatable) 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:Packager : CentOS BuildSystem 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:Vendor : CentOS 2023-01-25T09:39:27.066 INFO:teuthology.orchestra.run.smithi085.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T09:39:27.067 INFO:teuthology.orchestra.run.smithi085.stdout:Summary : Support tools for GRUB. 2023-01-25T09:39:27.067 INFO:teuthology.orchestra.run.smithi085.stdout:Description : 2023-01-25T09:39:27.067 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:39:27.067 INFO:teuthology.orchestra.run.smithi085.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T09:39:27.067 INFO:teuthology.orchestra.run.smithi085.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T09:39:27.068 INFO:teuthology.orchestra.run.smithi085.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T09:39:27.068 INFO:teuthology.orchestra.run.smithi085.stdout:hardware devices. 2023-01-25T09:39:27.068 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:39:27.068 INFO:teuthology.orchestra.run.smithi085.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T09:39:27.069 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T09:39:27.069 INFO:teuthology.task.kernel:Updating grub on smithi085 to boot 4.18.0-448.el8.x86_64 2023-01-25T09:39:27.070 DEBUG:teuthology.orchestra.run.smithi085:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T09:39:28.218 INFO:teuthology.orchestra.run.smithi165.stderr:Generating grub configuration file ... 2023-01-25T09:39:28.743 INFO:teuthology.orchestra.run.smithi085.stderr:Generating grub configuration file ... 2023-01-25T09:39:30.520 INFO:teuthology.orchestra.run.smithi165.stderr:done 2023-01-25T09:39:30.522 DEBUG:teuthology.orchestra.run.smithi165:> mktemp 2023-01-25T09:39:30.558 INFO:teuthology.orchestra.run.smithi165.stdout:/tmp/tmp.hYqSkkliwM 2023-01-25T09:39:30.558 DEBUG:teuthology.orchestra.run.smithi165:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hYqSkkliwM 2023-01-25T09:39:30.641 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0666 /tmp/tmp.hYqSkkliwM 2023-01-25T09:39:30.786 DEBUG:teuthology.orchestra.remote:smithi165:/tmp/tmp.hYqSkkliwM is 6KB 2023-01-25T09:39:30.834 DEBUG:teuthology.orchestra.run.smithi165:> rm -fr /tmp/tmp.hYqSkkliwM 2023-01-25T09:39:30.851 DEBUG:teuthology.orchestra.run.smithi165:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T09:39:30.929 INFO:teuthology.orchestra.run.smithi165.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T09:39:30.929 INFO:teuthology.orchestra.run.smithi165.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T09:39:30.929 INFO:teuthology.orchestra.run.smithi165.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T09:39:30.930 INFO:teuthology.orchestra.run.smithi165.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T09:39:30.930 DEBUG:teuthology.orchestra.run.smithi165:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T09:39:30.959 INFO:teuthology.orchestra.run.smithi085.stderr:done 2023-01-25T09:39:30.961 DEBUG:teuthology.orchestra.run.smithi085:> mktemp 2023-01-25T09:39:30.991 INFO:teuthology.orchestra.run.smithi085.stdout:/tmp/tmp.jbLcV1YrN2 2023-01-25T09:39:30.992 DEBUG:teuthology.orchestra.run.smithi085:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jbLcV1YrN2 2023-01-25T09:39:31.082 DEBUG:teuthology.orchestra.run.smithi165:> sudo shutdown -r now 2023-01-25T09:39:31.089 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0666 /tmp/tmp.jbLcV1YrN2 2023-01-25T09:39:31.271 DEBUG:teuthology.orchestra.remote:smithi085:/tmp/tmp.jbLcV1YrN2 is 6KB 2023-01-25T09:39:31.319 DEBUG:teuthology.orchestra.run.smithi085:> rm -fr /tmp/tmp.jbLcV1YrN2 2023-01-25T09:39:31.336 DEBUG:teuthology.orchestra.run.smithi085:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T09:39:31.450 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T09:39:31.451 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T09:39:31.451 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T09:39:31.451 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T09:39:31.452 DEBUG:teuthology.orchestra.run.smithi085:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T09:39:31.602 DEBUG:teuthology.orchestra.run.smithi085:> sudo shutdown -r now 2023-01-25T09:40:01.112 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-25T09:40:01.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-25T09:40:01.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:40:01.605 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T09:40:01.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T09:40:01.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:40:19.436 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-25T09:40:19.948 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.85 2023-01-25T09:40:49.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-25T09:40:49.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:40:49.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T09:40:49.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:41:06.393 DEBUG:teuthology.orchestra.run.smithi085:> true 2023-01-25T09:41:06.729 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T09:41:06.729 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-448.el8.x86_64"... 2023-01-25T09:41:06.730 DEBUG:teuthology.orchestra.run.smithi085:> uname -r 2023-01-25T09:41:06.749 INFO:teuthology.orchestra.run.smithi085.stdout:4.18.0-448.el8.x86_64 2023-01-25T09:41:06.750 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T09:41:06.750 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:41:06.750 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T09:41:07.751 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T09:41:07.751 DEBUG:teuthology.orchestra.run.smithi085:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:41:07.820 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.165 2023-01-25T09:41:07.862 INFO:teuthology.orchestra.run.smithi085.stdout:ttyS1 2023-01-25T09:41:07.892 DEBUG:teuthology.parallel:result is None 2023-01-25T09:41:37.821 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-25T09:41:37.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:41:38.141 DEBUG:teuthology.orchestra.run.smithi165:> true 2023-01-25T09:41:38.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-25T09:41:38.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-448.el8.x86_64"... 2023-01-25T09:41:38.423 DEBUG:teuthology.orchestra.run.smithi165:> uname -r 2023-01-25T09:41:38.442 INFO:teuthology.orchestra.run.smithi165.stdout:4.18.0-448.el8.x86_64 2023-01-25T09:41:38.443 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T09:41:38.443 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T09:41:38.443 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T09:41:39.444 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T09:41:39.444 DEBUG:teuthology.orchestra.run.smithi165:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T09:41:39.547 INFO:teuthology.orchestra.run.smithi165.stdout:ttyS1 2023-01-25T09:41:39.560 DEBUG:teuthology.parallel:result is None 2023-01-25T09:41:39.560 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T09:41:39.568 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T09:41:39.569 DEBUG:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:41:39.573 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T09:41:39.594 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T09:41:39.601 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T09:41:39.611 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T09:41:39.611 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:41:39.637 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T09:41:39.664 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T09:41:39.671 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T09:41:39.671 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:41:39.701 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T09:41:39.733 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:41:39.743 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:41:39.743 INFO:teuthology.orchestra.run.smithi165.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:41:39.754 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T09:41:39.755 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T09:41:39.766 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T09:41:39.767 DEBUG:teuthology.orchestra.run.smithi085:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:41:39.801 DEBUG:teuthology.orchestra.run.smithi165:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T09:41:39.829 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T09:41:39.837 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T09:41:39.838 DEBUG:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:41:39.869 DEBUG:teuthology.orchestra.run.smithi165:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T09:41:39.886 DEBUG:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:41:39.971 DEBUG:teuthology.orchestra.run.smithi085:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:41:40.024 DEBUG:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:41:40.113 DEBUG:teuthology.orchestra.run.smithi085:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:41:40.155 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:41:40.155 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:41:40.223 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:41:40.287 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T09:41:40.324 DEBUG:teuthology.orchestra.run.smithi165:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:41:40.415 DEBUG:teuthology.orchestra.run.smithi165:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T09:41:40.452 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:41:40.452 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T09:41:40.519 DEBUG:teuthology.orchestra.run.smithi085:> sudo service rsyslog restart 2023-01-25T09:41:40.521 DEBUG:teuthology.orchestra.run.smithi165:> sudo service rsyslog restart 2023-01-25T09:41:40.594 INFO:teuthology.orchestra.run.smithi085.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T09:41:40.609 INFO:teuthology.orchestra.run.smithi165.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T09:41:41.093 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T09:41:41.100 INFO:teuthology.task.internal:Starting timer... 2023-01-25T09:41:41.101 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T09:41:41.112 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T09:41:41.121 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T09:41:41.121 DEBUG:teuthology.orchestra.run.smithi085:> sudo service auditd rotate 2023-01-25T09:41:41.183 INFO:teuthology.orchestra.run.smithi085.stdout:Rotating logs: 2023-01-25T09:41:41.185 DEBUG:teuthology.orchestra.run.smithi165:> sudo service auditd rotate 2023-01-25T09:41:41.252 INFO:teuthology.orchestra.run.smithi165.stdout:Rotating logs: 2023-01-25T09:41:41.254 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T09:41:41.254 DEBUG:teuthology.orchestra.run.smithi085:> /usr/sbin/getenforce 2023-01-25T09:41:41.277 INFO:teuthology.orchestra.run.smithi085.stdout:Permissive 2023-01-25T09:41:41.278 DEBUG:teuthology.orchestra.run.smithi165:> /usr/sbin/getenforce 2023-01-25T09:41:41.312 INFO:teuthology.orchestra.run.smithi165.stdout:Permissive 2023-01-25T09:41:41.312 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi085.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi165.front.sepia.ceph.com': 'permissive'} 2023-01-25T09:41:41.313 DEBUG:teuthology.orchestra.run.smithi085:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T09:41:41.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:41:41.345 DEBUG:teuthology.orchestra.run.smithi165:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T09:41:41.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T09:41:41.381 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T09:41:41.381 DEBUG:teuthology.orchestra.run.smithi085:> sudo /usr/sbin/setenforce permissive 2023-01-25T09:41:41.415 DEBUG:teuthology.orchestra.run.smithi165:> sudo /usr/sbin/setenforce permissive 2023-01-25T09:41:41.458 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T09:41:41.474 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T09:41:41.475 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T09:41:41.493 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T09:41:41.495 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi085.front.sepia.ceph.com,smithi165.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T09:48:03.116 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi085.front.sepia.ceph.com'), Remote(name='ubuntu@smithi165.front.sepia.ceph.com')] 2023-01-25T09:48:03.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T09:48:03.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:48:03.186 DEBUG:teuthology.orchestra.run.smithi085:> true 2023-01-25T09:48:03.259 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com' 2023-01-25T09:48:03.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi165.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T09:48:03.326 DEBUG:teuthology.orchestra.run.smithi165:> true 2023-01-25T09:48:03.395 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T09:48:03.426 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T09:48:03.427 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:48:03.427 DEBUG:teuthology.orchestra.run.smithi085:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:48:03.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T09:48:03.430 DEBUG:teuthology.orchestra.run.smithi165:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T09:48:03.465 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T09:48:03.467 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T09:48:03.479 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T09:48:03.481 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T09:48:03.547 INFO:teuthology.orchestra.run.smithi085.stderr:sudo: ntpd: command not found 2023-01-25T09:48:03.551 INFO:teuthology.orchestra.run.smithi165.stderr:sudo: ntpd: command not found 2023-01-25T09:48:03.559 INFO:teuthology.orchestra.run.smithi085.stdout:506 Cannot talk to daemon 2023-01-25T09:48:03.563 INFO:teuthology.orchestra.run.smithi165.stdout:506 Cannot talk to daemon 2023-01-25T09:48:03.573 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T09:48:03.578 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T09:48:03.587 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T09:48:03.591 INFO:teuthology.orchestra.run.smithi165.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T09:48:03.649 INFO:teuthology.orchestra.run.smithi085.stderr:bash: ntpq: command not found 2023-01-25T09:48:03.654 INFO:teuthology.orchestra.run.smithi085.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T09:48:03.655 INFO:teuthology.orchestra.run.smithi085.stdout:=============================================================================== 2023-01-25T09:48:03.655 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.655 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.655 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.655 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.662 INFO:teuthology.orchestra.run.smithi165.stderr:bash: ntpq: command not found 2023-01-25T09:48:03.665 INFO:teuthology.orchestra.run.smithi165.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T09:48:03.666 INFO:teuthology.orchestra.run.smithi165.stdout:=============================================================================== 2023-01-25T09:48:03.666 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.667 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.667 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.667 INFO:teuthology.orchestra.run.smithi165.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T09:48:03.669 INFO:teuthology.run_tasks:Running task install... 2023-01-25T09:48:03.703 DEBUG:teuthology.task.install:project ceph 2023-01-25T09:48:03.703 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}} 2023-01-25T09:48:03.704 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'} 2023-01-25T09:48:03.704 INFO:teuthology.task.install:Using flavor: default 2023-01-25T09:48:03.710 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T09:48:03.711 INFO:teuthology.task.install:extra packages: [] 2023-01-25T09:48:03.711 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T09:48:03.748 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T09:48:03.749 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:48:03.750 DEBUG:teuthology.orchestra.run.smithi165:> sudo lsb_release -is 2023-01-25T09:48:03.750 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'tag': None, 'wait_for_package': False} 2023-01-25T09:48:03.751 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T09:48:03.788 INFO:teuthology.orchestra.run.smithi165.stdout:CentOSStream 2023-01-25T09:48:03.789 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:48:03.790 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'tag': None, 'wait_for_package': False} 2023-01-25T09:48:03.790 DEBUG:teuthology.orchestra.run.smithi165:> sudo lsb_release -is 2023-01-25T09:48:03.826 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T09:48:03.827 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:48:03.828 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:48:03.866 INFO:teuthology.orchestra.run.smithi165.stdout:CentOSStream 2023-01-25T09:48:03.867 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:48:03.867 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:48:04.046 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/ 2023-01-25T09:48:04.046 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1986.g44e4095d 2023-01-25T09:48:04.085 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/ 2023-01-25T09:48:04.085 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1986.g44e4095d 2023-01-25T09:48:04.236 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T09:48:04.236 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:48:04.236 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T09:48:04.239 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-01-24-0746/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T09:48:04.239 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:48:04.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T09:48:04.265 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T09:48:04.266 DEBUG:teuthology.orchestra.run.smithi085:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T09:48:04.269 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T09:48:04.269 DEBUG:teuthology.orchestra.run.smithi165:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44e4095da12a8269eb6cfe163cbb0d00b1a6412c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T09:48:04.335 DEBUG:teuthology.orchestra.run.smithi085:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T09:48:04.338 DEBUG:teuthology.orchestra.run.smithi165:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T09:48:04.413 DEBUG:teuthology.orchestra.run.smithi085:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T09:48:04.416 DEBUG:teuthology.orchestra.run.smithi165:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T09:48:04.479 INFO:teuthology.orchestra.run.smithi085.stdout:check_obsoletes = 1 2023-01-25T09:48:04.481 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum clean all 2023-01-25T09:48:04.483 INFO:teuthology.orchestra.run.smithi165.stdout:check_obsoletes = 1 2023-01-25T09:48:04.484 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum clean all 2023-01-25T09:48:04.729 INFO:teuthology.orchestra.run.smithi085.stdout:61 files removed 2023-01-25T09:48:04.759 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-radosgw 2023-01-25T09:48:04.760 INFO:teuthology.orchestra.run.smithi165.stdout:61 files removed 2023-01-25T09:48:04.788 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-radosgw 2023-01-25T09:48:05.443 INFO:teuthology.orchestra.run.smithi085.stdout:ceph packages for x86_64 284 kB/s | 79 kB 00:00 2023-01-25T09:48:05.476 INFO:teuthology.orchestra.run.smithi165.stdout:ceph packages for x86_64 283 kB/s | 79 kB 00:00 2023-01-25T09:48:05.719 INFO:teuthology.orchestra.run.smithi085.stdout:ceph noarch packages 39 kB/s | 9.3 kB 00:00 2023-01-25T09:48:05.752 INFO:teuthology.orchestra.run.smithi165.stdout:ceph noarch packages 39 kB/s | 9.3 kB 00:00 2023-01-25T09:48:06.011 INFO:teuthology.orchestra.run.smithi085.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-01-25T09:48:06.019 INFO:teuthology.orchestra.run.smithi165.stdout:ceph source packages 6.2 kB/s | 1.5 kB 00:00 2023-01-25T09:48:06.722 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - AppStream 40 MB/s | 27 MB 00:00 2023-01-25T09:48:07.080 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - AppStream 27 MB/s | 27 MB 00:01 2023-01-25T09:48:12.373 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - BaseOS 43 MB/s | 27 MB 00:00 2023-01-25T09:48:12.739 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - BaseOS 40 MB/s | 27 MB 00:00 2023-01-25T09:48:16.630 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - Extras 155 kB/s | 18 kB 00:00 2023-01-25T09:48:17.029 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - Extras 143 kB/s | 18 kB 00:00 2023-01-25T09:48:17.041 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T09:48:17.465 INFO:teuthology.orchestra.run.smithi165.stdout:CentOS-8 - PowerTools 18 MB/s | 5.6 MB 00:00 2023-01-25T09:48:18.265 INFO:teuthology.orchestra.run.smithi085.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-01-25T09:48:18.706 INFO:teuthology.orchestra.run.smithi165.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-01-25T09:48:20.107 INFO:teuthology.orchestra.run.smithi165.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T09:48:20.166 INFO:teuthology.orchestra.run.smithi085.stdout:Extra Packages for Enterprise Linux 7.5 MB/s | 13 MB 00:01 2023-01-25T09:48:23.365 INFO:teuthology.orchestra.run.smithi165.stdout:lab-extras 543 kB/s | 24 kB 00:00 2023-01-25T09:48:23.474 INFO:teuthology.orchestra.run.smithi085.stdout:lab-extras 401 kB/s | 24 kB 00:00 2023-01-25T09:48:26.870 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:48:26.873 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:48:26.873 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:48:26.873 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:48:26.874 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:48:26.874 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 13 M 2023-01-25T09:48:26.874 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrading: 2023-01-25T09:48:26.874 INFO:teuthology.orchestra.run.smithi165.stdout: librados2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.6 M 2023-01-25T09:48:26.875 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.6 M 2023-01-25T09:48:26.875 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:48:26.875 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 4.8 M 2023-01-25T09:48:26.875 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 21 M 2023-01-25T09:48:26.876 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 24 k 2023-01-25T09:48:26.876 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T09:48:26.876 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 767 k 2023-01-25T09:48:26.876 INFO:teuthology.orchestra.run.smithi165.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T09:48:26.876 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T09:48:26.877 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 474 k 2023-01-25T09:48:26.877 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T09:48:26.877 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 6.5 M 2023-01-25T09:48:26.877 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T09:48:26.877 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T09:48:26.878 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse 2023-01-25T09:48:26.878 INFO:teuthology.orchestra.run.smithi165.stdout: x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 45 k 2023-01-25T09:48:26.878 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 115 k 2023-01-25T09:48:26.878 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 190 k 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 372 k 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 364 k 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 106 k 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T09:48:26.879 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:48:26.880 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:48:26.880 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:48:26.880 INFO:teuthology.orchestra.run.smithi165.stdout:Install 21 Packages 2023-01-25T09:48:26.880 INFO:teuthology.orchestra.run.smithi165.stdout:Upgrade 2 Packages 2023-01-25T09:48:26.881 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:48:26.881 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 58 M 2023-01-25T09:48:26.881 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:48:26.909 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:48:26.911 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:48:26.911 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:48:26.912 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:48:26.912 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:48:26.912 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-radosgw x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 13 M 2023-01-25T09:48:26.912 INFO:teuthology.orchestra.run.smithi085.stdout:Upgrading: 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout: librados2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.6 M 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout: librbd1 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.6 M 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-base x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 4.8 M 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-common x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 21 M 2023-01-25T09:48:26.913 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-selinux x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 24 k 2023-01-25T09:48:26.914 INFO:teuthology.orchestra.run.smithi085.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T09:48:26.914 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 767 k 2023-01-25T09:48:26.914 INFO:teuthology.orchestra.run.smithi085.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T09:48:26.914 INFO:teuthology.orchestra.run.smithi085.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T09:48:26.914 INFO:teuthology.orchestra.run.smithi085.stdout: libradosstriper1 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 474 k 2023-01-25T09:48:26.915 INFO:teuthology.orchestra.run.smithi085.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T09:48:26.915 INFO:teuthology.orchestra.run.smithi085.stdout: librgw2 x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 6.5 M 2023-01-25T09:48:26.915 INFO:teuthology.orchestra.run.smithi085.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T09:48:26.915 INFO:teuthology.orchestra.run.smithi085.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T09:48:26.915 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-argparse 2023-01-25T09:48:26.916 INFO:teuthology.orchestra.run.smithi085.stdout: x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 45 k 2023-01-25T09:48:26.916 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-common x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 115 k 2023-01-25T09:48:26.916 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cephfs x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 190 k 2023-01-25T09:48:26.916 INFO:teuthology.orchestra.run.smithi085.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T09:48:26.917 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rados x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 372 k 2023-01-25T09:48:26.917 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rbd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 364 k 2023-01-25T09:48:26.917 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rgw x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 106 k 2023-01-25T09:48:26.917 INFO:teuthology.orchestra.run.smithi085.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T09:48:26.917 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:48:26.918 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:48:26.918 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:48:26.918 INFO:teuthology.orchestra.run.smithi085.stdout:Install 21 Packages 2023-01-25T09:48:26.918 INFO:teuthology.orchestra.run.smithi085.stdout:Upgrade 2 Packages 2023-01-25T09:48:26.918 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:48:26.919 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 58 M 2023-01-25T09:48:26.919 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:48:28.326 INFO:teuthology.orchestra.run.smithi085.stdout:(1/23): ceph-base-18.0.0-1986.g44e4095d.el8.x86 3.4 MB/s | 4.8 MB 00:01 2023-01-25T09:48:28.376 INFO:teuthology.orchestra.run.smithi085.stdout:(2/23): ceph-selinux-18.0.0-1986.g44e4095d.el8. 486 kB/s | 24 kB 00:00 2023-01-25T09:48:28.543 INFO:teuthology.orchestra.run.smithi085.stdout:(3/23): libcephfs2-18.0.0-1986.g44e4095d.el8.x8 4.5 MB/s | 767 kB 00:00 2023-01-25T09:48:28.660 INFO:teuthology.orchestra.run.smithi085.stdout:(4/23): libradosstriper1-18.0.0-1986.g44e4095d. 4.0 MB/s | 474 kB 00:00 2023-01-25T09:48:28.766 INFO:teuthology.orchestra.run.smithi165.stdout:(1/23): ceph-base-18.0.0-1986.g44e4095d.el8.x86 2.6 MB/s | 4.8 MB 00:01 2023-01-25T09:48:28.883 INFO:teuthology.orchestra.run.smithi165.stdout:(2/23): ceph-selinux-18.0.0-1986.g44e4095d.el8. 208 kB/s | 24 kB 00:00 2023-01-25T09:48:29.199 INFO:teuthology.orchestra.run.smithi165.stdout:(3/23): libcephfs2-18.0.0-1986.g44e4095d.el8.x8 2.4 MB/s | 767 kB 00:00 2023-01-25T09:48:29.385 INFO:teuthology.orchestra.run.smithi085.stdout:(5/23): librgw2-18.0.0-1986.g44e4095d.el8.x86_6 9.0 MB/s | 6.5 MB 00:00 2023-01-25T09:48:29.425 INFO:teuthology.orchestra.run.smithi165.stdout:(4/23): libradosstriper1-18.0.0-1986.g44e4095d. 2.1 MB/s | 474 kB 00:00 2023-01-25T09:48:29.444 INFO:teuthology.orchestra.run.smithi085.stdout:(6/23): python3-ceph-argparse-18.0.0-1986.g44e4 767 kB/s | 45 kB 00:00 2023-01-25T09:48:29.511 INFO:teuthology.orchestra.run.smithi085.stdout:(7/23): python3-ceph-common-18.0.0-1986.g44e409 1.7 MB/s | 115 kB 00:00 2023-01-25T09:48:29.586 INFO:teuthology.orchestra.run.smithi085.stdout:(8/23): python3-cephfs-18.0.0-1986.g44e4095d.el 2.5 MB/s | 190 kB 00:00 2023-01-25T09:48:29.711 INFO:teuthology.orchestra.run.smithi085.stdout:(9/23): ceph-radosgw-18.0.0-1986.g44e4095d.el8. 4.7 MB/s | 13 MB 00:02 2023-01-25T09:48:29.737 INFO:teuthology.orchestra.run.smithi085.stdout:(10/23): python3-rados-18.0.0-1986.g44e4095d.el 2.4 MB/s | 372 kB 00:00 2023-01-25T09:48:29.812 INFO:teuthology.orchestra.run.smithi085.stdout:(11/23): python3-rgw-18.0.0-1986.g44e4095d.el8. 1.4 MB/s | 106 kB 00:00 2023-01-25T09:48:29.837 INFO:teuthology.orchestra.run.smithi085.stdout:(12/23): python3-rbd-18.0.0-1986.g44e4095d.el8. 2.8 MB/s | 364 kB 00:00 2023-01-25T09:48:29.904 INFO:teuthology.orchestra.run.smithi085.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-01-25T09:48:29.930 INFO:teuthology.orchestra.run.smithi085.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-25T09:48:29.955 INFO:teuthology.orchestra.run.smithi085.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2023-01-25T09:48:29.980 INFO:teuthology.orchestra.run.smithi085.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 934 kB/s | 47 kB 00:00 2023-01-25T09:48:30.372 INFO:teuthology.orchestra.run.smithi085.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 150 kB/s | 59 kB 00:00 2023-01-25T09:48:30.481 INFO:teuthology.orchestra.run.smithi085.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 693 kB/s | 75 kB 00:00 2023-01-25T09:48:30.623 INFO:teuthology.orchestra.run.smithi085.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 458 kB/s | 306 kB 00:00 2023-01-25T09:48:31.115 INFO:teuthology.orchestra.run.smithi085.stdout:(20/23): librados2-18.0.0-1986.g44e4095d.el8.x8 7.4 MB/s | 3.6 MB 00:00 2023-01-25T09:48:31.366 INFO:teuthology.orchestra.run.smithi085.stdout:(21/23): librbd1-18.0.0-1986.g44e4095d.el8.x86_ 14 MB/s | 3.6 MB 00:00 2023-01-25T09:48:32.141 INFO:teuthology.orchestra.run.smithi085.stdout:(22/23): thrift-0.13.0-2.el8.x86_64.rpm 1.0 MB/s | 1.7 MB 00:01 2023-01-25T09:48:32.208 INFO:teuthology.orchestra.run.smithi165.stdout:(5/23): ceph-radosgw-18.0.0-1986.g44e4095d.el8. 2.4 MB/s | 13 MB 00:05 2023-01-25T09:48:32.258 INFO:teuthology.orchestra.run.smithi165.stdout:(6/23): python3-ceph-argparse-18.0.0-1986.g44e4 895 kB/s | 45 kB 00:00 2023-01-25T09:48:32.350 INFO:teuthology.orchestra.run.smithi165.stdout:(7/23): python3-ceph-common-18.0.0-1986.g44e409 1.2 MB/s | 115 kB 00:00 2023-01-25T09:48:32.526 INFO:teuthology.orchestra.run.smithi165.stdout:(8/23): librgw2-18.0.0-1986.g44e4095d.el8.x86_6 2.1 MB/s | 6.5 MB 00:03 2023-01-25T09:48:32.567 INFO:teuthology.orchestra.run.smithi165.stdout:(9/23): python3-cephfs-18.0.0-1986.g44e4095d.el 878 kB/s | 190 kB 00:00 2023-01-25T09:48:32.818 INFO:teuthology.orchestra.run.smithi165.stdout:(10/23): python3-rbd-18.0.0-1986.g44e4095d.el8. 1.4 MB/s | 364 kB 00:00 2023-01-25T09:48:33.034 INFO:teuthology.orchestra.run.smithi165.stdout:(11/23): python3-rados-18.0.0-1986.g44e4095d.el 731 kB/s | 372 kB 00:00 2023-01-25T09:48:33.060 INFO:teuthology.orchestra.run.smithi165.stdout:(12/23): python3-rgw-18.0.0-1986.g44e4095d.el8. 441 kB/s | 106 kB 00:00 2023-01-25T09:48:33.119 INFO:teuthology.orchestra.run.smithi165.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-01-25T09:48:33.144 INFO:teuthology.orchestra.run.smithi165.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-25T09:48:33.169 INFO:teuthology.orchestra.run.smithi165.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-01-25T09:48:33.195 INFO:teuthology.orchestra.run.smithi165.stdout:(16/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 931 kB/s | 47 kB 00:00 2023-01-25T09:48:33.420 INFO:teuthology.orchestra.run.smithi165.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 261 kB/s | 59 kB 00:00 2023-01-25T09:48:33.588 INFO:teuthology.orchestra.run.smithi165.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 450 kB/s | 75 kB 00:00 2023-01-25T09:48:33.612 INFO:teuthology.orchestra.run.smithi165.stdout:(19/23): gperftools-libs-2.7-9.el8.x86_64.rpm 692 kB/s | 306 kB 00:00 2023-01-25T09:48:34.805 INFO:teuthology.orchestra.run.smithi165.stdout:(20/23): thrift-0.13.0-2.el8.x86_64.rpm 1.4 MB/s | 1.7 MB 00:01 2023-01-25T09:48:35.771 INFO:teuthology.orchestra.run.smithi165.stdout:(21/23): librados2-18.0.0-1986.g44e4095d.el8.x8 1.7 MB/s | 3.6 MB 00:02 2023-01-25T09:48:36.257 INFO:teuthology.orchestra.run.smithi165.stdout:(22/23): ceph-common-18.0.0-1986.g44e4095d.el8. 2.3 MB/s | 21 MB 00:09 2023-01-25T09:48:37.497 INFO:teuthology.orchestra.run.smithi165.stdout:(23/23): librbd1-18.0.0-1986.g44e4095d.el8.x86_ 1.3 MB/s | 3.6 MB 00:02 2023-01-25T09:48:37.500 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:48:37.501 INFO:teuthology.orchestra.run.smithi165.stdout:Total 5.5 MB/s | 58 MB 00:10 2023-01-25T09:48:37.539 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:48:37.583 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:48:37.583 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:48:38.211 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:48:38.214 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:48:39.508 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:48:39.737 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T09:48:40.001 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T09:48:40.213 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T09:48:40.349 INFO:teuthology.orchestra.run.smithi085.stdout:(23/23): ceph-common-18.0.0-1986.g44e4095d.el8. 1.6 MB/s | 21 MB 00:13 2023-01-25T09:48:40.353 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:48:40.353 INFO:teuthology.orchestra.run.smithi085.stdout:Total 4.3 MB/s | 58 MB 00:13 2023-01-25T09:48:40.394 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:48:40.440 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:48:40.441 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:48:40.620 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T09:48:40.855 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:48:40.947 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:48:41.202 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 5/25 2023-01-25T09:48:41.237 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:48:41.240 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:48:41.414 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 6/25 2023-01-25T09:48:41.831 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 6/25 2023-01-25T09:48:42.038 INFO:teuthology.orchestra.run.smithi165.stdout: Upgrading : librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:48:42.136 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:48:42.320 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T09:48:42.488 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T09:48:42.520 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:48:42.539 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T09:48:42.715 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8. 10/25 2023-01-25T09:48:42.739 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T09:48:42.956 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T09:48:42.973 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 11/25 2023-01-25T09:48:43.141 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T09:48:43.197 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 12/25 2023-01-25T09:48:43.363 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 13/25 2023-01-25T09:48:43.437 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 13/25 2023-01-25T09:48:43.570 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T09:48:43.675 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T09:48:43.767 INFO:teuthology.orchestra.run.smithi085.stdout: Upgrading : librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:48:43.849 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:48:44.122 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 5/25 2023-01-25T09:48:44.308 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 6/25 2023-01-25T09:48:44.501 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T09:48:44.690 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 6/25 2023-01-25T09:48:44.738 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 16/25 2023-01-25T09:48:44.808 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 16/25 2023-01-25T09:48:44.858 INFO:teuthology.orchestra.run.smithi085.stdout: Upgrading : librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:48:44.921 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:48:45.062 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 17/25 2023-01-25T09:48:45.072 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T09:48:45.233 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T09:48:45.271 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T09:48:45.291 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T09:48:45.418 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8. 10/25 2023-01-25T09:48:45.505 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x8 19/25 2023-01-25T09:48:45.651 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 11/25 2023-01-25T09:48:45.900 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 12/25 2023-01-25T09:48:46.041 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 13/25 2023-01-25T09:48:46.115 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 13/25 2023-01-25T09:48:46.317 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T09:48:47.312 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T09:48:47.483 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 16/25 2023-01-25T09:48:47.552 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 16/25 2023-01-25T09:48:47.774 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 17/25 2023-01-25T09:48:47.941 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T09:48:48.141 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x8 19/25 2023-01-25T09:48:49.146 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:49.387 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:49.974 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:50.296 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 21/25 2023-01-25T09:48:50.390 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 21/25 2023-01-25T09:48:50.612 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:48:51.672 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:51.990 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:52.565 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 20/25 2023-01-25T09:48:52.919 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 21/25 2023-01-25T09:48:53.012 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 21/25 2023-01-25T09:48:53.158 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:49:09.585 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:49:09.585 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /sys 2023-01-25T09:49:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /proc 2023-01-25T09:49:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /dev 2023-01-25T09:49:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /run 2023-01-25T09:49:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /mnt 2023-01-25T09:49:09.586 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /var/tmp 2023-01-25T09:49:09.587 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /home 2023-01-25T09:49:09.587 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /tmp 2023-01-25T09:49:09.587 INFO:teuthology.orchestra.run.smithi165.stdout:skipping the directory /dev 2023-01-25T09:49:09.587 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:11.017 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 23/25 2023-01-25T09:49:11.037 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 23/25 2023-01-25T09:49:11.037 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T09:49:11.269 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T09:49:11.269 INFO:teuthology.orchestra.run.smithi165.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:12.047 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:12.047 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 1/25 2023-01-25T09:49:12.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2/25 2023-01-25T09:49:12.048 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 3/25 2023-01-25T09:49:12.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:49:12.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 5/25 2023-01-25T09:49:12.049 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 6/25 2023-01-25T09:49:12.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:49:12.050 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8. 8/25 2023-01-25T09:49:12.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x8 9/25 2023-01-25T09:49:12.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 10/25 2023-01-25T09:49:12.051 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 11/25 2023-01-25T09:49:12.052 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 12/25 2023-01-25T09:49:12.052 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 13/25 2023-01-25T09:49:12.052 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T09:49:12.053 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T09:49:12.053 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T09:49:12.054 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T09:49:12.054 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T09:49:12.054 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T09:49:12.055 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T09:49:12.055 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T09:49:12.056 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:49:12.056 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T09:49:12.056 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 24/25 2023-01-25T09:49:12.981 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:12.981 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:12.981 INFO:teuthology.orchestra.run.smithi165.stdout:Upgraded: 2023-01-25T09:49:12.981 INFO:teuthology.orchestra.run.smithi165.stdout: librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.982 INFO:teuthology.orchestra.run.smithi165.stdout: librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.982 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:49:12.982 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.982 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.982 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.983 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.983 INFO:teuthology.orchestra.run.smithi165.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T09:49:12.983 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.983 INFO:teuthology.orchestra.run.smithi165.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T09:49:12.983 INFO:teuthology.orchestra.run.smithi165.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T09:49:12.984 INFO:teuthology.orchestra.run.smithi165.stdout: libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.984 INFO:teuthology.orchestra.run.smithi165.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T09:49:12.984 INFO:teuthology.orchestra.run.smithi165.stdout: librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.984 INFO:teuthology.orchestra.run.smithi165.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T09:49:12.984 INFO:teuthology.orchestra.run.smithi165.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T09:49:12.985 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.985 INFO:teuthology.orchestra.run.smithi165.stdout: python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.985 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.985 INFO:teuthology.orchestra.run.smithi165.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T09:49:12.985 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.986 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.986 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:12.986 INFO:teuthology.orchestra.run.smithi165.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T09:49:12.986 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:12.986 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:13.028 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:49:13.028 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /sys 2023-01-25T09:49:13.028 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /proc 2023-01-25T09:49:13.028 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /dev 2023-01-25T09:49:13.029 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /run 2023-01-25T09:49:13.029 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /mnt 2023-01-25T09:49:13.029 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /var/tmp 2023-01-25T09:49:13.029 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /home 2023-01-25T09:49:13.029 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /tmp 2023-01-25T09:49:13.030 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /dev 2023-01-25T09:49:13.030 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:13.283 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-test 2023-01-25T09:49:14.014 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:00:51 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:14.482 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 23/25 2023-01-25T09:49:14.503 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 23/25 2023-01-25T09:49:14.504 INFO:teuthology.orchestra.run.smithi085.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T09:49:14.714 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T09:49:14.714 INFO:teuthology.orchestra.run.smithi085.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:15.153 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:15.154 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:15.155 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:49:15.155 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:15.155 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:49:15.155 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 45 M 2023-01-25T09:49:15.155 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:49:15.156 INFO:teuthology.orchestra.run.smithi165.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T09:49:15.156 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 137 k 2023-01-25T09:49:15.156 INFO:teuthology.orchestra.run.smithi165.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T09:49:15.156 INFO:teuthology.orchestra.run.smithi165.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T09:49:15.157 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T09:49:15.157 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:15.157 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:49:15.157 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:15.157 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2023-01-25T09:49:15.158 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:15.158 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 46 M 2023-01-25T09:49:15.158 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 204 M 2023-01-25T09:49:15.159 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:49:15.231 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.7 MB/s | 202 kB 00:00 2023-01-25T09:49:15.249 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-01-25T09:49:15.282 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T09:49:15.307 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-01-25T09:49:15.416 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): libcephsqlite-18.0.0-1986.g44e4095d.el8. 531 kB/s | 137 kB 00:00 2023-01-25T09:49:15.454 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:15.454 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 1/25 2023-01-25T09:49:15.454 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2/25 2023-01-25T09:49:15.455 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 3/25 2023-01-25T09:49:15.455 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 4/25 2023-01-25T09:49:15.455 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 5/25 2023-01-25T09:49:15.455 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_6 6/25 2023-01-25T09:49:15.455 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 7/25 2023-01-25T09:49:15.456 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8. 8/25 2023-01-25T09:49:15.456 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x8 9/25 2023-01-25T09:49:15.456 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 10/25 2023-01-25T09:49:15.456 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 11/25 2023-01-25T09:49:15.456 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 12/25 2023-01-25T09:49:15.457 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 13/25 2023-01-25T09:49:15.457 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T09:49:15.457 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T09:49:15.457 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T09:49:15.458 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T09:49:15.458 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T09:49:15.458 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T09:49:15.458 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T09:49:15.458 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T09:49:15.459 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 22/25 2023-01-25T09:49:15.459 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T09:49:15.459 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 24/25 2023-01-25T09:49:16.315 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T09:49:16.315 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:16.315 INFO:teuthology.orchestra.run.smithi085.stdout:Upgraded: 2023-01-25T09:49:16.315 INFO:teuthology.orchestra.run.smithi085.stdout: librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.316 INFO:teuthology.orchestra.run.smithi085.stdout: librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.316 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:49:16.316 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.316 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.316 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-radosgw-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.317 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-selinux-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.317 INFO:teuthology.orchestra.run.smithi085.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T09:49:16.317 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.317 INFO:teuthology.orchestra.run.smithi085.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T09:49:16.317 INFO:teuthology.orchestra.run.smithi085.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T09:49:16.318 INFO:teuthology.orchestra.run.smithi085.stdout: libradosstriper1-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.318 INFO:teuthology.orchestra.run.smithi085.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T09:49:16.318 INFO:teuthology.orchestra.run.smithi085.stdout: librgw2-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.318 INFO:teuthology.orchestra.run.smithi085.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T09:49:16.318 INFO:teuthology.orchestra.run.smithi085.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-argparse-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-common-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.319 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.320 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:16.320 INFO:teuthology.orchestra.run.smithi085.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T09:49:16.320 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:16.320 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:16.567 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-test 2023-01-25T09:49:17.290 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:00:54 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:17.399 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): ceph-test-18.0.0-1986.g44e4095d.el8.x86_ 20 MB/s | 45 MB 00:02 2023-01-25T09:49:17.402 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:17.403 INFO:teuthology.orchestra.run.smithi165.stdout:Total 20 MB/s | 46 MB 00:02 2023-01-25T09:49:17.444 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:49:17.466 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:49:17.466 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:49:17.759 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:49:17.762 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:49:18.269 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:49:18.431 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:18.432 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:18.432 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:49:18.433 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:18.433 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:49:18.434 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-test x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 45 M 2023-01-25T09:49:18.434 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:49:18.434 INFO:teuthology.orchestra.run.smithi085.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T09:49:18.434 INFO:teuthology.orchestra.run.smithi085.stdout: libcephsqlite x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 137 k 2023-01-25T09:49:18.435 INFO:teuthology.orchestra.run.smithi085.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T09:49:18.435 INFO:teuthology.orchestra.run.smithi085.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T09:49:18.435 INFO:teuthology.orchestra.run.smithi085.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T09:49:18.436 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:18.436 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:49:18.436 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:18.436 INFO:teuthology.orchestra.run.smithi085.stdout:Install 6 Packages 2023-01-25T09:49:18.437 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:18.438 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 46 M 2023-01-25T09:49:18.438 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 204 M 2023-01-25T09:49:18.438 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:49:18.500 INFO:teuthology.orchestra.run.smithi085.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 3.0 MB/s | 202 kB 00:00 2023-01-25T09:49:18.518 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T09:49:18.525 INFO:teuthology.orchestra.run.smithi085.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2023-01-25T09:49:18.559 INFO:teuthology.orchestra.run.smithi085.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T09:49:18.584 INFO:teuthology.orchestra.run.smithi085.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 71 kB 00:00 2023-01-25T09:49:18.643 INFO:teuthology.orchestra.run.smithi085.stdout:(5/6): libcephsqlite-18.0.0-1986.g44e4095d.el8. 661 kB/s | 137 kB 00:00 2023-01-25T09:49:18.696 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T09:49:18.890 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T09:49:18.969 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T09:49:19.193 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T09:49:19.373 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 5/6 2023-01-25T09:49:20.693 INFO:teuthology.orchestra.run.smithi085.stdout:(6/6): ceph-test-18.0.0-1986.g44e4095d.el8.x86_ 20 MB/s | 45 MB 00:02 2023-01-25T09:49:20.696 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:20.696 INFO:teuthology.orchestra.run.smithi085.stdout:Total 20 MB/s | 46 MB 00:02 2023-01-25T09:49:20.740 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:49:20.761 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:49:20.761 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:49:21.046 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:49:21.050 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:49:21.513 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:49:21.722 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T09:49:21.897 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T09:49:22.077 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T09:49:22.156 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T09:49:22.339 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T09:49:22.519 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 5/6 2023-01-25T09:49:23.762 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 5/6 2023-01-25T09:49:24.061 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 6/6 2023-01-25T09:49:24.369 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 6/6 2023-01-25T09:49:24.369 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 1/6 2023-01-25T09:49:24.370 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 2/6 2023-01-25T09:49:24.370 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T09:49:24.370 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T09:49:24.370 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T09:49:24.916 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T09:49:24.917 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:24.917 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:49:24.917 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:24.917 INFO:teuthology.orchestra.run.smithi165.stdout: jq-1.6-6.el8.x86_64 2023-01-25T09:49:24.918 INFO:teuthology.orchestra.run.smithi165.stdout: libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:24.918 INFO:teuthology.orchestra.run.smithi165.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T09:49:24.918 INFO:teuthology.orchestra.run.smithi165.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T09:49:24.918 INFO:teuthology.orchestra.run.smithi165.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T09:49:24.918 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:24.919 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:25.166 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph 2023-01-25T09:49:25.901 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:02 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:26.918 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 5/6 2023-01-25T09:49:27.049 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:27.052 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2023-01-25T09:49:27.052 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:49:27.052 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2023-01-25T09:49:27.053 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:49:27.053 INFO:teuthology.orchestra.run.smithi165.stdout: ceph x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 6.4 k 2023-01-25T09:49:27.053 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:49:27.053 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 2.3 M 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 1.5 M 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 236 k 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.9 M 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 17 M 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T09:49:27.054 INFO:teuthology.orchestra.run.smithi165.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T09:49:27.055 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T09:49:27.055 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T09:49:27.055 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T09:49:27.055 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T09:49:27.055 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T09:49:27.056 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T09:49:27.056 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T09:49:27.057 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T09:49:27.058 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T09:49:27.058 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T09:49:27.058 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T09:49:27.059 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T09:49:27.059 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T09:49:27.059 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T09:49:27.060 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T09:49:27.060 INFO:teuthology.orchestra.run.smithi165.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T09:49:27.061 INFO:teuthology.orchestra.run.smithi165.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T09:49:27.061 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T09:49:27.061 INFO:teuthology.orchestra.run.smithi165.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T09:49:27.062 INFO:teuthology.orchestra.run.smithi165.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T09:49:27.062 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T09:49:27.062 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T09:49:27.063 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T09:49:27.063 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T09:49:27.063 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:27.064 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:49:27.064 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================= 2023-01-25T09:49:27.064 INFO:teuthology.orchestra.run.smithi165.stdout:Install 32 Packages 2023-01-25T09:49:27.065 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:27.065 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 28 M 2023-01-25T09:49:27.066 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 107 M 2023-01-25T09:49:27.066 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:49:27.207 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 6/6 2023-01-25T09:49:27.335 INFO:teuthology.orchestra.run.smithi165.stdout:(1/32): ceph-18.0.0-1986.g44e4095d.el8.x86_64.r 23 kB/s | 6.4 kB 00:00 2023-01-25T09:49:27.512 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 6/6 2023-01-25T09:49:27.513 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 1/6 2023-01-25T09:49:27.513 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 2/6 2023-01-25T09:49:27.513 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T09:49:27.513 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T09:49:27.514 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T09:49:27.644 INFO:teuthology.orchestra.run.smithi165.stdout:(2/32): ceph-mgr-18.0.0-1986.g44e4095d.el8.x86_ 2.6 MB/s | 1.5 MB 00:00 2023-01-25T09:49:27.827 INFO:teuthology.orchestra.run.smithi165.stdout:(3/32): ceph-mds-18.0.0-1986.g44e4095d.el8.x86_ 3.0 MB/s | 2.3 MB 00:00 2023-01-25T09:49:27.878 INFO:teuthology.orchestra.run.smithi165.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1986.g44e4 4.6 MB/s | 236 kB 00:00 2023-01-25T09:49:27.945 INFO:teuthology.orchestra.run.smithi165.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-01-25T09:49:27.970 INFO:teuthology.orchestra.run.smithi165.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T09:49:27.996 INFO:teuthology.orchestra.run.smithi165.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T09:49:28.019 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T09:49:28.019 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:28.019 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:49:28.020 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-test-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:28.020 INFO:teuthology.orchestra.run.smithi085.stdout: jq-1.6-6.el8.x86_64 2023-01-25T09:49:28.020 INFO:teuthology.orchestra.run.smithi085.stdout: libcephsqlite-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:28.020 INFO:teuthology.orchestra.run.smithi085.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T09:49:28.020 INFO:teuthology.orchestra.run.smithi085.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T09:49:28.021 INFO:teuthology.orchestra.run.smithi085.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T09:49:28.021 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:28.021 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:28.021 INFO:teuthology.orchestra.run.smithi165.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-25T09:49:28.113 INFO:teuthology.orchestra.run.smithi165.stdout:(9/32): ceph-mon-18.0.0-1986.g44e4095d.el8.x86_ 5.0 MB/s | 3.9 MB 00:00 2023-01-25T09:49:28.147 INFO:teuthology.orchestra.run.smithi165.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 3.6 MB/s | 457 kB 00:00 2023-01-25T09:49:28.180 INFO:teuthology.orchestra.run.smithi165.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 237 kB 00:00 2023-01-25T09:49:28.209 INFO:teuthology.orchestra.run.smithi165.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.2 MB/s | 109 kB 00:00 2023-01-25T09:49:28.231 INFO:teuthology.orchestra.run.smithi165.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 6.7 MB/s | 559 kB 00:00 2023-01-25T09:49:28.246 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph 2023-01-25T09:49:28.373 INFO:teuthology.orchestra.run.smithi165.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 261 kB/s | 44 kB 00:00 2023-01-25T09:49:28.465 INFO:teuthology.orchestra.run.smithi165.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 793 kB/s | 185 kB 00:00 2023-01-25T09:49:28.582 INFO:teuthology.orchestra.run.smithi165.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 827 kB/s | 173 kB 00:00 2023-01-25T09:49:28.674 INFO:teuthology.orchestra.run.smithi165.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-01-25T09:49:28.757 INFO:teuthology.orchestra.run.smithi165.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 211 kB/s | 18 kB 00:00 2023-01-25T09:49:28.816 INFO:teuthology.orchestra.run.smithi165.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 834 kB/s | 49 kB 00:00 2023-01-25T09:49:28.917 INFO:teuthology.orchestra.run.smithi165.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 852 kB/s | 384 kB 00:00 2023-01-25T09:49:28.958 INFO:teuthology.orchestra.run.smithi165.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 413 kB/s | 59 kB 00:00 2023-01-25T09:49:28.982 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:05 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:29.034 INFO:teuthology.orchestra.run.smithi165.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-01-25T09:49:29.226 INFO:teuthology.orchestra.run.smithi165.stdout:(23/32): ceph-osd-18.0.0-1986.g44e4095d.el8.x86 10 MB/s | 17 MB 00:01 2023-01-25T09:49:29.251 INFO:teuthology.orchestra.run.smithi165.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 86 kB/s | 19 kB 00:00 2023-01-25T09:49:29.293 INFO:teuthology.orchestra.run.smithi165.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 751 kB/s | 283 kB 00:00 2023-01-25T09:49:29.318 INFO:teuthology.orchestra.run.smithi165.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 436 kB/s | 29 kB 00:00 2023-01-25T09:49:29.360 INFO:teuthology.orchestra.run.smithi165.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 410 kB/s | 27 kB 00:00 2023-01-25T09:49:29.394 INFO:teuthology.orchestra.run.smithi165.stdout:(28/32): python3-singledispatch-3.4.0.3-18.el8. 143 kB/s | 24 kB 00:00 2023-01-25T09:49:29.503 INFO:teuthology.orchestra.run.smithi165.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 788 kB/s | 85 kB 00:00 2023-01-25T09:49:29.528 INFO:teuthology.orchestra.run.smithi165.stdout:(30/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.1 MB/s | 241 kB 00:00 2023-01-25T09:49:29.562 INFO:teuthology.orchestra.run.smithi165.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-01-25T09:49:29.587 INFO:teuthology.orchestra.run.smithi165.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 273 kB/s | 23 kB 00:00 2023-01-25T09:49:29.590 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:29.591 INFO:teuthology.orchestra.run.smithi165.stdout:Total 11 MB/s | 28 MB 00:02 2023-01-25T09:49:29.669 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:49:29.705 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:49:29.705 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:49:30.089 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:49:30.092 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:49:30.133 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:30.137 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T09:49:30.137 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:49:30.137 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T09:49:30.137 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:49:30.137 INFO:teuthology.orchestra.run.smithi085.stdout: ceph x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 6.4 k 2023-01-25T09:49:30.138 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:49:30.138 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mds x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 2.3 M 2023-01-25T09:49:30.138 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 1.5 M 2023-01-25T09:49:30.138 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 236 k 2023-01-25T09:49:30.138 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mon x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.9 M 2023-01-25T09:49:30.139 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-osd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 17 M 2023-01-25T09:49:30.139 INFO:teuthology.orchestra.run.smithi085.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T09:49:30.139 INFO:teuthology.orchestra.run.smithi085.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T09:49:30.139 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T09:49:30.139 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T09:49:30.140 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T09:49:30.140 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T09:49:30.140 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T09:49:30.140 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T09:49:30.140 INFO:teuthology.orchestra.run.smithi085.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T09:49:30.141 INFO:teuthology.orchestra.run.smithi085.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T09:49:30.141 INFO:teuthology.orchestra.run.smithi085.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T09:49:30.141 INFO:teuthology.orchestra.run.smithi085.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T09:49:30.141 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T09:49:30.141 INFO:teuthology.orchestra.run.smithi085.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T09:49:30.142 INFO:teuthology.orchestra.run.smithi085.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T09:49:30.143 INFO:teuthology.orchestra.run.smithi085.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T09:49:30.143 INFO:teuthology.orchestra.run.smithi085.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T09:49:30.143 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T09:49:30.143 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T09:49:30.143 INFO:teuthology.orchestra.run.smithi085.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T09:49:30.144 INFO:teuthology.orchestra.run.smithi085.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T09:49:30.144 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:30.144 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:49:30.144 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T09:49:30.144 INFO:teuthology.orchestra.run.smithi085.stdout:Install 32 Packages 2023-01-25T09:49:30.145 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:30.145 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 28 M 2023-01-25T09:49:30.146 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 107 M 2023-01-25T09:49:30.146 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:49:30.289 INFO:teuthology.orchestra.run.smithi085.stdout:(1/32): ceph-18.0.0-1986.g44e4095d.el8.x86_64.r 44 kB/s | 6.4 kB 00:00 2023-01-25T09:49:30.472 INFO:teuthology.orchestra.run.smithi085.stdout:(2/32): ceph-mgr-18.0.0-1986.g44e4095d.el8.x86_ 4.6 MB/s | 1.5 MB 00:00 2023-01-25T09:49:30.531 INFO:teuthology.orchestra.run.smithi085.stdout:(3/32): ceph-mds-18.0.0-1986.g44e4095d.el8.x86_ 5.8 MB/s | 2.3 MB 00:00 2023-01-25T09:49:30.614 INFO:teuthology.orchestra.run.smithi085.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1986.g44e4 2.8 MB/s | 236 kB 00:00 2023-01-25T09:49:30.675 INFO:teuthology.orchestra.run.smithi085.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T09:49:30.690 INFO:teuthology.orchestra.run.smithi085.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 2.3 MB/s | 39 kB 00:00 2023-01-25T09:49:30.716 INFO:teuthology.orchestra.run.smithi085.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T09:49:30.732 INFO:teuthology.orchestra.run.smithi085.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 3.2 MB/s | 54 kB 00:00 2023-01-25T09:49:30.766 INFO:teuthology.orchestra.run.smithi085.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-25T09:49:30.825 INFO:teuthology.orchestra.run.smithi085.stdout:(10/32): ceph-mon-18.0.0-1986.g44e4095d.el8.x86 7.3 MB/s | 3.9 MB 00:00 2023-01-25T09:49:30.852 INFO:teuthology.orchestra.run.smithi085.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 237 kB 00:00 2023-01-25T09:49:30.917 INFO:teuthology.orchestra.run.smithi085.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 1.7 MB/s | 109 kB 00:00 2023-01-25T09:49:30.951 INFO:teuthology.orchestra.run.smithi085.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 4.3 MB/s | 559 kB 00:00 2023-01-25T09:49:31.060 INFO:teuthology.orchestra.run.smithi085.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 311 kB/s | 44 kB 00:00 2023-01-25T09:49:31.177 INFO:teuthology.orchestra.run.smithi085.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 820 kB/s | 185 kB 00:00 2023-01-25T09:49:31.202 INFO:teuthology.orchestra.run.smithi085.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2023-01-25T09:49:31.252 INFO:teuthology.orchestra.run.smithi085.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2023-01-25T09:49:31.303 INFO:teuthology.orchestra.run.smithi085.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 351 kB/s | 18 kB 00:00 2023-01-25T09:49:31.445 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:49:31.462 INFO:teuthology.orchestra.run.smithi085.stdout:(19/32): ceph-osd-18.0.0-1986.g44e4095d.el8.x86 17 MB/s | 17 MB 00:00 2023-01-25T09:49:31.487 INFO:teuthology.orchestra.run.smithi085.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 265 kB/s | 49 kB 00:00 2023-01-25T09:49:31.553 INFO:teuthology.orchestra.run.smithi085.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.0 MB/s | 384 kB 00:00 2023-01-25T09:49:31.612 INFO:teuthology.orchestra.run.smithi085.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 391 kB/s | 59 kB 00:00 2023-01-25T09:49:31.638 INFO:teuthology.orchestra.run.smithi085.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 185 kB/s | 16 kB 00:00 2023-01-25T09:49:31.671 INFO:teuthology.orchestra.run.smithi085.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 318 kB/s | 19 kB 00:00 2023-01-25T09:49:31.697 INFO:teuthology.orchestra.run.smithi085.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 407 kB/s | 24 kB 00:00 2023-01-25T09:49:31.727 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T09:49:31.730 INFO:teuthology.orchestra.run.smithi085.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.1 MB/s | 283 kB 00:00 2023-01-25T09:49:31.756 INFO:teuthology.orchestra.run.smithi085.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 348 kB/s | 29 kB 00:00 2023-01-25T09:49:31.781 INFO:teuthology.orchestra.run.smithi085.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 327 kB/s | 27 kB 00:00 2023-01-25T09:49:31.856 INFO:teuthology.orchestra.run.smithi085.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2023-01-25T09:49:31.907 INFO:teuthology.orchestra.run.smithi085.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 458 kB/s | 23 kB 00:00 2023-01-25T09:49:31.932 INFO:teuthology.orchestra.run.smithi085.stdout:(31/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.2 MB/s | 241 kB 00:00 2023-01-25T09:49:31.957 INFO:teuthology.orchestra.run.smithi085.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-01-25T09:49:31.961 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:31.961 INFO:teuthology.orchestra.run.smithi085.stdout:Total 15 MB/s | 28 MB 00:01 2023-01-25T09:49:32.012 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T09:49:32.039 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:49:32.075 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:49:32.075 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:49:32.301 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T09:49:32.476 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:49:32.480 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:49:32.577 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T09:49:32.783 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T09:49:32.938 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T09:49:33.165 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T09:49:33.368 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T09:49:33.627 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T09:49:33.672 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:49:33.897 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T09:49:33.941 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T09:49:34.175 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T09:49:34.219 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T09:49:34.413 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T09:49:34.481 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T09:49:34.665 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T09:49:34.863 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T09:49:34.916 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T09:49:35.034 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T09:49:35.190 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T09:49:35.219 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T09:49:35.380 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T09:49:35.403 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T09:49:35.630 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T09:49:35.695 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T09:49:35.878 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T09:49:35.946 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T09:49:36.132 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T09:49:36.289 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T09:49:36.339 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T09:49:36.559 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T09:49:36.735 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T09:49:36.822 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T09:49:36.986 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T09:49:37.050 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T09:49:37.191 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T09:49:37.276 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T09:49:37.467 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T09:49:37.507 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T09:49:37.692 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T09:49:37.763 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T09:49:37.975 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T09:49:38.155 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T09:49:38.222 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T09:49:38.410 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T09:49:38.508 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T09:49:38.596 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T09:49:38.883 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T09:49:38.891 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8. 27/32 2023-01-25T09:49:39.106 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T09:49:39.106 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 28/32 2023-01-25T09:49:39.368 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T09:49:39.729 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T09:49:40.088 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T09:49:40.472 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8. 27/32 2023-01-25T09:49:40.571 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 28/32 2023-01-25T09:49:40.701 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 28/32 2023-01-25T09:49:40.808 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 29/32 2023-01-25T09:49:41.211 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 29/32 2023-01-25T09:49:41.428 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 30/32 2023-01-25T09:49:41.643 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 30/32 2023-01-25T09:49:41.828 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 31/32 2023-01-25T09:49:41.846 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 31/32 2023-01-25T09:49:41.987 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 32/32 2023-01-25T09:49:42.156 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 28/32 2023-01-25T09:49:42.354 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 29/32 2023-01-25T09:49:42.427 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 32/32 2023-01-25T09:49:42.428 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 1/32 2023-01-25T09:49:42.428 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 2/32 2023-01-25T09:49:42.428 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 3/32 2023-01-25T09:49:42.428 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 4/32 2023-01-25T09:49:42.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 5/32 2023-01-25T09:49:42.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8. 6/32 2023-01-25T09:49:42.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T09:49:42.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T09:49:42.429 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T09:49:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T09:49:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T09:49:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T09:49:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T09:49:42.430 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T09:49:42.431 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T09:49:42.431 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T09:49:42.431 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T09:49:42.431 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T09:49:42.431 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T09:49:42.432 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T09:49:42.432 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T09:49:42.432 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T09:49:42.432 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T09:49:42.432 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T09:49:42.433 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T09:49:42.433 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T09:49:42.433 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T09:49:42.433 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T09:49:42.434 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T09:49:42.434 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T09:49:42.434 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T09:49:42.748 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 29/32 2023-01-25T09:49:42.941 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 30/32 2023-01-25T09:49:43.155 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 30/32 2023-01-25T09:49:43.357 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 31/32 2023-01-25T09:49:43.376 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 31/32 2023-01-25T09:49:43.383 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T09:49:43.383 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:43.384 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:49:43.384 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:43.385 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:43.385 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:43.385 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:49:43.386 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:43.386 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:43.387 INFO:teuthology.orchestra.run.smithi165.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T09:49:43.387 INFO:teuthology.orchestra.run.smithi165.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T09:49:43.387 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T09:49:43.388 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T09:49:43.388 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T09:49:43.388 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T09:49:43.389 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T09:49:43.389 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T09:49:43.389 INFO:teuthology.orchestra.run.smithi165.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T09:49:43.390 INFO:teuthology.orchestra.run.smithi165.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T09:49:43.390 INFO:teuthology.orchestra.run.smithi165.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T09:49:43.390 INFO:teuthology.orchestra.run.smithi165.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T09:49:43.390 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T09:49:43.391 INFO:teuthology.orchestra.run.smithi165.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T09:49:43.391 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T09:49:43.391 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T09:49:43.392 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T09:49:43.392 INFO:teuthology.orchestra.run.smithi165.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T09:49:43.392 INFO:teuthology.orchestra.run.smithi165.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T09:49:43.392 INFO:teuthology.orchestra.run.smithi165.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T09:49:43.393 INFO:teuthology.orchestra.run.smithi165.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T09:49:43.393 INFO:teuthology.orchestra.run.smithi165.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T09:49:43.394 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T09:49:43.394 INFO:teuthology.orchestra.run.smithi165.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T09:49:43.394 INFO:teuthology.orchestra.run.smithi165.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T09:49:43.394 INFO:teuthology.orchestra.run.smithi165.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T09:49:43.394 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:43.395 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:43.497 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 32/32 2023-01-25T09:49:43.603 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-base 2023-01-25T09:49:43.942 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 32/32 2023-01-25T09:49:43.943 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 1/32 2023-01-25T09:49:43.943 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 2/32 2023-01-25T09:49:43.943 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 3/32 2023-01-25T09:49:43.943 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 4/32 2023-01-25T09:49:43.943 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 5/32 2023-01-25T09:49:43.944 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8. 6/32 2023-01-25T09:49:43.944 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T09:49:43.944 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T09:49:43.944 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T09:49:43.944 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T09:49:43.945 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T09:49:43.945 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T09:49:43.945 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T09:49:43.945 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T09:49:43.945 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T09:49:43.946 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T09:49:43.946 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T09:49:43.946 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T09:49:43.946 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T09:49:43.946 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T09:49:43.947 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T09:49:43.948 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T09:49:43.948 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T09:49:43.948 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T09:49:43.948 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T09:49:43.949 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T09:49:44.332 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:21 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:44.821 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T09:49:44.821 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:44.822 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:49:44.822 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:44.822 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mds-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:44.822 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:44.822 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-modules-core-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:49:44.823 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mon-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:44.823 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-osd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:44.823 INFO:teuthology.orchestra.run.smithi085.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T09:49:44.823 INFO:teuthology.orchestra.run.smithi085.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T09:49:44.823 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T09:49:44.824 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T09:49:44.824 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T09:49:44.824 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T09:49:44.824 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T09:49:44.825 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T09:49:44.825 INFO:teuthology.orchestra.run.smithi085.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T09:49:44.825 INFO:teuthology.orchestra.run.smithi085.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T09:49:44.825 INFO:teuthology.orchestra.run.smithi085.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T09:49:44.825 INFO:teuthology.orchestra.run.smithi085.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T09:49:44.826 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T09:49:44.826 INFO:teuthology.orchestra.run.smithi085.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T09:49:44.826 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T09:49:44.827 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T09:49:44.827 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T09:49:44.827 INFO:teuthology.orchestra.run.smithi085.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T09:49:44.827 INFO:teuthology.orchestra.run.smithi085.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T09:49:44.827 INFO:teuthology.orchestra.run.smithi085.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T09:49:44.828 INFO:teuthology.orchestra.run.smithi085.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T09:49:44.828 INFO:teuthology.orchestra.run.smithi085.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T09:49:44.828 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T09:49:44.829 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T09:49:44.829 INFO:teuthology.orchestra.run.smithi085.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T09:49:44.829 INFO:teuthology.orchestra.run.smithi085.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T09:49:44.829 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:44.829 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:45.034 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-base 2023-01-25T09:49:45.372 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:49:45.471 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:45.472 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:49:45.473 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:45.570 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install cephadm 2023-01-25T09:49:45.749 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:22 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:46.291 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:23 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:46.791 INFO:teuthology.orchestra.run.smithi085.stdout:Package ceph-base-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:49:46.892 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:46.894 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:49:46.894 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:46.984 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install cephadm 2023-01-25T09:49:47.445 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:47.446 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:47.447 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:49:47.447 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:47.447 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:49:47.447 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 82 k 2023-01-25T09:49:47.447 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:47.448 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:49:47.448 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:47.448 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:49:47.448 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:47.448 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 82 k 2023-01-25T09:49:47.449 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 374 k 2023-01-25T09:49:47.449 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:49:47.635 INFO:teuthology.orchestra.run.smithi165.stdout:cephadm-18.0.0-1986.g44e4095d.el8.noarch.rpm 459 kB/s | 82 kB 00:00 2023-01-25T09:49:47.635 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:47.636 INFO:teuthology.orchestra.run.smithi165.stdout:Total 456 kB/s | 82 kB 00:00 2023-01-25T09:49:47.636 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:49:47.636 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:49:47.636 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:49:47.637 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:49:47.640 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:49:47.689 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:49:47.702 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:24 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:48.858 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:48.859 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:48.859 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:49:48.859 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:48.859 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:49:48.860 INFO:teuthology.orchestra.run.smithi085.stdout: cephadm noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 82 k 2023-01-25T09:49:48.860 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:48.860 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:49:48.860 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:48.860 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:49:48.861 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:48.861 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 82 k 2023-01-25T09:49:48.861 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 374 k 2023-01-25T09:49:48.861 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:49:49.042 INFO:teuthology.orchestra.run.smithi085.stdout:cephadm-18.0.0-1986.g44e4095d.el8.noarch.rpm 451 kB/s | 82 kB 00:00 2023-01-25T09:49:49.044 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:49.044 INFO:teuthology.orchestra.run.smithi085.stdout:Total 448 kB/s | 82 kB 00:00 2023-01-25T09:49:49.044 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:49:49.051 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:49:49.051 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:49:49.053 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:49:49.056 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:49:49.132 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:49:49.283 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:49.465 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:49.703 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:50.685 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:50.792 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:50.792 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:50.792 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:49:50.793 INFO:teuthology.orchestra.run.smithi165.stdout: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:49:50.793 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:50.793 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:50.836 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:51.038 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T09:49:51.073 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:51.550 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:49:51.551 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:51.551 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:49:51.551 INFO:teuthology.orchestra.run.smithi085.stdout: cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:49:51.552 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:51.552 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:51.776 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:28 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:51.843 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T09:49:52.571 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:29 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:52.935 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:52.936 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:52.936 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2023-01-25T09:49:52.936 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:52.936 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:49:52.937 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 165 k 2023-01-25T09:49:52.937 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:52.937 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:49:52.937 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:52.937 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:49:52.938 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:52.938 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 165 k 2023-01-25T09:49:52.938 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 503 k 2023-01-25T09:49:52.938 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:49:53.214 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-immutable-object-cache-18.0.0-1986.g44e409 596 kB/s | 165 kB 00:00 2023-01-25T09:49:53.215 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:53.215 INFO:teuthology.orchestra.run.smithi165.stdout:Total 593 kB/s | 165 kB 00:00 2023-01-25T09:49:53.215 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:49:53.226 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:49:53.227 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:49:53.275 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:49:53.278 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:49:53.416 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:49:53.625 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:53.723 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:53.724 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:53.725 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T09:49:53.725 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:53.725 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:49:53.725 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 165 k 2023-01-25T09:49:53.725 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:53.726 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:49:53.726 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:53.726 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:49:53.726 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:53.726 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 165 k 2023-01-25T09:49:53.727 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 503 k 2023-01-25T09:49:53.727 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:49:53.941 INFO:teuthology.orchestra.run.smithi085.stdout:ceph-immutable-object-cache-18.0.0-1986.g44e409 768 kB/s | 165 kB 00:00 2023-01-25T09:49:53.941 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:53.942 INFO:teuthology.orchestra.run.smithi085.stdout:Total 764 kB/s | 165 kB 00:00 2023-01-25T09:49:53.942 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:49:53.953 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:49:53.953 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:49:54.003 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:49:54.006 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:49:54.075 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:54.136 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:49:54.331 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:54.599 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:54.600 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:54.600 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:49:54.601 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:54.601 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:54.601 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:54.755 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:54.812 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr 2023-01-25T09:49:55.245 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d. 1/1 2023-01-25T09:49:55.246 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:55.246 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:49:55.246 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-immutable-object-cache-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:49:55.246 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:55.246 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:55.438 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr 2023-01-25T09:49:55.548 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:32 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:56.168 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:33 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:56.599 INFO:teuthology.orchestra.run.smithi165.stdout:Package ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:49:56.697 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:56.699 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:49:56.699 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:49:57.179 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T09:49:57.216 INFO:teuthology.orchestra.run.smithi085.stdout:Package ceph-mgr-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:49:57.315 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:57.316 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:49:57.316 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:49:57.405 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T09:49:57.900 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:34 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:58.121 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:35 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:49:59.040 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:49:59.041 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:59.041 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:49:59.042 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:59.042 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:49:59.042 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 1.7 M 2023-01-25T09:49:59.042 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:49:59.042 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 23 k 2023-01-25T09:49:59.043 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 15 k 2023-01-25T09:49:59.043 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T09:49:59.043 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T09:49:59.043 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T09:49:59.043 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:59.044 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:49:59.044 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:49:59.044 INFO:teuthology.orchestra.run.smithi165.stdout:Install 6 Packages 2023-01-25T09:49:59.044 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:49:59.045 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 2.0 M 2023-01-25T09:49:59.045 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 8.2 M 2023-01-25T09:49:59.045 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:49:59.222 INFO:teuthology.orchestra.run.smithi165.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1986.g44e 129 kB/s | 23 kB 00:00 2023-01-25T09:49:59.251 INFO:teuthology.orchestra.run.smithi165.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1986.g44e4 70 kB/s | 15 kB 00:00 2023-01-25T09:49:59.266 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:49:59.267 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:59.268 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:49:59.268 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:59.268 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:49:59.269 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 1.7 M 2023-01-25T09:49:59.269 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:49:59.269 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 23 k 2023-01-25T09:49:59.269 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 15 k 2023-01-25T09:49:59.270 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T09:49:59.270 INFO:teuthology.orchestra.run.smithi085.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T09:49:59.270 INFO:teuthology.orchestra.run.smithi085.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T09:49:59.271 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:59.271 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:49:59.271 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:49:59.271 INFO:teuthology.orchestra.run.smithi085.stdout:Install 6 Packages 2023-01-25T09:49:59.271 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:49:59.272 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 2.0 M 2023-01-25T09:49:59.272 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 8.2 M 2023-01-25T09:49:59.272 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:49:59.301 INFO:teuthology.orchestra.run.smithi165.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 540 kB/s | 43 kB 00:00 2023-01-25T09:49:59.377 INFO:teuthology.orchestra.run.smithi165.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 268 kB/s | 34 kB 00:00 2023-01-25T09:49:59.419 INFO:teuthology.orchestra.run.smithi165.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1986.g44e4095d 4.6 MB/s | 1.7 MB 00:00 2023-01-25T09:49:59.535 INFO:teuthology.orchestra.run.smithi165.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 841 kB/s | 196 kB 00:00 2023-01-25T09:49:59.537 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:59.538 INFO:teuthology.orchestra.run.smithi165.stdout:Total 4.1 MB/s | 2.0 MB 00:00 2023-01-25T09:49:59.547 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:49:59.556 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:49:59.557 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:49:59.603 INFO:teuthology.orchestra.run.smithi085.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1986.g44e 69 kB/s | 23 kB 00:00 2023-01-25T09:49:59.628 INFO:teuthology.orchestra.run.smithi085.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1986.g44e4 41 kB/s | 15 kB 00:00 2023-01-25T09:49:59.637 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:49:59.640 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:49:59.679 INFO:teuthology.orchestra.run.smithi085.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 567 kB/s | 43 kB 00:00 2023-01-25T09:49:59.746 INFO:teuthology.orchestra.run.smithi085.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 287 kB/s | 34 kB 00:00 2023-01-25T09:49:59.779 INFO:teuthology.orchestra.run.smithi085.stdout:(5/6): ceph-mgr-dashboard-18.0.0-1986.g44e4095d 3.4 MB/s | 1.7 MB 00:00 2023-01-25T09:49:59.930 INFO:teuthology.orchestra.run.smithi085.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 784 kB/s | 196 kB 00:00 2023-01-25T09:49:59.932 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:49:59.932 INFO:teuthology.orchestra.run.smithi085.stdout:Total 3.0 MB/s | 2.0 MB 00:00 2023-01-25T09:49:59.943 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:49:59.951 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:49:59.952 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:49:59.972 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:00.035 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:00.038 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:00.204 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T09:50:00.324 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:00.433 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T09:50:00.535 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T09:50:00.643 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T09:50:00.755 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.n 4/6 2023-01-25T09:50:00.755 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T09:50:00.924 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T09:50:01.028 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.n 4/6 2023-01-25T09:50:01.153 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8. 5/6 2023-01-25T09:50:01.354 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 6/6 2023-01-25T09:50:01.385 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8. 5/6 2023-01-25T09:50:01.593 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 6/6 2023-01-25T09:50:01.691 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 6/6 2023-01-25T09:50:01.692 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8. 1/6 2023-01-25T09:50:01.692 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 2/6 2023-01-25T09:50:01.692 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.n 3/6 2023-01-25T09:50:01.692 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T09:50:01.692 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T09:50:01.901 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 6/6 2023-01-25T09:50:01.901 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8. 1/6 2023-01-25T09:50:01.902 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarc 2/6 2023-01-25T09:50:01.902 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.n 3/6 2023-01-25T09:50:01.902 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T09:50:01.902 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T09:50:02.230 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T09:50:02.230 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:02.230 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:02.230 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.231 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.231 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.231 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T09:50:02.231 INFO:teuthology.orchestra.run.smithi165.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T09:50:02.231 INFO:teuthology.orchestra.run.smithi165.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T09:50:02.232 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:02.232 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:02.372 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T09:50:02.401 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T09:50:02.401 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:02.401 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:02.401 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-grafana-dashboards-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.401 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-dashboard-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.402 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-prometheus-alerts-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:02.402 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T09:50:02.402 INFO:teuthology.orchestra.run.smithi085.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T09:50:02.402 INFO:teuthology.orchestra.run.smithi085.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T09:50:02.402 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:02.403 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:02.513 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T09:50:03.100 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:40 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:03.235 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:40 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:04.248 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:04.250 INFO:teuthology.orchestra.run.smithi165.stdout:===================================================================================================== 2023-01-25T09:50:04.250 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:50:04.250 INFO:teuthology.orchestra.run.smithi165.stdout:===================================================================================================== 2023-01-25T09:50:04.250 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:04.251 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 7.4 M 2023-01-25T09:50:04.251 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:50:04.251 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T09:50:04.251 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T09:50:04.251 INFO:teuthology.orchestra.run.smithi165.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T09:50:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T09:50:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T09:50:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T09:50:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T09:50:04.252 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:04.253 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:04.253 INFO:teuthology.orchestra.run.smithi165.stdout:===================================================================================================== 2023-01-25T09:50:04.253 INFO:teuthology.orchestra.run.smithi165.stdout:Install 8 Packages 2023-01-25T09:50:04.253 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:04.254 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 35 M 2023-01-25T09:50:04.254 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 210 M 2023-01-25T09:50:04.254 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:04.379 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:04.380 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T09:50:04.380 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:50:04.380 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T09:50:04.380 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:04.381 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 7.4 M 2023-01-25T09:50:04.381 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:50:04.381 INFO:teuthology.orchestra.run.smithi085.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T09:50:04.381 INFO:teuthology.orchestra.run.smithi085.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T09:50:04.381 INFO:teuthology.orchestra.run.smithi085.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T09:50:04.382 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T09:50:04.382 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T09:50:04.382 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T09:50:04.382 INFO:teuthology.orchestra.run.smithi085.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T09:50:04.382 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:04.383 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:04.383 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T09:50:04.383 INFO:teuthology.orchestra.run.smithi085.stdout:Install 8 Packages 2023-01-25T09:50:04.383 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:04.384 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 35 M 2023-01-25T09:50:04.384 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 210 M 2023-01-25T09:50:04.384 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:04.424 INFO:teuthology.orchestra.run.smithi165.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2023-01-25T09:50:04.541 INFO:teuthology.orchestra.run.smithi165.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 32 MB/s | 3.7 MB 00:00 2023-01-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi165.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.9 MB 00:00 2023-01-25T09:50:04.641 INFO:teuthology.orchestra.run.smithi165.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2023-01-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi165.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 19 MB/s | 645 kB 00:00 2023-01-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi165.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2023-01-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi165.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-198 13 MB/s | 7.4 MB 00:00 2023-01-25T09:50:04.906 INFO:teuthology.orchestra.run.smithi085.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 9.0 MB/s | 4.7 MB 00:00 2023-01-25T09:50:05.018 INFO:teuthology.orchestra.run.smithi085.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 7.6 MB/s | 4.9 MB 00:00 2023-01-25T09:50:05.052 INFO:teuthology.orchestra.run.smithi085.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T09:50:05.060 INFO:teuthology.orchestra.run.smithi165.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 31 MB/s | 14 MB 00:00 2023-01-25T09:50:05.061 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:05.063 INFO:teuthology.orchestra.run.smithi165.stdout:Total 44 MB/s | 35 MB 00:00 2023-01-25T09:50:05.166 INFO:teuthology.orchestra.run.smithi085.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2023-01-25T09:50:05.228 INFO:teuthology.orchestra.run.smithi085.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 10 MB/s | 645 kB 00:00 2023-01-25T09:50:05.261 INFO:teuthology.orchestra.run.smithi085.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-01-25T09:50:05.294 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:05.312 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:05.312 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:05.353 INFO:teuthology.orchestra.run.smithi085.stdout:(7/8): ceph-mgr-diskprediction-local-18.0.0-198 7.6 MB/s | 7.4 MB 00:00 2023-01-25T09:50:05.570 INFO:teuthology.orchestra.run.smithi085.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 26 MB/s | 14 MB 00:00 2023-01-25T09:50:05.572 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:05.573 INFO:teuthology.orchestra.run.smithi085.stdout:Total 30 MB/s | 35 MB 00:01 2023-01-25T09:50:05.718 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:05.721 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:05.803 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:05.821 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:05.821 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:06.207 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:06.211 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:06.309 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:06.464 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T09:50:06.603 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T09:50:06.764 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T09:50:06.771 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:06.912 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T09:50:07.030 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T09:50:07.212 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T09:50:07.360 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T09:50:07.581 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:07.802 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T09:50:08.004 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:08.189 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:08.397 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T09:50:08.630 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:08.796 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T09:50:09.079 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T09:50:09.435 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T09:50:09.480 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T09:50:09.630 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T09:50:09.865 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T09:50:10.336 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T09:50:11.407 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T09:50:12.095 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T09:50:12.683 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T09:50:13.365 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T09:50:13.561 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 8/8 2023-01-25T09:50:13.613 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 8/8 2023-01-25T09:50:13.925 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 8/8 2023-01-25T09:50:13.925 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 1/8 2023-01-25T09:50:13.926 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T09:50:13.926 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:13.926 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T09:50:13.926 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T09:50:13.926 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T09:50:13.927 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T09:50:13.974 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 8/8 2023-01-25T09:50:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095 1/8 2023-01-25T09:50:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T09:50:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T09:50:13.975 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T09:50:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T09:50:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T09:50:13.976 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T09:50:14.437 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T09:50:14.438 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:14.438 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:14.438 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:14.438 INFO:teuthology.orchestra.run.smithi085.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T09:50:14.439 INFO:teuthology.orchestra.run.smithi085.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T09:50:14.439 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T09:50:14.439 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T09:50:14.439 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T09:50:14.439 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T09:50:14.440 INFO:teuthology.orchestra.run.smithi085.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T09:50:14.440 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:14.440 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:14.503 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T09:50:14.503 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:14.503 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:14.503 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:14.504 INFO:teuthology.orchestra.run.smithi165.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T09:50:14.504 INFO:teuthology.orchestra.run.smithi165.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T09:50:14.504 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T09:50:14.504 INFO:teuthology.orchestra.run.smithi165.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T09:50:14.504 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T09:50:14.505 INFO:teuthology.orchestra.run.smithi165.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T09:50:14.505 INFO:teuthology.orchestra.run.smithi165.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T09:50:14.505 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:14.505 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:14.546 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-rook 2023-01-25T09:50:14.621 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-rook 2023-01-25T09:50:15.269 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:15.343 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:01:52 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:16.414 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:16.416 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T09:50:16.416 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:50:16.417 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T09:50:16.417 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:16.417 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 47 k 2023-01-25T09:50:16.417 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:50:16.417 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T09:50:16.418 INFO:teuthology.orchestra.run.smithi085.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T09:50:16.419 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T09:50:16.420 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T09:50:16.420 INFO:teuthology.orchestra.run.smithi085.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T09:50:16.421 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T09:50:16.421 INFO:teuthology.orchestra.run.smithi085.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T09:50:16.421 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:16.421 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:16.421 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T09:50:16.422 INFO:teuthology.orchestra.run.smithi085.stdout:Install 13 Packages 2023-01-25T09:50:16.422 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:16.423 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 1.9 M 2023-01-25T09:50:16.423 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 25 M 2023-01-25T09:50:16.424 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:16.489 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:16.490 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================== 2023-01-25T09:50:16.490 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:50:16.491 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================== 2023-01-25T09:50:16.491 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:16.491 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 47 k 2023-01-25T09:50:16.491 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:50:16.491 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T09:50:16.492 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T09:50:16.492 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T09:50:16.492 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T09:50:16.492 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T09:50:16.493 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T09:50:16.493 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T09:50:16.493 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T09:50:16.493 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T09:50:16.493 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T09:50:16.494 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T09:50:16.494 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T09:50:16.494 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:16.494 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:16.494 INFO:teuthology.orchestra.run.smithi165.stdout:======================================================================================== 2023-01-25T09:50:16.495 INFO:teuthology.orchestra.run.smithi165.stdout:Install 13 Packages 2023-01-25T09:50:16.495 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:16.495 INFO:teuthology.orchestra.run.smithi085.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 366 kB/s | 27 kB 00:00 2023-01-25T09:50:16.496 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 1.9 M 2023-01-25T09:50:16.496 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 25 M 2023-01-25T09:50:16.496 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:16.518 INFO:teuthology.orchestra.run.smithi085.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 204 kB/s | 20 kB 00:00 2023-01-25T09:50:16.543 INFO:teuthology.orchestra.run.smithi085.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-01-25T09:50:16.566 INFO:teuthology.orchestra.run.smithi165.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 368 kB/s | 27 kB 00:00 2023-01-25T09:50:16.568 INFO:teuthology.orchestra.run.smithi085.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T09:50:16.591 INFO:teuthology.orchestra.run.smithi165.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 205 kB/s | 20 kB 00:00 2023-01-25T09:50:16.594 INFO:teuthology.orchestra.run.smithi085.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2023-01-25T09:50:16.616 INFO:teuthology.orchestra.run.smithi165.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-01-25T09:50:16.619 INFO:teuthology.orchestra.run.smithi085.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 846 kB/s | 43 kB 00:00 2023-01-25T09:50:16.641 INFO:teuthology.orchestra.run.smithi165.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T09:50:16.662 INFO:teuthology.orchestra.run.smithi085.stdout:(7/13): ceph-mgr-rook-18.0.0-1986.g44e4095d.el8 196 kB/s | 47 kB 00:00 2023-01-25T09:50:16.700 INFO:teuthology.orchestra.run.smithi165.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.8 MB/s | 155 kB 00:00 2023-01-25T09:50:16.726 INFO:teuthology.orchestra.run.smithi165.stdout:(6/13): ceph-mgr-rook-18.0.0-1986.g44e4095d.el8 204 kB/s | 47 kB 00:00 2023-01-25T09:50:16.752 INFO:teuthology.orchestra.run.smithi165.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 391 kB/s | 43 kB 00:00 2023-01-25T09:50:16.753 INFO:teuthology.orchestra.run.smithi085.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-25T09:50:16.779 INFO:teuthology.orchestra.run.smithi085.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 179 kB/s | 33 kB 00:00 2023-01-25T09:50:16.804 INFO:teuthology.orchestra.run.smithi085.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 572 kB/s | 81 kB 00:00 2023-01-25T09:50:16.835 INFO:teuthology.orchestra.run.smithi165.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 245 kB/s | 33 kB 00:00 2023-01-25T09:50:16.854 INFO:teuthology.orchestra.run.smithi085.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 817 kB/s | 61 kB 00:00 2023-01-25T09:50:16.860 INFO:teuthology.orchestra.run.smithi165.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-25T09:50:16.879 INFO:teuthology.orchestra.run.smithi085.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 815 kB/s | 61 kB 00:00 2023-01-25T09:50:16.885 INFO:teuthology.orchestra.run.smithi165.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 606 kB/s | 81 kB 00:00 2023-01-25T09:50:16.977 INFO:teuthology.orchestra.run.smithi165.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 526 kB/s | 61 kB 00:00 2023-01-25T09:50:17.002 INFO:teuthology.orchestra.run.smithi165.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 524 kB/s | 61 kB 00:00 2023-01-25T09:50:17.412 INFO:teuthology.orchestra.run.smithi085.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.8 MB/s | 1.2 MB 00:00 2023-01-25T09:50:17.414 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:17.414 INFO:teuthology.orchestra.run.smithi085.stdout:Total 1.9 MB/s | 1.9 MB 00:00 2023-01-25T09:50:17.466 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:17.481 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:17.481 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:17.561 INFO:teuthology.orchestra.run.smithi165.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.6 MB/s | 1.2 MB 00:00 2023-01-25T09:50:17.562 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:17.563 INFO:teuthology.orchestra.run.smithi165.stdout:Total 1.8 MB/s | 1.9 MB 00:01 2023-01-25T09:50:17.578 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:17.581 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:17.618 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:17.634 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:17.634 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:17.733 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:17.737 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:18.074 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:18.282 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:18.371 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T09:50:18.561 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T09:50:18.787 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T09:50:18.824 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T09:50:19.033 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T09:50:19.047 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T09:50:19.199 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T09:50:19.340 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T09:50:19.421 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T09:50:19.594 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T09:50:19.728 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T09:50:19.802 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T09:50:19.938 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T09:50:20.043 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T09:50:20.335 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T09:50:20.575 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T09:50:20.983 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T09:50:21.318 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T09:50:21.672 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T09:50:21.935 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T09:50:21.951 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T09:50:22.169 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T09:50:22.170 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T09:50:22.335 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 13/13 2023-01-25T09:50:22.404 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T09:50:22.578 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 13/13 2023-01-25T09:50:22.641 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 13/13 2023-01-25T09:50:22.642 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 1/13 2023-01-25T09:50:22.642 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T09:50:22.642 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T09:50:22.642 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T09:50:22.642 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T09:50:22.643 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T09:50:22.643 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T09:50:22.643 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T09:50:22.643 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T09:50:22.643 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T09:50:22.644 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T09:50:22.644 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T09:50:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 13/13 2023-01-25T09:50:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 1/13 2023-01-25T09:50:22.889 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T09:50:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T09:50:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T09:50:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T09:50:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T09:50:22.890 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T09:50:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T09:50:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T09:50:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T09:50:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T09:50:22.891 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T09:50:23.210 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T09:50:23.211 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:23.211 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:23.211 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:23.211 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T09:50:23.211 INFO:teuthology.orchestra.run.smithi085.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T09:50:23.212 INFO:teuthology.orchestra.run.smithi085.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T09:50:23.212 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T09:50:23.212 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T09:50:23.212 INFO:teuthology.orchestra.run.smithi085.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T09:50:23.212 INFO:teuthology.orchestra.run.smithi085.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T09:50:23.213 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T09:50:23.213 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T09:50:23.213 INFO:teuthology.orchestra.run.smithi085.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T09:50:23.213 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T09:50:23.213 INFO:teuthology.orchestra.run.smithi085.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T09:50:23.214 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:23.214 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:23.337 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T09:50:23.456 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T09:50:23.456 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:23.457 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:23.457 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-rook-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:23.457 INFO:teuthology.orchestra.run.smithi165.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T09:50:23.457 INFO:teuthology.orchestra.run.smithi165.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T09:50:23.457 INFO:teuthology.orchestra.run.smithi165.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T09:50:23.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T09:50:23.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T09:50:23.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T09:50:23.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T09:50:23.458 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:23.459 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:23.583 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T09:50:24.064 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:01 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:24.316 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:01 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:25.204 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:25.204 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:25.205 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:50:25.205 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:25.205 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:25.205 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 120 k 2023-01-25T09:50:25.206 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:50:25.206 INFO:teuthology.orchestra.run.smithi085.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T09:50:25.206 INFO:teuthology.orchestra.run.smithi085.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T09:50:25.207 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T09:50:25.207 INFO:teuthology.orchestra.run.smithi085.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T09:50:25.207 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:25.207 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:25.207 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:25.208 INFO:teuthology.orchestra.run.smithi085.stdout:Install 5 Packages 2023-01-25T09:50:25.208 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:25.208 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 6.0 M 2023-01-25T09:50:25.209 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 26 M 2023-01-25T09:50:25.209 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:25.295 INFO:teuthology.orchestra.run.smithi085.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.0 MB/s | 538 kB 00:00 2023-01-25T09:50:25.395 INFO:teuthology.orchestra.run.smithi085.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 26 MB/s | 4.8 MB 00:00 2023-01-25T09:50:25.445 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:25.447 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:25.448 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:50:25.448 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:25.448 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:25.448 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 120 k 2023-01-25T09:50:25.448 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:50:25.449 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T09:50:25.449 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T09:50:25.449 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T09:50:25.449 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T09:50:25.449 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:25.450 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:25.450 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:25.450 INFO:teuthology.orchestra.run.smithi165.stdout:Install 5 Packages 2023-01-25T09:50:25.450 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:25.451 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 6.0 M 2023-01-25T09:50:25.451 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 26 M 2023-01-25T09:50:25.451 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:25.462 INFO:teuthology.orchestra.run.smithi085.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1986.g44e4095d.e 472 kB/s | 120 kB 00:00 2023-01-25T09:50:25.559 INFO:teuthology.orchestra.run.smithi165.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 4.8 MB/s | 538 kB 00:00 2023-01-25T09:50:25.570 INFO:teuthology.orchestra.run.smithi085.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 344 kB/s | 60 kB 00:00 2023-01-25T09:50:25.629 INFO:teuthology.orchestra.run.smithi085.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.4 MB/s | 476 kB 00:00 2023-01-25T09:50:25.630 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:25.631 INFO:teuthology.orchestra.run.smithi085.stdout:Total 14 MB/s | 6.0 MB 00:00 2023-01-25T09:50:25.659 INFO:teuthology.orchestra.run.smithi165.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-01-25T09:50:25.681 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:25.692 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:25.692 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:25.718 INFO:teuthology.orchestra.run.smithi165.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1986.g44e4095d.e 446 kB/s | 120 kB 00:00 2023-01-25T09:50:25.814 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:25.817 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:25.876 INFO:teuthology.orchestra.run.smithi165.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 278 kB/s | 60 kB 00:00 2023-01-25T09:50:25.926 INFO:teuthology.orchestra.run.smithi165.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.3 MB/s | 476 kB 00:00 2023-01-25T09:50:25.928 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:25.929 INFO:teuthology.orchestra.run.smithi165.stdout:Total 12 MB/s | 6.0 MB 00:00 2023-01-25T09:50:25.980 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:25.991 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:25.991 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:26.092 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:26.128 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:26.131 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:26.405 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T09:50:26.406 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:26.749 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T09:50:27.339 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T09:50:27.722 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T09:50:27.725 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T09:50:27.978 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T09:50:28.150 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T09:50:28.184 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 5/5 2023-01-25T09:50:28.438 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T09:50:28.482 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 5/5 2023-01-25T09:50:28.483 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/5 2023-01-25T09:50:28.483 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T09:50:28.483 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T09:50:28.483 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T09:50:28.644 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 5/5 2023-01-25T09:50:28.949 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 5/5 2023-01-25T09:50:28.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 1/5 2023-01-25T09:50:28.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T09:50:28.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T09:50:28.950 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T09:50:28.985 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T09:50:28.985 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:28.985 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:28.986 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:28.986 INFO:teuthology.orchestra.run.smithi085.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T09:50:28.986 INFO:teuthology.orchestra.run.smithi085.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T09:50:28.986 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T09:50:28.986 INFO:teuthology.orchestra.run.smithi085.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T09:50:28.987 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:28.987 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:29.095 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-fuse 2023-01-25T09:50:29.446 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T09:50:29.447 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:29.447 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:29.447 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-mgr-cephadm-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:29.447 INFO:teuthology.orchestra.run.smithi165.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T09:50:29.448 INFO:teuthology.orchestra.run.smithi165.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T09:50:29.448 INFO:teuthology.orchestra.run.smithi165.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T09:50:29.448 INFO:teuthology.orchestra.run.smithi165.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T09:50:29.448 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:29.449 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:29.565 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-fuse 2023-01-25T09:50:29.810 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:06 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:30.287 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:07 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:30.944 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:30.945 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:30.945 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:50:30.946 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:30.946 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:30.946 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-fuse x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 845 k 2023-01-25T09:50:30.946 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T09:50:30.946 INFO:teuthology.orchestra.run.smithi085.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T09:50:30.947 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:30.947 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:30.947 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:30.947 INFO:teuthology.orchestra.run.smithi085.stdout:Install 2 Packages 2023-01-25T09:50:30.947 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:30.948 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 928 k 2023-01-25T09:50:30.949 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 2.9 M 2023-01-25T09:50:30.949 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:31.019 INFO:teuthology.orchestra.run.smithi085.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-01-25T09:50:31.425 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:31.425 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:31.426 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:50:31.426 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:31.426 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:31.426 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 845 k 2023-01-25T09:50:31.427 INFO:teuthology.orchestra.run.smithi165.stdout:Installing dependencies: 2023-01-25T09:50:31.427 INFO:teuthology.orchestra.run.smithi165.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T09:50:31.427 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:31.427 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:31.427 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:31.428 INFO:teuthology.orchestra.run.smithi165.stdout:Install 2 Packages 2023-01-25T09:50:31.428 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:31.429 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 928 k 2023-01-25T09:50:31.429 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 2.9 M 2023-01-25T09:50:31.429 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:31.492 INFO:teuthology.orchestra.run.smithi165.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2023-01-25T09:50:31.586 INFO:teuthology.orchestra.run.smithi085.stdout:(2/2): ceph-fuse-18.0.0-1986.g44e4095d.el8.x86_ 1.3 MB/s | 845 kB 00:00 2023-01-25T09:50:31.586 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:31.587 INFO:teuthology.orchestra.run.smithi085.stdout:Total 1.4 MB/s | 928 kB 00:00 2023-01-25T09:50:31.597 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:31.619 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:31.619 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:31.711 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:31.715 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:31.888 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:32.348 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T09:50:32.556 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2/2 2023-01-25T09:50:32.971 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2/2 2023-01-25T09:50:32.972 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/2 2023-01-25T09:50:33.485 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T09:50:33.485 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:33.486 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:33.486 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T09:50:33.486 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:33.486 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:33.696 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-volume 2023-01-25T09:50:33.774 INFO:teuthology.orchestra.run.smithi165.stdout:(2/2): ceph-fuse-18.0.0-1986.g44e4095d.el8.x86_ 360 kB/s | 845 kB 00:02 2023-01-25T09:50:33.775 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:33.775 INFO:teuthology.orchestra.run.smithi165.stdout:Total 395 kB/s | 928 kB 00:02 2023-01-25T09:50:33.788 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:33.811 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:33.811 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:33.910 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:33.914 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:34.086 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:34.341 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T09:50:34.430 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:11 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:34.532 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2/2 2023-01-25T09:50:34.971 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2/2 2023-01-25T09:50:34.972 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/2 2023-01-25T09:50:35.477 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T09:50:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:35.478 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T09:50:35.478 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:35.478 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:35.567 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:35.567 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:35.567 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T09:50:35.568 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:35.568 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:35.568 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-volume noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 263 k 2023-01-25T09:50:35.569 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:35.569 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:35.569 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:35.569 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:50:35.569 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:35.570 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 263 k 2023-01-25T09:50:35.570 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 1.3 M 2023-01-25T09:50:35.571 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:35.722 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install ceph-volume 2023-01-25T09:50:35.864 INFO:teuthology.orchestra.run.smithi085.stdout:ceph-volume-18.0.0-1986.g44e4095d.el8.noarch.rp 891 kB/s | 263 kB 00:00 2023-01-25T09:50:35.865 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:35.865 INFO:teuthology.orchestra.run.smithi085.stdout:Total 887 kB/s | 263 kB 00:00 2023-01-25T09:50:35.866 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:35.875 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:35.875 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:35.975 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:35.978 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:36.164 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:36.441 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:36.463 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:13 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:36.863 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:37.331 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:37.331 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:37.332 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:37.332 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:37.332 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:37.332 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:37.516 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librados-devel 2023-01-25T09:50:37.605 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:37.606 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:37.607 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repository Size 2023-01-25T09:50:37.607 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:37.608 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:37.608 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume noarch 2:18.0.0-1986.g44e4095d.el8 ceph-noarch 263 k 2023-01-25T09:50:37.608 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:37.609 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:37.609 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:37.610 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:50:37.610 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:37.610 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 263 k 2023-01-25T09:50:37.611 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 1.3 M 2023-01-25T09:50:37.611 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:37.953 INFO:teuthology.orchestra.run.smithi165.stdout:ceph-volume-18.0.0-1986.g44e4095d.el8.noarch.rp 759 kB/s | 263 kB 00:00 2023-01-25T09:50:37.954 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:37.954 INFO:teuthology.orchestra.run.smithi165.stdout:Total 757 kB/s | 263 kB 00:00 2023-01-25T09:50:37.954 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:37.964 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:37.964 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:38.053 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:38.057 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:38.245 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:38.329 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:15 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:38.517 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:38.966 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:39.476 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:39.476 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:39.477 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T09:50:39.477 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:39.477 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:39.477 INFO:teuthology.orchestra.run.smithi085.stdout: librados-devel x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 139 k 2023-01-25T09:50:39.478 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:39.478 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:39.478 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:39.478 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:50:39.478 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:39.479 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 139 k 2023-01-25T09:50:39.479 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 512 k 2023-01-25T09:50:39.479 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:39.514 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 1/1 2023-01-25T09:50:39.514 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:39.514 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:39.515 INFO:teuthology.orchestra.run.smithi165.stdout: ceph-volume-2:18.0.0-1986.g44e4095d.el8.noarch 2023-01-25T09:50:39.515 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:39.515 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:39.730 INFO:teuthology.orchestra.run.smithi085.stdout:librados-devel-18.0.0-1986.g44e4095d.el8.x86_64 551 kB/s | 139 kB 00:00 2023-01-25T09:50:39.731 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:39.731 INFO:teuthology.orchestra.run.smithi085.stdout:Total 548 kB/s | 139 kB 00:00 2023-01-25T09:50:39.732 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:39.736 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:39.736 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:39.757 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados-devel 2023-01-25T09:50:39.790 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:39.793 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:39.928 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:40.104 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:40.409 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:40.484 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:17 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:40.884 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:40.884 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:40.884 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:40.885 INFO:teuthology.orchestra.run.smithi085.stdout: librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:50:40.885 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:40.885 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:41.146 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install libcephfs2 2023-01-25T09:50:41.624 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:41.624 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:41.625 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2023-01-25T09:50:41.625 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:41.625 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:41.625 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 139 k 2023-01-25T09:50:41.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:41.626 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:41.626 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:41.626 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:50:41.626 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:41.627 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 139 k 2023-01-25T09:50:41.627 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 512 k 2023-01-25T09:50:41.627 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:41.843 INFO:teuthology.orchestra.run.smithi165.stdout:librados-devel-18.0.0-1986.g44e4095d.el8.x86_64 639 kB/s | 139 kB 00:00 2023-01-25T09:50:41.844 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:41.844 INFO:teuthology.orchestra.run.smithi165.stdout:Total 635 kB/s | 139 kB 00:00 2023-01-25T09:50:41.845 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:41.849 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:41.850 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:41.871 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:41.903 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:41.906 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:42.041 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:42.238 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:42.577 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:42.913 INFO:teuthology.orchestra.run.smithi085.stdout:Package libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:43.014 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:43.015 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:43.015 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:43.110 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install libcephfs-devel 2023-01-25T09:50:43.116 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:43.117 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:43.117 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:43.117 INFO:teuthology.orchestra.run.smithi165.stdout: librados-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:50:43.117 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:43.118 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:43.397 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs2 2023-01-25T09:50:43.832 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:44.129 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:21 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:44.967 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:44.968 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:44.968 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T09:50:44.968 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:44.968 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:44.969 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs-devel x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 30 k 2023-01-25T09:50:44.969 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:44.969 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:44.969 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:44.970 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:50:44.970 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:44.970 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 30 k 2023-01-25T09:50:44.970 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 137 k 2023-01-25T09:50:44.970 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:45.131 INFO:teuthology.orchestra.run.smithi085.stdout:libcephfs-devel-18.0.0-1986.g44e4095d.el8.x86_6 188 kB/s | 30 kB 00:00 2023-01-25T09:50:45.132 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:45.132 INFO:teuthology.orchestra.run.smithi085.stdout:Total 186 kB/s | 30 kB 00:00 2023-01-25T09:50:45.132 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:50:45.135 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:50:45.136 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:50:45.157 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:50:45.160 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:50:45.181 INFO:teuthology.orchestra.run.smithi165.stdout:Package libcephfs2-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:45.220 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:50:45.282 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:45.284 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:45.284 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:45.380 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install libcephfs-devel 2023-01-25T09:50:45.412 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:45.687 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:46.106 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:23 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:46.129 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:46.130 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:46.130 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:50:46.130 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:50:46.130 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:46.131 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:46.236 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librados2 2023-01-25T09:50:46.968 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:23 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:47.259 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:47.259 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:47.260 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2023-01-25T09:50:47.260 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:47.260 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:50:47.260 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 30 k 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:47.261 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 30 k 2023-01-25T09:50:47.262 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 137 k 2023-01-25T09:50:47.262 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:50:47.885 INFO:teuthology.orchestra.run.smithi165.stdout:libcephfs-devel-18.0.0-1986.g44e4095d.el8.x86_6 49 kB/s | 30 kB 00:00 2023-01-25T09:50:47.886 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:50:47.886 INFO:teuthology.orchestra.run.smithi165.stdout:Total 49 kB/s | 30 kB 00:00 2023-01-25T09:50:47.887 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:50:47.890 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:50:47.891 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:50:47.916 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:50:47.920 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:50:47.983 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:50:48.010 INFO:teuthology.orchestra.run.smithi085.stdout:Package librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:48.110 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:48.111 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:48.111 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:48.187 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:48.234 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librbd1 2023-01-25T09:50:48.462 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:48.934 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:50:48.934 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:48.934 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:50:48.934 INFO:teuthology.orchestra.run.smithi165.stdout: libcephfs-devel-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:50:48.935 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:50:48.935 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:48.951 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:25 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:49.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librados2 2023-01-25T09:50:49.801 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:49.993 INFO:teuthology.orchestra.run.smithi085.stdout:Package librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:50.094 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:50.096 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:50.096 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:50.189 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rados 2023-01-25T09:50:50.839 INFO:teuthology.orchestra.run.smithi165.stdout:Package librados2-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:50.907 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:27 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:50.940 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:50.941 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:50.941 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:51.038 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install librbd1 2023-01-25T09:50:51.764 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:28 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:51.942 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:52.041 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:52.042 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:52.043 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:52.135 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rgw 2023-01-25T09:50:52.807 INFO:teuthology.orchestra.run.smithi165.stdout:Package librbd1-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:52.852 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:29 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:52.908 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:52.909 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:52.909 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:53.200 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rados 2023-01-25T09:50:53.894 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:53.938 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:53.994 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:53.995 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:53.996 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:54.096 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-cephfs 2023-01-25T09:50:54.812 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:31 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:55.053 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rados-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:55.153 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:55.154 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:55.154 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:55.244 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rgw 2023-01-25T09:50:55.847 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:55.946 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:55.947 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:55.947 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:55.967 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:32 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:56.032 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rbd 2023-01-25T09:50:56.746 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:33 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:57.009 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rgw-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:57.111 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:57.112 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:57.112 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:57.215 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-cephfs 2023-01-25T09:50:57.785 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:57.884 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:57.885 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T09:50:57.886 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:50:57.933 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:57.982 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-fuse 2023-01-25T09:50:58.725 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:35 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:50:58.979 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-cephfs-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:50:59.080 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:50:59.081 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:50:59.081 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:50:59.178 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install python3-rbd 2023-01-25T09:50:59.866 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:50:59.867 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:59.868 INFO:teuthology.orchestra.run.smithi085.stdout: Package Architecture Version Repository Size 2023-01-25T09:50:59.868 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:59.868 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:50:59.869 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-fuse x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 94 k 2023-01-25T09:50:59.869 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:59.869 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:50:59.869 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:50:59.869 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:50:59.870 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:50:59.870 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 94 k 2023-01-25T09:50:59.870 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 280 k 2023-01-25T09:50:59.870 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:50:59.899 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:36 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:00.110 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-fuse-18.0.0-1986.g44e4095d.el8.x86_64.rpm 390 kB/s | 94 kB 00:00 2023-01-25T09:51:00.111 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:00.111 INFO:teuthology.orchestra.run.smithi085.stdout:Total 388 kB/s | 94 kB 00:00 2023-01-25T09:51:00.112 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:51:00.121 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:51:00.122 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:51:00.173 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:51:00.177 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:51:00.291 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:51:00.501 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:00.783 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:00.940 INFO:teuthology.orchestra.run.smithi165.stdout:Package python3-rbd-2:18.0.0-1986.g44e4095d.el8.x86_64 is already installed. 2023-01-25T09:51:01.040 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:51:01.041 INFO:teuthology.orchestra.run.smithi165.stdout:Nothing to do. 2023-01-25T09:51:01.041 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:51:01.157 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-fuse 2023-01-25T09:51:01.521 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:01.522 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:01.522 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:51:01.522 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:01.522 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:01.523 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:51:01.764 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-mirror 2023-01-25T09:51:01.888 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:38 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:02.504 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:39 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:03.028 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:51:03.028 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:03.029 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2023-01-25T09:51:03.029 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:03.029 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:51:03.029 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 94 k 2023-01-25T09:51:03.029 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:03.030 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:51:03.030 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:03.030 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:51:03.030 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:03.030 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 94 k 2023-01-25T09:51:03.031 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 280 k 2023-01-25T09:51:03.031 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:51:03.226 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-fuse-18.0.0-1986.g44e4095d.el8.x86_64.rpm 481 kB/s | 94 kB 00:00 2023-01-25T09:51:03.226 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:03.227 INFO:teuthology.orchestra.run.smithi165.stdout:Total 478 kB/s | 94 kB 00:00 2023-01-25T09:51:03.227 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:51:03.237 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:51:03.237 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:51:03.290 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:51:03.293 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:51:03.411 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:51:03.649 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:51:03.650 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:03.650 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T09:51:03.650 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:03.650 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:51:03.651 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-mirror x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.5 M 2023-01-25T09:51:03.651 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:03.651 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:51:03.651 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:03.651 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:51:03.652 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:03.652 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 3.5 M 2023-01-25T09:51:03.652 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 16 M 2023-01-25T09:51:03.652 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:51:03.659 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:03.961 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:04.147 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-mirror-18.0.0-1986.g44e4095d.el8.x86_64.rpm 6.9 MB/s | 3.5 MB 00:00 2023-01-25T09:51:04.148 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:04.149 INFO:teuthology.orchestra.run.smithi085.stdout:Total 6.9 MB/s | 3.5 MB 00:00 2023-01-25T09:51:04.149 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:51:04.160 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:51:04.161 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:51:04.224 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:51:04.227 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:51:04.462 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:04.462 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:04.462 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:51:04.463 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-fuse-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:04.463 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:04.463 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:51:04.669 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:51:04.753 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-mirror 2023-01-25T09:51:04.896 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:05.338 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:05.499 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:42 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:05.837 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:05.837 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:05.838 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:51:05.838 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:05.838 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:05.838 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:51:06.046 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-nbd 2023-01-25T09:51:06.644 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:51:06.645 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:06.645 INFO:teuthology.orchestra.run.smithi165.stdout: Package Arch Version Repo Size 2023-01-25T09:51:06.645 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:06.646 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:51:06.646 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 3.5 M 2023-01-25T09:51:06.646 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:06.646 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:51:06.647 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:06.647 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:51:06.648 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:06.649 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 3.5 M 2023-01-25T09:51:06.649 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 16 M 2023-01-25T09:51:06.649 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:51:06.773 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:43 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:07.703 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-mirror-18.0.0-1986.g44e4095d.el8.x86_64.rpm 3.3 MB/s | 3.5 MB 00:01 2023-01-25T09:51:07.704 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:07.704 INFO:teuthology.orchestra.run.smithi165.stdout:Total 3.3 MB/s | 3.5 MB 00:01 2023-01-25T09:51:07.705 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:51:07.716 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:51:07.716 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:51:07.780 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:51:07.784 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:51:07.921 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T09:51:07.922 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:07.923 INFO:teuthology.orchestra.run.smithi085.stdout: Package Architecture Version Repository Size 2023-01-25T09:51:07.923 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:07.923 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T09:51:07.923 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-nbd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 180 k 2023-01-25T09:51:07.923 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:07.924 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T09:51:07.924 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T09:51:07.924 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T09:51:07.924 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:07.925 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 180 k 2023-01-25T09:51:07.925 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 568 k 2023-01-25T09:51:07.925 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T09:51:08.117 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-nbd-18.0.0-1986.g44e4095d.el8.x86_64.rpm 928 kB/s | 180 kB 00:00 2023-01-25T09:51:08.118 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:08.118 INFO:teuthology.orchestra.run.smithi085.stdout:Total 922 kB/s | 180 kB 00:00 2023-01-25T09:51:08.118 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T09:51:08.129 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T09:51:08.129 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T09:51:08.180 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T09:51:08.183 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T09:51:08.234 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:51:08.305 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T09:51:08.420 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:08.458 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:08.756 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:08.870 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:09.228 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:09.228 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:09.229 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T09:51:09.229 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:09.229 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:09.230 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T09:51:09.441 DEBUG:teuthology.parallel:result is None 2023-01-25T09:51:09.447 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:09.447 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:09.448 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:51:09.448 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-mirror-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:09.448 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:09.449 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:51:09.698 DEBUG:teuthology.orchestra.run.smithi165:> sudo yum -y install rbd-nbd 2023-01-25T09:51:10.430 INFO:teuthology.orchestra.run.smithi165.stdout:Last metadata expiration check: 0:02:47 ago on Wed 25 Jan 2023 09:48:23 AM UTC. 2023-01-25T09:51:11.567 INFO:teuthology.orchestra.run.smithi165.stdout:Dependencies resolved. 2023-01-25T09:51:11.568 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:11.568 INFO:teuthology.orchestra.run.smithi165.stdout: Package Architecture Version Repository Size 2023-01-25T09:51:11.568 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:11.569 INFO:teuthology.orchestra.run.smithi165.stdout:Installing: 2023-01-25T09:51:11.569 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd x86_64 2:18.0.0-1986.g44e4095d.el8 ceph 180 k 2023-01-25T09:51:11.569 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:11.569 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction Summary 2023-01-25T09:51:11.569 INFO:teuthology.orchestra.run.smithi165.stdout:================================================================================ 2023-01-25T09:51:11.570 INFO:teuthology.orchestra.run.smithi165.stdout:Install 1 Package 2023-01-25T09:51:11.570 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:11.570 INFO:teuthology.orchestra.run.smithi165.stdout:Total download size: 180 k 2023-01-25T09:51:11.570 INFO:teuthology.orchestra.run.smithi165.stdout:Installed size: 568 k 2023-01-25T09:51:11.570 INFO:teuthology.orchestra.run.smithi165.stdout:Downloading Packages: 2023-01-25T09:51:11.764 INFO:teuthology.orchestra.run.smithi165.stdout:rbd-nbd-18.0.0-1986.g44e4095d.el8.x86_64.rpm 918 kB/s | 180 kB 00:00 2023-01-25T09:51:11.765 INFO:teuthology.orchestra.run.smithi165.stdout:-------------------------------------------------------------------------------- 2023-01-25T09:51:11.765 INFO:teuthology.orchestra.run.smithi165.stdout:Total 912 kB/s | 180 kB 00:00 2023-01-25T09:51:11.766 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction check 2023-01-25T09:51:11.777 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction check succeeded. 2023-01-25T09:51:11.777 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction test 2023-01-25T09:51:11.828 INFO:teuthology.orchestra.run.smithi165.stdout:Transaction test succeeded. 2023-01-25T09:51:11.832 INFO:teuthology.orchestra.run.smithi165.stdout:Running transaction 2023-01-25T09:51:11.950 INFO:teuthology.orchestra.run.smithi165.stdout: Preparing : 1/1 2023-01-25T09:51:12.133 INFO:teuthology.orchestra.run.smithi165.stdout: Installing : rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:12.435 INFO:teuthology.orchestra.run.smithi165.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:12.927 INFO:teuthology.orchestra.run.smithi165.stdout: Verifying : rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 1/1 2023-01-25T09:51:12.927 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:12.927 INFO:teuthology.orchestra.run.smithi165.stdout:Installed: 2023-01-25T09:51:12.928 INFO:teuthology.orchestra.run.smithi165.stdout: rbd-nbd-2:18.0.0-1986.g44e4095d.el8.x86_64 2023-01-25T09:51:12.928 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:12.928 INFO:teuthology.orchestra.run.smithi165.stdout:Complete! 2023-01-25T09:51:13.132 DEBUG:teuthology.parallel:result is None 2023-01-25T09:51:13.132 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T09:51:13.173 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T09:51:13.174 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:51:13.175 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:51:13.333 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T09:51:13.357 INFO:teuthology.orchestra.run.smithi085.stdout:18.0.0-1986.g44e4095d.el8 2023-01-25T09:51:13.357 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986.g44e4095d.el8 2023-01-25T09:51:13.358 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986.g44e4095d is installed. 2023-01-25T09:51:13.358 DEBUG:teuthology.orchestra.run.smithi165:> sudo lsb_release -is 2023-01-25T09:51:13.396 INFO:teuthology.orchestra.run.smithi165.stdout:CentOSStream 2023-01-25T09:51:13.398 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T09:51:13.398 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44e4095da12a8269eb6cfe163cbb0d00b1a6412c 2023-01-25T09:51:13.553 DEBUG:teuthology.orchestra.run.smithi165:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T09:51:13.575 INFO:teuthology.orchestra.run.smithi165.stdout:18.0.0-1986.g44e4095d.el8 2023-01-25T09:51:13.575 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1986.g44e4095d.el8 2023-01-25T09:51:13.576 INFO:teuthology.task.install:The correct ceph version 18.0.0-1986.g44e4095d is installed. 2023-01-25T09:51:13.577 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T09:51:13.577 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:13.578 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:51:13.609 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:13.609 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T09:51:13.643 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T09:51:13.643 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:13.644 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:51:13.678 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:51:13.746 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:13.746 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T09:51:13.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T09:51:13.841 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T09:51:13.841 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:13.842 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:51:13.870 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:51:13.938 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:13.939 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T09:51:13.966 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T09:51:14.033 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T09:51:14.100 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T09:51:14.100 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 777 /var/log/ceph 2023-01-25T09:51:14.103 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 777 /var/log/ceph 2023-01-25T09:51:14.129 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T09:51:14.130 DEBUG:teuthology.orchestra.run.smithi085:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:51:14.171 DEBUG:teuthology.orchestra.run.smithi165:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T09:51:14.198 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T09:51:14.198 DEBUG:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:51:14.239 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T09:51:14.283 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T09:51:14.284 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T09:51:14.284 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi/7137198', 'branch': 'wip-yuri6-testing-2023-01-24-0746', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7137198', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:27:30-rados-wip-yuri6-testing-2023-01-24-0746-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-01-24-0746'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2023-01-24-0746', 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri6-testing-2023-01-24-0746', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_44e4095da12a8269eb6cfe163cbb0d00b1a6412c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'targets': {'smithi085.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5VdgV4UpoIWV/yQs3TM3IUO21oySyHh/8SGyoQcBYT1lFkqK+GMf2XpBphGaieP2Rrc1qK0F4Jo3gpaSf+4QymvI4g6ne9kb3tq4qG2wsKDxvqzbs7Dg448M/o5Y3qLzDLwdAXXxEawYV4UloR1rOvw0yMIz0lZtBhzjnmCySaxzUBtiUWFMi+3z464+6uDV++36ve2hvraDDHMtW1ClRiMfkw4Zc92y4c3KI41zrFAuvfBaa0aKTnqjHENN1bbV+XT9zrMZlYTU4g6JHEBus8Y/UmhGJ20kE03vytNxNpBrEj7DlXMqAYqeS41HtNCfQOFgz9GfUDj5lkjysbvgYgPlT1MmpRVKhre4y4/tYtYKiTKXkXq4AXooaetF85fyfnSAlKBdgQ1tJUMW9AM3UXVlAgxzKH0xGt4gmgjTfT/Bw+TnRuvfHwR0bwGIrWoWZK858oKqS4aUntPT5i4DpMStrltsl0kKdBI9Lu39AEc/QO4FejLfoVuT1HJc7gy8=', 'smithi165.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBtNoOxD66iMY1Uz3dfwMA8itEM4UGTF1rlYG0ksqompS6NfJDde/Q02NNxUOX8F6/oNhvwEfQMdCB/j/lHvzUi9zOPn551I9TRTBBwfH5NJEFeIyM2sAkHGe7e5A773iUfy5pmnSr/iSflcL9AHDbKtxcNgEDembDS+4Odt5/UzOkRhrPtnEyJayLP2kVjlPwUEZLn8146M+KMDLc6XmeFMibuHUNEBpzfHAhYnrDoF3KMiNhBKQsZ1dntrKwJE7SOJQSP8nLQ87arlIuO6r+HcocsvBm3j5+RQX1acZHp8fadGoBcuUC2HE4exvoP5y9vMUGOrlDXuuW2tUIniSSSPW/LbKq7Vp8xyWJGy6SAV8YyfpNqcZzHBWFMIpGn1D9idgyBD30tU40we5QARI/6DnWmitHGL8jhL98doOLpmj+tRAOR+Qa+2n2uyR9f9T+d42Vp+GJFHXnmOENPlhGQAoSWyXEgpmcFkqbNbELzPd4v8KngXESSwvzfQ9ydrE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '44e4095da12a8269eb6cfe163cbb0d00b1a6412c', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache min_read_recency_for_promote 0', 'sudo ceph osd pool set cache min_write_recency_for_promote 0']}}, {'rados': {'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:27:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T09:51:14.285 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:51:14.307 DEBUG:teuthology.orchestra.run.smithi165:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T09:51:14.327 DEBUG:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:51:14.367 DEBUG:teuthology.orchestra.run.smithi165:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T09:51:14.394 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:14.395 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:51:14.450 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:51:14.451 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_1 2023-01-25T09:51:14.508 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:51:14.508 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:14.508 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 370135 Links: 1 2023-01-25T09:51:14.509 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:14.509 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:14.509 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 09:51:05.072517801 +0000 2023-01-25T09:51:14.509 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 09:47:36.199892045 +0000 2023-01-25T09:51:14.510 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 09:47:36.199892045 +0000 2023-01-25T09:51:14.510 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T09:51:14.510 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:51:14.574 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T09:51:14.574 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T09:51:14.574 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000216361 s, 2.4 MB/s 2023-01-25T09:51:14.575 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:51:14.635 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_2 2023-01-25T09:51:14.693 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:51:14.693 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:14.693 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 375922 Links: 1 2023-01-25T09:51:14.694 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:14.694 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:14.694 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 09:51:05.072517801 +0000 2023-01-25T09:51:14.694 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 09:47:36.713882956 +0000 2023-01-25T09:51:14.694 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 09:47:36.713882956 +0000 2023-01-25T09:51:14.695 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T09:51:14.695 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:51:14.759 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T09:51:14.759 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T09:51:14.759 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000234571 s, 2.2 MB/s 2023-01-25T09:51:14.760 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:51:14.819 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_3 2023-01-25T09:51:14.878 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:51:14.878 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:14.878 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 369647 Links: 1 2023-01-25T09:51:14.878 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:14.879 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:14.879 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 09:51:05.072517801 +0000 2023-01-25T09:51:14.879 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 09:47:37.226873884 +0000 2023-01-25T09:51:14.879 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 09:47:37.226873884 +0000 2023-01-25T09:51:14.880 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T09:51:14.880 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:51:14.943 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T09:51:14.943 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T09:51:14.944 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000231526 s, 2.2 MB/s 2023-01-25T09:51:14.945 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:51:15.003 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_4 2023-01-25T09:51:15.062 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:51:15.062 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:15.062 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 377009 Links: 1 2023-01-25T09:51:15.063 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:15.063 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:15.063 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 09:51:05.072517801 +0000 2023-01-25T09:51:15.063 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 09:47:37.757864494 +0000 2023-01-25T09:51:15.063 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 09:47:37.757864494 +0000 2023-01-25T09:51:15.064 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T09:51:15.064 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:51:15.127 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T09:51:15.128 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T09:51:15.128 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000214401 s, 2.4 MB/s 2023-01-25T09:51:15.129 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:51:15.188 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:15.189 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:15.189 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T09:51:15.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T09:51:15.209 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_1 2023-01-25T09:51:15.268 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T09:51:15.268 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:15.268 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 371130 Links: 1 2023-01-25T09:51:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2023-01-25 09:51:08.602898452 +0000 2023-01-25T09:51:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2023-01-25 09:47:36.559291508 +0000 2023-01-25T09:51:15.269 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2023-01-25 09:47:36.559291508 +0000 2023-01-25T09:51:15.270 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2023-01-25T09:51:15.270 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T09:51:15.335 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2023-01-25T09:51:15.335 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2023-01-25T09:51:15.335 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000201627 s, 2.5 MB/s 2023-01-25T09:51:15.336 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T09:51:15.397 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_2 2023-01-25T09:51:15.455 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T09:51:15.456 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:15.456 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 371196 Links: 1 2023-01-25T09:51:15.456 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:15.457 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:15.457 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2023-01-25 09:51:08.602898452 +0000 2023-01-25T09:51:15.457 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2023-01-25 09:47:37.064283073 +0000 2023-01-25T09:51:15.457 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2023-01-25 09:47:37.064283073 +0000 2023-01-25T09:51:15.457 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2023-01-25T09:51:15.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T09:51:15.525 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2023-01-25T09:51:15.525 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2023-01-25T09:51:15.526 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000232077 s, 2.2 MB/s 2023-01-25T09:51:15.526 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T09:51:15.584 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_3 2023-01-25T09:51:15.642 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T09:51:15.642 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:15.642 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 373700 Links: 1 2023-01-25T09:51:15.642 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:15.643 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:15.643 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2023-01-25 09:51:08.602898452 +0000 2023-01-25T09:51:15.643 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2023-01-25 09:47:37.572274588 +0000 2023-01-25T09:51:15.643 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2023-01-25 09:47:37.572274588 +0000 2023-01-25T09:51:15.643 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2023-01-25T09:51:15.644 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T09:51:15.709 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2023-01-25T09:51:15.710 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2023-01-25T09:51:15.710 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.000217937 s, 2.3 MB/s 2023-01-25T09:51:15.711 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T09:51:15.770 DEBUG:teuthology.orchestra.run.smithi165:> stat /dev/vg_nvme/lv_4 2023-01-25T09:51:15.827 INFO:teuthology.orchestra.run.smithi165.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T09:51:15.828 INFO:teuthology.orchestra.run.smithi165.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T09:51:15.828 INFO:teuthology.orchestra.run.smithi165.stdout:Device: 6h/6d Inode: 367333 Links: 1 2023-01-25T09:51:15.828 INFO:teuthology.orchestra.run.smithi165.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T09:51:15.828 INFO:teuthology.orchestra.run.smithi165.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T09:51:15.829 INFO:teuthology.orchestra.run.smithi165.stdout:Access: 2023-01-25 09:51:08.602898452 +0000 2023-01-25T09:51:15.829 INFO:teuthology.orchestra.run.smithi165.stdout:Modify: 2023-01-25 09:47:38.071266253 +0000 2023-01-25T09:51:15.829 INFO:teuthology.orchestra.run.smithi165.stdout:Change: 2023-01-25 09:47:38.071266253 +0000 2023-01-25T09:51:15.829 INFO:teuthology.orchestra.run.smithi165.stdout: Birth: - 2023-01-25T09:51:15.830 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T09:51:15.894 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records in 2023-01-25T09:51:15.894 INFO:teuthology.orchestra.run.smithi165.stderr:1+0 records out 2023-01-25T09:51:15.894 INFO:teuthology.orchestra.run.smithi165.stderr:512 bytes copied, 0.00018797 s, 2.7 MB/s 2023-01-25T09:51:15.895 DEBUG:teuthology.orchestra.run.smithi165:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T09:51:15.954 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:15.955 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi085.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:51:15.955 INFO:tasks.ceph:Generating config... 2023-01-25T09:51:15.956 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T09:51:15.957 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-25T09:51:15.957 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-25T09:51:15.957 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-01-25T09:51:15.958 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T09:51:15.958 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T09:51:15.958 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T09:51:15.958 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T09:51:15.959 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T09:51:15.959 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T09:51:15.959 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T09:51:15.959 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T09:51:15.960 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T09:51:15.960 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T09:51:15.960 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T09:51:15.961 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-25T09:51:15.961 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T09:51:15.961 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T09:51:15.961 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T09:51:15.962 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T09:51:15.962 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2023-01-25T09:51:15.962 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2023-01-25T09:51:15.962 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T09:51:15.963 INFO:tasks.ceph:[osd] osd max scrubs = 2 2023-01-25T09:51:15.963 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T09:51:15.963 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T09:51:15.964 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T09:51:15.964 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T09:51:15.964 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T09:51:15.964 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T09:51:15.965 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T09:51:15.965 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T09:51:15.965 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-25T09:51:15.965 INFO:tasks.ceph:[global] ms bind msgr1 = False 2023-01-25T09:51:15.965 INFO:tasks.ceph:[global] ms bind msgr2 = True 2023-01-25T09:51:15.966 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-01-25T09:51:15.966 INFO:tasks.ceph:[global] ms type = async 2023-01-25T09:51:15.966 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2023-01-25T09:51:15.966 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T09:51:15.967 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2023-01-25T09:51:15.967 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T09:51:15.967 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T09:51:15.967 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T09:51:15.968 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T09:51:15.968 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T09:51:15.968 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T09:51:15.969 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T09:51:15.969 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T09:51:16.032 INFO:teuthology.orchestra.run.smithi085.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T09:51:16.034 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T09:51:16.081 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:51:16.108 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.85'), ('mon.c', '[v2:172.21.15.85:3301,v1:172.21.15.85:6790]'), ('mon.b', '172.21.15.165')] 2023-01-25T09:51:16.109 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.165', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd max scrubs': 2, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T09:51:16.110 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:16.110 DEBUG:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:51:16.166 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.85 --addv c '[v2:172.21.15.85:3301,v1:172.21.15.85:6790]' --add b 172.21.15.165 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:16.256 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:16.256 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: generated fsid c987774b-2f2f-4b1a-8f5c-26157f155976 2023-01-25T09:51:16.257 INFO:teuthology.orchestra.run.smithi085.stdout:setting min_mon_release = pacific 2023-01-25T09:51:16.257 INFO:teuthology.orchestra.run.smithi085.stdout:epoch 0 2023-01-25T09:51:16.257 INFO:teuthology.orchestra.run.smithi085.stdout:fsid c987774b-2f2f-4b1a-8f5c-26157f155976 2023-01-25T09:51:16.257 INFO:teuthology.orchestra.run.smithi085.stdout:last_changed 2023-01-25T09:51:16.252078+0000 2023-01-25T09:51:16.257 INFO:teuthology.orchestra.run.smithi085.stdout:created 2023-01-25T09:51:16.252078+0000 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:min_mon_release 16 (pacific) 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:election_strategy: 1 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:0: [v2:172.21.15.85:3300/0,v1:172.21.15.85:6789/0] mon.a 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:1: [v2:172.21.15.165:3300/0,v1:172.21.15.165:6789/0] mon.b 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:2: [v2:172.21.15.85:3301/0,v1:172.21.15.85:6790/0] mon.c 2023-01-25T09:51:16.258 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T09:51:16.260 DEBUG:teuthology.orchestra.run.smithi085:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T09:51:16.278 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c987774b-2f2f-4b1a-8f5c-26157f155976... 2023-01-25T09:51:16.279 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:51:16.320 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T09:51:16.363 INFO:teuthology.orchestra.run.smithi085.stdout:[global] 2023-01-25T09:51:16.363 INFO:teuthology.orchestra.run.smithi085.stdout: chdir = "" 2023-01-25T09:51:16.364 INFO:teuthology.orchestra.run.smithi085.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:51:16.364 INFO:teuthology.orchestra.run.smithi085.stdout: auth supported = cephx 2023-01-25T09:51:16.364 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.364 INFO:teuthology.orchestra.run.smithi085.stdout: filestore xattr use omap = true 2023-01-25T09:51:16.365 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.365 INFO:teuthology.orchestra.run.smithi085.stdout: mon clock drift allowed = 1.000 2023-01-25T09:51:16.365 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.365 INFO:teuthology.orchestra.run.smithi085.stdout: osd crush chooseleaf type = 0 2023-01-25T09:51:16.365 INFO:teuthology.orchestra.run.smithi085.stdout: auth debug = true 2023-01-25T09:51:16.366 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.366 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on old message = true 2023-01-25T09:51:16.366 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on bug = true 2023-01-25T09:51:16.366 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.366 INFO:teuthology.orchestra.run.smithi085.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:51:16.367 INFO:teuthology.orchestra.run.smithi085.stdout: mon pg warn max object skew = 0 2023-01-25T09:51:16.367 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.367 INFO:teuthology.orchestra.run.smithi085.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:51:16.367 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:51:16.367 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.368 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default size = 2 2023-01-25T09:51:16.368 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.368 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow primary affinity = true 2023-01-25T09:51:16.368 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow pg remap = true 2023-01-25T09:51:16.369 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:51:16.369 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:51:16.369 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on no sortbitwise = false 2023-01-25T09:51:16.369 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:51:16.369 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on too few osds = false 2023-01-25T09:51:16.370 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:51:16.370 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:51:16.370 INFO:teuthology.orchestra.run.smithi085.stdout: mon_allow_pool_size_one = true 2023-01-25T09:51:16.370 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.370 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: osd default data pool replay window = 5 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: mon allow pool delete = true 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.371 INFO:teuthology.orchestra.run.smithi085.stdout: mon cluster log file level = debug 2023-01-25T09:51:16.372 INFO:teuthology.orchestra.run.smithi085.stdout: debug asserts on shutdown = true 2023-01-25T09:51:16.372 INFO:teuthology.orchestra.run.smithi085.stdout: mon health detail to clog = false 2023-01-25T09:51:16.372 INFO:teuthology.orchestra.run.smithi085.stdout: mon host = "172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.165" 2023-01-25T09:51:16.372 INFO:teuthology.orchestra.run.smithi085.stdout: mon client directed command retry = 5 2023-01-25T09:51:16.373 INFO:teuthology.orchestra.run.smithi085.stdout: mon election default strategy = 1 2023-01-25T09:51:16.373 INFO:teuthology.orchestra.run.smithi085.stdout: ms bind msgr1 = False 2023-01-25T09:51:16.373 INFO:teuthology.orchestra.run.smithi085.stdout: ms bind msgr2 = True 2023-01-25T09:51:16.373 INFO:teuthology.orchestra.run.smithi085.stdout: ms inject socket failures = 5000 2023-01-25T09:51:16.373 INFO:teuthology.orchestra.run.smithi085.stdout: ms type = async 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_min_size = 2 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_size = 2 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout: fsid = c987774b-2f2f-4b1a-8f5c-26157f155976 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.374 INFO:teuthology.orchestra.run.smithi085.stdout:[osd] 2023-01-25T09:51:16.375 INFO:teuthology.orchestra.run.smithi085.stdout: osd journal size = 100 2023-01-25T09:51:16.375 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.375 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub load threshold = 5.0 2023-01-25T09:51:16.375 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub max interval = 600 2023-01-25T09:51:16.376 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.376 INFO:teuthology.orchestra.run.smithi085.stdout: osd recover clone overlap = true 2023-01-25T09:51:16.376 INFO:teuthology.orchestra.run.smithi085.stdout: osd recovery max chunk = 1048576 2023-01-25T09:51:16.376 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.376 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug shutdown = true 2023-01-25T09:51:16.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug op order = true 2023-01-25T09:51:16.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify stray on activate = true 2023-01-25T09:51:16.377 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd open classes on start = true 2023-01-25T09:51:16.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug pg log writeout = true 2023-01-25T09:51:16.378 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:51:16.378 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd map max advance = 10 2023-01-25T09:51:16.378 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.379 INFO:teuthology.orchestra.run.smithi085.stdout: journal zero on create = true 2023-01-25T09:51:16.379 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.379 INFO:teuthology.orchestra.run.smithi085.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:51:16.379 INFO:teuthology.orchestra.run.smithi085.stdout: filestore apply finisher threads = 3 2023-01-25T09:51:16.379 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.380 INFO:teuthology.orchestra.run.smithi085.stdout: bdev debug aio = true 2023-01-25T09:51:16.380 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug misdirected ops = true 2023-01-25T09:51:16.380 INFO:teuthology.orchestra.run.smithi085.stdout: debug monc = 20 2023-01-25T09:51:16.380 INFO:teuthology.orchestra.run.smithi085.stdout: bdev async discard = True 2023-01-25T09:51:16.380 INFO:teuthology.orchestra.run.smithi085.stdout: bdev enable discard = True 2023-01-25T09:51:16.381 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore allocator = bitmap 2023-01-25T09:51:16.381 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore block size = 96636764160 2023-01-25T09:51:16.381 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore fsck on mount = True 2023-01-25T09:51:16.381 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore zero block detection = True 2023-01-25T09:51:16.382 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluefs = 20 2023-01-25T09:51:16.382 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluestore = 20 2023-01-25T09:51:16.382 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T09:51:16.382 INFO:teuthology.orchestra.run.smithi085.stdout: debug osd = 20 2023-01-25T09:51:16.382 INFO:teuthology.orchestra.run.smithi085.stdout: debug rocksdb = 10 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd full ratio = 0.9 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: osd backoff on peering = True 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:51:16.383 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify cached snaps = True 2023-01-25T09:51:16.384 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify missing on start = True 2023-01-25T09:51:16.384 INFO:teuthology.orchestra.run.smithi085.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:51:16.384 INFO:teuthology.orchestra.run.smithi085.stdout: osd heartbeat use min delay socket = True 2023-01-25T09:51:16.384 INFO:teuthology.orchestra.run.smithi085.stdout: osd inject bad map crc probability = 0.1 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd max markdown count = 1000 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd max scrubs = 2 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd mclock override recovery settings = True 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd objectstore = bluestore 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd op queue = debug_random 2023-01-25T09:51:16.385 INFO:teuthology.orchestra.run.smithi085.stdout: osd op queue cut off = debug_random 2023-01-25T09:51:16.386 INFO:teuthology.orchestra.run.smithi085.stdout: osd shutdown pgref assert = True 2023-01-25T09:51:16.386 INFO:teuthology.orchestra.run.smithi085.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:51:16.386 INFO:teuthology.orchestra.run.smithi085.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:51:16.386 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.386 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr] 2023-01-25T09:51:16.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T09:51:16.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug mgr = 20 2023-01-25T09:51:16.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2023-01-25T09:51:16.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2023-01-25T09:51:16.387 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:51:16.388 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:51:16.388 INFO:teuthology.orchestra.run.smithi085.stdout: mgr/telemetry/nag = false 2023-01-25T09:51:16.388 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mon] 2023-01-25T09:51:16.388 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T09:51:16.389 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2023-01-25T09:51:16.389 INFO:teuthology.orchestra.run.smithi085.stdout: debug paxos = 20 2023-01-25T09:51:16.389 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2023-01-25T09:51:16.389 INFO:teuthology.orchestra.run.smithi085.stdout: mon data avail warn = 5 2023-01-25T09:51:16.389 INFO:teuthology.orchestra.run.smithi085.stdout: mon mgr mkfs grace = 240 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd reporter subtree level = osd 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd prime pg temp = true 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.390 INFO:teuthology.orchestra.run.smithi085.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:51:16.391 INFO:teuthology.orchestra.run.smithi085.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:51:16.391 INFO:teuthology.orchestra.run.smithi085.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:51:16.391 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.391 INFO:teuthology.orchestra.run.smithi085.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:51:16.391 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:51:16.392 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:51:16.392 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.392 INFO:teuthology.orchestra.run.smithi085.stdout: # 1m isn't quite enough 2023-01-25T09:51:16.392 INFO:teuthology.orchestra.run.smithi085.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:51:16.392 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.393 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:51:16.393 INFO:teuthology.orchestra.run.smithi085.stdout: mon scrub interval = 300 2023-01-25T09:51:16.393 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:16.394 INFO:teuthology.orchestra.run.smithi085.stdout:[client] 2023-01-25T09:51:16.394 INFO:teuthology.orchestra.run.smithi085.stdout: rgw cache enabled = true 2023-01-25T09:51:16.394 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable ops log = true 2023-01-25T09:51:16.394 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable usage log = true 2023-01-25T09:51:16.394 INFO:teuthology.orchestra.run.smithi085.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:51:16.395 INFO:teuthology.orchestra.run.smithi085.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:51:16.395 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.a] 2023-01-25T09:51:16.395 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.c] 2023-01-25T09:51:16.395 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.b] 2023-01-25T09:51:16.397 INFO:teuthology.orchestra.run.smithi165.stdout:[global] 2023-01-25T09:51:16.397 INFO:teuthology.orchestra.run.smithi165.stdout: chdir = "" 2023-01-25T09:51:16.397 INFO:teuthology.orchestra.run.smithi165.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T09:51:16.397 INFO:teuthology.orchestra.run.smithi165.stdout: auth supported = cephx 2023-01-25T09:51:16.398 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.398 INFO:teuthology.orchestra.run.smithi165.stdout: filestore xattr use omap = true 2023-01-25T09:51:16.398 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.398 INFO:teuthology.orchestra.run.smithi165.stdout: mon clock drift allowed = 1.000 2023-01-25T09:51:16.399 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.399 INFO:teuthology.orchestra.run.smithi165.stdout: osd crush chooseleaf type = 0 2023-01-25T09:51:16.399 INFO:teuthology.orchestra.run.smithi165.stdout: auth debug = true 2023-01-25T09:51:16.399 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.399 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on old message = true 2023-01-25T09:51:16.400 INFO:teuthology.orchestra.run.smithi165.stdout: ms die on bug = true 2023-01-25T09:51:16.400 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.400 INFO:teuthology.orchestra.run.smithi165.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T09:51:16.400 INFO:teuthology.orchestra.run.smithi165.stdout: mon pg warn max object skew = 0 2023-01-25T09:51:16.400 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.401 INFO:teuthology.orchestra.run.smithi165.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T09:51:16.401 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T09:51:16.401 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.401 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default size = 2 2023-01-25T09:51:16.401 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.402 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow primary affinity = true 2023-01-25T09:51:16.402 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd allow pg remap = true 2023-01-25T09:51:16.402 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on legacy crush tunables = false 2023-01-25T09:51:16.402 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on crush straw calc version zero = false 2023-01-25T09:51:16.402 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on no sortbitwise = false 2023-01-25T09:51:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on osd down out interval zero = false 2023-01-25T09:51:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: mon warn on too few osds = false 2023-01-25T09:51:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T09:51:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T09:51:16.403 INFO:teuthology.orchestra.run.smithi165.stdout: mon_allow_pool_size_one = true 2023-01-25T09:51:16.404 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.404 INFO:teuthology.orchestra.run.smithi165.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T09:51:16.404 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.404 INFO:teuthology.orchestra.run.smithi165.stdout: osd default data pool replay window = 5 2023-01-25T09:51:16.404 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.405 INFO:teuthology.orchestra.run.smithi165.stdout: mon allow pool delete = true 2023-01-25T09:51:16.405 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.405 INFO:teuthology.orchestra.run.smithi165.stdout: mon cluster log file level = debug 2023-01-25T09:51:16.405 INFO:teuthology.orchestra.run.smithi165.stdout: debug asserts on shutdown = true 2023-01-25T09:51:16.405 INFO:teuthology.orchestra.run.smithi165.stdout: mon health detail to clog = false 2023-01-25T09:51:16.406 INFO:teuthology.orchestra.run.smithi165.stdout: mon host = "172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.165" 2023-01-25T09:51:16.406 INFO:teuthology.orchestra.run.smithi165.stdout: mon client directed command retry = 5 2023-01-25T09:51:16.406 INFO:teuthology.orchestra.run.smithi165.stdout: mon election default strategy = 1 2023-01-25T09:51:16.406 INFO:teuthology.orchestra.run.smithi165.stdout: ms bind msgr1 = False 2023-01-25T09:51:16.406 INFO:teuthology.orchestra.run.smithi165.stdout: ms bind msgr2 = True 2023-01-25T09:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: ms inject socket failures = 5000 2023-01-25T09:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: ms type = async 2023-01-25T09:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T09:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_min_size = 2 2023-01-25T09:51:16.407 INFO:teuthology.orchestra.run.smithi165.stdout: osd_pool_default_size = 2 2023-01-25T09:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout: fsid = c987774b-2f2f-4b1a-8f5c-26157f155976 2023-01-25T09:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout:[osd] 2023-01-25T09:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout: osd journal size = 100 2023-01-25T09:51:16.408 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.409 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub load threshold = 5.0 2023-01-25T09:51:16.409 INFO:teuthology.orchestra.run.smithi165.stdout: osd scrub max interval = 600 2023-01-25T09:51:16.409 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.409 INFO:teuthology.orchestra.run.smithi165.stdout: osd recover clone overlap = true 2023-01-25T09:51:16.409 INFO:teuthology.orchestra.run.smithi165.stdout: osd recovery max chunk = 1048576 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug shutdown = true 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug op order = true 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify stray on activate = true 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.410 INFO:teuthology.orchestra.run.smithi165.stdout: osd open classes on start = true 2023-01-25T09:51:16.411 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug pg log writeout = true 2023-01-25T09:51:16.411 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.411 INFO:teuthology.orchestra.run.smithi165.stdout: osd deep scrub update digest min age = 30 2023-01-25T09:51:16.411 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.411 INFO:teuthology.orchestra.run.smithi165.stdout: osd map max advance = 10 2023-01-25T09:51:16.412 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.412 INFO:teuthology.orchestra.run.smithi165.stdout: journal zero on create = true 2023-01-25T09:51:16.412 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.412 INFO:teuthology.orchestra.run.smithi165.stdout: filestore ondisk finisher threads = 3 2023-01-25T09:51:16.412 INFO:teuthology.orchestra.run.smithi165.stdout: filestore apply finisher threads = 3 2023-01-25T09:51:16.413 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.413 INFO:teuthology.orchestra.run.smithi165.stdout: bdev debug aio = true 2023-01-25T09:51:16.413 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug misdirected ops = true 2023-01-25T09:51:16.413 INFO:teuthology.orchestra.run.smithi165.stdout: debug monc = 20 2023-01-25T09:51:16.413 INFO:teuthology.orchestra.run.smithi165.stdout: bdev async discard = True 2023-01-25T09:51:16.414 INFO:teuthology.orchestra.run.smithi165.stdout: bdev enable discard = True 2023-01-25T09:51:16.414 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore allocator = bitmap 2023-01-25T09:51:16.414 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore block size = 96636764160 2023-01-25T09:51:16.414 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore fsck on mount = True 2023-01-25T09:51:16.414 INFO:teuthology.orchestra.run.smithi165.stdout: bluestore zero block detection = True 2023-01-25T09:51:16.415 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluefs = 20 2023-01-25T09:51:16.415 INFO:teuthology.orchestra.run.smithi165.stdout: debug bluestore = 20 2023-01-25T09:51:16.415 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2023-01-25T09:51:16.415 INFO:teuthology.orchestra.run.smithi165.stdout: debug osd = 20 2023-01-25T09:51:16.415 INFO:teuthology.orchestra.run.smithi165.stdout: debug rocksdb = 10 2023-01-25T09:51:16.416 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T09:51:16.416 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd full ratio = 0.9 2023-01-25T09:51:16.416 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd nearfull ratio = 0.8 2023-01-25T09:51:16.416 INFO:teuthology.orchestra.run.smithi165.stdout: osd backoff on peering = True 2023-01-25T09:51:16.416 INFO:teuthology.orchestra.run.smithi165.stdout: osd blocked scrub grace period = 3600 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify cached snaps = True 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd debug verify missing on start = True 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd failsafe full ratio = 0.95 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd heartbeat use min delay socket = True 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd inject bad map crc probability = 0.1 2023-01-25T09:51:16.417 INFO:teuthology.orchestra.run.smithi165.stdout: osd max markdown count = 1000 2023-01-25T09:51:16.418 INFO:teuthology.orchestra.run.smithi165.stdout: osd max scrubs = 2 2023-01-25T09:51:16.418 INFO:teuthology.orchestra.run.smithi165.stdout: osd mclock override recovery settings = True 2023-01-25T09:51:16.418 INFO:teuthology.orchestra.run.smithi165.stdout: osd objectstore = bluestore 2023-01-25T09:51:16.418 INFO:teuthology.orchestra.run.smithi165.stdout: osd op queue = debug_random 2023-01-25T09:51:16.418 INFO:teuthology.orchestra.run.smithi165.stdout: osd op queue cut off = debug_random 2023-01-25T09:51:16.419 INFO:teuthology.orchestra.run.smithi165.stdout: osd shutdown pgref assert = True 2023-01-25T09:51:16.419 INFO:teuthology.orchestra.run.smithi165.stdout: osd_max_pg_log_entries = 3000 2023-01-25T09:51:16.419 INFO:teuthology.orchestra.run.smithi165.stdout: osd_min_pg_log_entries = 3000 2023-01-25T09:51:16.419 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.419 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr] 2023-01-25T09:51:16.420 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2023-01-25T09:51:16.420 INFO:teuthology.orchestra.run.smithi165.stdout: debug mgr = 20 2023-01-25T09:51:16.420 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2023-01-25T09:51:16.420 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2023-01-25T09:51:16.420 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:51:16.421 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:51:16.421 INFO:teuthology.orchestra.run.smithi165.stdout: mgr/telemetry/nag = false 2023-01-25T09:51:16.421 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.421 INFO:teuthology.orchestra.run.smithi165.stdout:[mon] 2023-01-25T09:51:16.421 INFO:teuthology.orchestra.run.smithi165.stdout: debug ms = 1 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: debug mon = 20 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: debug paxos = 20 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: debug auth = 20 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: mon data avail warn = 5 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: mon mgr mkfs grace = 240 2023-01-25T09:51:16.422 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min pgs per osd = 4 2023-01-25T09:51:16.423 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd reporter subtree level = osd 2023-01-25T09:51:16.423 INFO:teuthology.orchestra.run.smithi165.stdout: mon osd prime pg temp = true 2023-01-25T09:51:16.423 INFO:teuthology.orchestra.run.smithi165.stdout: mon reweight min bytes per osd = 10 2023-01-25T09:51:16.423 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.423 INFO:teuthology.orchestra.run.smithi165.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T09:51:16.424 INFO:teuthology.orchestra.run.smithi165.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T09:51:16.424 INFO:teuthology.orchestra.run.smithi165.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T09:51:16.424 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.424 INFO:teuthology.orchestra.run.smithi165.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: # 1m isn't quite enough 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: mon_down_mkfs_grace = 2m 2023-01-25T09:51:16.425 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.426 INFO:teuthology.orchestra.run.smithi165.stdout: mon_warn_on_filestore_osds = false 2023-01-25T09:51:16.426 INFO:teuthology.orchestra.run.smithi165.stdout: mon scrub interval = 300 2023-01-25T09:51:16.426 INFO:teuthology.orchestra.run.smithi165.stdout: 2023-01-25T09:51:16.426 INFO:teuthology.orchestra.run.smithi165.stdout:[client] 2023-01-25T09:51:16.426 INFO:teuthology.orchestra.run.smithi165.stdout: rgw cache enabled = true 2023-01-25T09:51:16.427 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable ops log = true 2023-01-25T09:51:16.427 INFO:teuthology.orchestra.run.smithi165.stdout: rgw enable usage log = true 2023-01-25T09:51:16.427 INFO:teuthology.orchestra.run.smithi165.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T09:51:16.427 INFO:teuthology.orchestra.run.smithi165.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T09:51:16.428 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.a] 2023-01-25T09:51:16.428 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.c] 2023-01-25T09:51:16.428 INFO:teuthology.orchestra.run.smithi165.stdout:[mon.b] 2023-01-25T09:51:16.429 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T09:51:16.429 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T09:51:16.494 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T09:51:16.494 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:16.495 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T09:51:16.512 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:16.513 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T09:51:16.571 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:51:16.571 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:16.571 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:51:16.572 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:51:16.646 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:16.647 DEBUG:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:16.704 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:51:16.705 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:16.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T09:51:16.705 DEBUG:teuthology.orchestra.run.smithi165:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T09:51:16.743 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:16.743 DEBUG:teuthology.orchestra.run.smithi165:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:16.801 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T09:51:16.801 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T09:51:16.801 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:51:16.855 INFO:teuthology.orchestra.run.smithi085.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T09:51:16.858 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:51:16.945 INFO:teuthology.orchestra.run.smithi165.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T09:51:16.947 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T09:51:16.948 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T09:51:16.948 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T09:51:16.993 INFO:teuthology.orchestra.run.smithi085.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T09:51:17.005 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T09:51:17.049 INFO:teuthology.orchestra.run.smithi165.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T09:51:17.061 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T09:51:17.062 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi085.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi165.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T09:51:17.062 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T09:51:17.089 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:17.090 INFO:tasks.ceph:role: osd.0 2023-01-25T09:51:17.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:51:17.090 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:51:17.164 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:17.165 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:17.165 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:17.165 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:17.165 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:17.166 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:17.166 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:17.166 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:17.166 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:17.167 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:17.588 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T09:51:17.589 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T09:51:17.590 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T09:51:17.755 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T09:51:17.790 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T09:51:17.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:17.859 INFO:tasks.ceph:role: osd.1 2023-01-25T09:51:17.859 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:51:17.859 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:51:17.933 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:17.934 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:17.934 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:17.934 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:17.934 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:17.935 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:17.935 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:17.935 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:17.935 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:17.935 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:18.367 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T09:51:18.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T09:51:18.369 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T09:51:18.476 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T09:51:18.507 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T09:51:18.574 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:18.575 INFO:tasks.ceph:role: osd.2 2023-01-25T09:51:18.575 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:51:18.575 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:51:18.650 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:18.650 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:18.650 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:18.650 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:18.650 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:18.651 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:18.651 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:18.651 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:18.651 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:18.651 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:19.101 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T09:51:19.103 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T09:51:19.103 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T09:51:19.254 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T09:51:19.289 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T09:51:19.356 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:19.356 INFO:tasks.ceph:role: osd.3 2023-01-25T09:51:19.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:51:19.357 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:51:19.431 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:19.432 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:19.432 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:19.432 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:19.433 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:19.433 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:19.433 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:19.433 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:19.434 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:19.434 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:19.876 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T09:51:19.878 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T09:51:19.878 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T09:51:20.053 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T09:51:20.084 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:20.182 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.176+0000 7f4cb19f6580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T09:51:20.182 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.176+0000 7f4cb19f6580 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T09:51:20.182 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.176+0000 7f4cb19f6580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:51:20.182 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.176+0000 7f4cb19f6580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:51:20.183 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.176+0000 7f4cb19f6580 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T09:51:20.183 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.177+0000 7f4cb19f6580 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T09:51:20.706 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:20.701+0000 7f4cb19f6580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:21.469 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:21.464+0000 7f4cb19f6580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:22.233 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:22.228+0000 7f4cb19f6580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:23.023 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T09:51:23.115 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:23.202 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.197+0000 7fc9084d0580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T09:51:23.203 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.197+0000 7fc9084d0580 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T09:51:23.203 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.197+0000 7fc9084d0580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:51:23.203 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.197+0000 7fc9084d0580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:51:23.203 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.197+0000 7fc9084d0580 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T09:51:23.204 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.198+0000 7fc9084d0580 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T09:51:23.730 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:23.725+0000 7fc9084d0580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:24.494 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:24.489+0000 7fc9084d0580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:25.261 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:25.256+0000 7fc9084d0580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:26.052 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T09:51:26.081 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:26.168 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.163+0000 7f65d4059580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T09:51:26.169 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.163+0000 7f65d4059580 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T09:51:26.169 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.163+0000 7f65d4059580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:51:26.169 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.163+0000 7f65d4059580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:51:26.169 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.163+0000 7f65d4059580 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T09:51:26.170 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.164+0000 7f65d4059580 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T09:51:26.693 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:26.688+0000 7f65d4059580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:27.457 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:27.452+0000 7f65d4059580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:28.222 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:28.217+0000 7f65d4059580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:29.013 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T09:51:29.044 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:29.137 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.128+0000 7f093a486580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T09:51:29.137 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.129+0000 7f093a486580 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T09:51:29.137 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.129+0000 7f093a486580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:51:29.138 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.129+0000 7f093a486580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:51:29.138 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.129+0000 7f093a486580 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T09:51:29.138 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.129+0000 7f093a486580 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T09:51:29.658 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:29.653+0000 7f093a486580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:30.419 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:30.414+0000 7f093a486580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:31.181 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T09:51:31.175+0000 7f093a486580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:31.971 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T09:51:32.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T09:51:32.030 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:32.031 INFO:tasks.ceph:role: osd.4 2023-01-25T09:51:32.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:51:32.031 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T09:51:32.108 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:32.108 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:32.108 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:32.109 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:32.109 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:32.109 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:32.109 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:32.109 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:32.110 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:32.110 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:32.547 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2023-01-25T09:51:32.549 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2023-01-25T09:51:32.549 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T09:51:32.739 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T09:51:32.774 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T09:51:32.842 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:32.843 INFO:tasks.ceph:role: osd.5 2023-01-25T09:51:32.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:51:32.844 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T09:51:32.918 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:32.918 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:32.919 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:32.919 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:32.919 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:32.919 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:32.919 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:32.920 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:32.920 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:32.920 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:33.339 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2023-01-25T09:51:33.341 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2023-01-25T09:51:33.342 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T09:51:33.445 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T09:51:33.479 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T09:51:33.546 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:33.547 INFO:tasks.ceph:role: osd.6 2023-01-25T09:51:33.547 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:51:33.547 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T09:51:33.621 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:33.622 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:33.622 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:33.622 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:33.622 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:33.623 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:33.623 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:33.623 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:33.623 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:33.623 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:34.067 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2023-01-25T09:51:34.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2023-01-25T09:51:34.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T09:51:34.240 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T09:51:34.272 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T09:51:34.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T09:51:34.340 INFO:tasks.ceph:role: osd.7 2023-01-25T09:51:34.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com 2023-01-25T09:51:34.341 DEBUG:teuthology.orchestra.run.smithi165:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T09:51:34.416 INFO:teuthology.orchestra.run.smithi165.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T09:51:34.416 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T09:51:34.416 INFO:teuthology.orchestra.run.smithi165.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T09:51:34.416 INFO:teuthology.orchestra.run.smithi165.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T09:51:34.417 INFO:teuthology.orchestra.run.smithi165.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T09:51:34.417 INFO:teuthology.orchestra.run.smithi165.stdout: = sunit=0 swidth=0 blks 2023-01-25T09:51:34.417 INFO:teuthology.orchestra.run.smithi165.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T09:51:34.417 INFO:teuthology.orchestra.run.smithi165.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T09:51:34.417 INFO:teuthology.orchestra.run.smithi165.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T09:51:34.418 INFO:teuthology.orchestra.run.smithi165.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T09:51:34.864 INFO:teuthology.orchestra.run.smithi165.stdout:Discarding blocks...Done. 2023-01-25T09:51:34.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi165.front.sepia.ceph.com -o noatime 2023-01-25T09:51:34.866 DEBUG:teuthology.orchestra.run.smithi165:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T09:51:35.053 DEBUG:teuthology.orchestra.run.smithi165:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T09:51:35.088 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:35.191 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.185+0000 7fb925000580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T09:51:35.192 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.185+0000 7fb925000580 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T09:51:35.192 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.185+0000 7fb925000580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:51:35.193 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.185+0000 7fb925000580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:51:35.193 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.185+0000 7fb925000580 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T09:51:35.193 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.186+0000 7fb925000580 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T09:51:35.715 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:35.710+0000 7fb925000580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:36.479 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:36.474+0000 7fb925000580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:37.241 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:37.236+0000 7fb925000580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:38.037 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T09:51:38.068 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:38.159 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.153+0000 7f2e15dc1580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T09:51:38.159 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.153+0000 7f2e15dc1580 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T09:51:38.160 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.153+0000 7f2e15dc1580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:51:38.160 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.153+0000 7f2e15dc1580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:51:38.160 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.153+0000 7f2e15dc1580 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T09:51:38.160 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.154+0000 7f2e15dc1580 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T09:51:38.683 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:38.677+0000 7f2e15dc1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:39.443 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:39.438+0000 7f2e15dc1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:40.207 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:40.202+0000 7f2e15dc1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:41.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T09:51:41.032 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:41.124 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.118+0000 7fab7b1a1580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T09:51:41.124 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.118+0000 7fab7b1a1580 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T09:51:41.125 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.118+0000 7fab7b1a1580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:51:41.125 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.118+0000 7fab7b1a1580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:51:41.125 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.118+0000 7fab7b1a1580 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T09:51:41.125 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.119+0000 7fab7b1a1580 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T09:51:41.648 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:41.643+0000 7fab7b1a1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:42.416 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:42.410+0000 7fab7b1a1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:43.179 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:43.173+0000 7fab7b1a1580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:43.970 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T09:51:44.000 DEBUG:teuthology.orchestra.run.smithi165:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:44.090 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.084+0000 7ff61afa9580 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T09:51:44.090 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.084+0000 7ff61afa9580 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T09:51:44.091 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.084+0000 7ff61afa9580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:51:44.091 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.084+0000 7ff61afa9580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:51:44.091 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.084+0000 7ff61afa9580 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T09:51:44.091 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.085+0000 7ff61afa9580 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T09:51:44.622 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:44.616+0000 7ff61afa9580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:45.382 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:45.377+0000 7ff61afa9580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:46.144 INFO:teuthology.orchestra.run.smithi165.stderr:2023-01-25T09:51:46.139+0000 7ff61afa9580 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T09:51:46.936 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T09:51:46.970 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T09:51:46.970 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:46.970 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T09:51:47.000 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:47.001 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T09:51:47.068 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:47.069 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T09:51:47.136 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:47.137 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T09:51:47.203 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:47.204 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T09:51:47.270 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.271 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T09:51:47.304 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.304 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T09:51:47.376 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.377 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T09:51:47.448 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.449 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T09:51:47.518 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.518 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T09:51:47.588 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:47.588 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T09:51:47.606 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:47.607 DEBUG:teuthology.orchestra.run.smithi165:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T09:51:47.647 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T09:51:47.647 DEBUG:teuthology.orchestra.run.smithi085:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:51:47.650 DEBUG:teuthology.orchestra.run.smithi165:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T09:51:47.690 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr.y] 2023-01-25T09:51:47.690 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCU+9BjrP3AMhAAw2S08XFrUbu807MhSGu5eQ== 2023-01-25T09:51:47.690 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.0] 2023-01-25T09:51:47.690 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCY+9BjUTWUChAAhVND8MY//Zf6qw2HCILXnQ== 2023-01-25T09:51:47.691 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.1] 2023-01-25T09:51:47.691 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCb+9BjvK3TCxAAtBFVRk2Kw4nJyTJTStKkdA== 2023-01-25T09:51:47.691 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.2] 2023-01-25T09:51:47.691 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCe+9BjnnTKCRAAxZ8vp7ecxu8WDOPNDnNf6w== 2023-01-25T09:51:47.691 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.3] 2023-01-25T09:51:47.692 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCh+9Bjx4m7BxAAeYKoSYJnA4P8hqiR3mvh9g== 2023-01-25T09:51:47.692 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr.x] 2023-01-25T09:51:47.692 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCU+9Bj+DQVOBAAuSt++LLlqQMXrEeIktSDIA== 2023-01-25T09:51:47.692 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.4] 2023-01-25T09:51:47.692 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCn+9BjhEUfCxAAyQ6cl+GAsLCxiXBemIn6zw== 2023-01-25T09:51:47.693 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.5] 2023-01-25T09:51:47.693 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCq+9Bj3OU4CRAAVYfOD2W/3qLQUQWV3QyhxA== 2023-01-25T09:51:47.693 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.6] 2023-01-25T09:51:47.693 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCt+9Bj8o0hBxAAAcKLqcLef/f7X5bN9TLwwg== 2023-01-25T09:51:47.693 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.7] 2023-01-25T09:51:47.694 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCw+9BjX4QdBRAAljKvD+jyicwEXI/SYiBLBg== 2023-01-25T09:51:47.694 INFO:teuthology.orchestra.run.smithi085.stdout:[client.0] 2023-01-25T09:51:47.694 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCU+9BjjiXtOhAADtX62zf3uWdoIJ6CQOw5AQ== 2023-01-25T09:51:47.694 INFO:teuthology.orchestra.run.smithi085.stdout:[client.1] 2023-01-25T09:51:47.694 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQCV+9BjW7OyAhAAqdgOdDshzi5GiHX18bMZNA== 2023-01-25T09:51:47.713 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.y] 2023-01-25T09:51:47.714 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCU+9BjrP3AMhAAw2S08XFrUbu807MhSGu5eQ== 2023-01-25T09:51:47.714 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.0] 2023-01-25T09:51:47.714 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCY+9BjUTWUChAAhVND8MY//Zf6qw2HCILXnQ== 2023-01-25T09:51:47.715 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.1] 2023-01-25T09:51:47.715 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCb+9BjvK3TCxAAtBFVRk2Kw4nJyTJTStKkdA== 2023-01-25T09:51:47.715 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.2] 2023-01-25T09:51:47.716 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCe+9BjnnTKCRAAxZ8vp7ecxu8WDOPNDnNf6w== 2023-01-25T09:51:47.716 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.3] 2023-01-25T09:51:47.716 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCh+9Bjx4m7BxAAeYKoSYJnA4P8hqiR3mvh9g== 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout:[mgr.x] 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCU+9Bj+DQVOBAAuSt++LLlqQMXrEeIktSDIA== 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.4] 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCn+9BjhEUfCxAAyQ6cl+GAsLCxiXBemIn6zw== 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.5] 2023-01-25T09:51:47.717 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCq+9Bj3OU4CRAAVYfOD2W/3qLQUQWV3QyhxA== 2023-01-25T09:51:47.718 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.6] 2023-01-25T09:51:47.718 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCt+9Bj8o0hBxAAAcKLqcLef/f7X5bN9TLwwg== 2023-01-25T09:51:47.718 INFO:teuthology.orchestra.run.smithi165.stdout:[osd.7] 2023-01-25T09:51:47.718 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCw+9BjX4QdBRAAljKvD+jyicwEXI/SYiBLBg== 2023-01-25T09:51:47.718 INFO:teuthology.orchestra.run.smithi165.stdout:[client.0] 2023-01-25T09:51:47.719 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCU+9BjjiXtOhAADtX62zf3uWdoIJ6CQOw5AQ== 2023-01-25T09:51:47.719 INFO:teuthology.orchestra.run.smithi165.stdout:[client.1] 2023-01-25T09:51:47.719 INFO:teuthology.orchestra.run.smithi165.stdout: key = AQCV+9BjW7OyAhAAqdgOdDshzi5GiHX18bMZNA== 2023-01-25T09:51:47.720 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:51:47.738 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:51:47.815 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.818 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.872 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.874 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.927 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.930 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.983 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:47.985 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.038 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:51:48.042 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T09:51:48.096 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.099 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.153 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.155 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.209 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.211 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.265 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.267 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T09:51:48.320 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:51:48.323 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:51:48.380 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:51:48.382 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T09:51:48.438 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T09:51:48.439 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T09:51:48.466 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:51:48.564 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T09:51:48.591 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T09:51:48.673 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:51:48.772 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T09:51:48.799 DEBUG:teuthology.orchestra.run.smithi165:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T09:51:48.828 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T09:51:48.929 DEBUG:teuthology.orchestra.run.smithi165:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T09:51:48.957 DEBUG:teuthology.orchestra.run.smithi085:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:48.959 DEBUG:teuthology.orchestra.run.smithi165:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T09:51:49.014 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T09:51:49.015 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T09:51:49.015 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T09:51:49.018 INFO:tasks.ceph.mon.a:Started 2023-01-25T09:51:49.018 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T09:51:49.018 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T09:51:49.020 INFO:tasks.ceph.mon.c:Started 2023-01-25T09:51:49.021 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T09:51:49.021 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T09:51:49.057 INFO:tasks.ceph.mon.b:Started 2023-01-25T09:51:49.057 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T09:51:49.058 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T09:51:49.058 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T09:51:49.062 INFO:tasks.ceph.mgr.y:Started 2023-01-25T09:51:49.063 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T09:51:49.063 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T09:51:49.065 INFO:tasks.ceph.mgr.x:Started 2023-01-25T09:51:49.066 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T09:51:49.066 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T09:51:55.307 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:55.299+0000 7f1e2d2ef200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:51:55.374 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:55.369+0000 7f1e2d2ef200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:51:55.454 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:55.449+0000 7f1e2d2ef200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:51:55.458 INFO:teuthology.orchestra.run.smithi085.stderr:adjusted tunables profile to default 2023-01-25T09:51:55.469 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T09:51:55.469 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:55.470 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T09:51:55.499 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:55.499 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T09:51:55.565 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:55.566 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T09:51:55.634 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T09:51:55.635 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T09:51:55.638 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:55.633+0000 7f1e2d2ef200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:51:55.702 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:55.702 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T09:51:55.729 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:55.730 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T09:51:55.797 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:55.798 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T09:51:55.864 DEBUG:teuthology.orchestra.run.smithi165:> set -ex 2023-01-25T09:51:55.864 DEBUG:teuthology.orchestra.run.smithi165:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T09:51:55.933 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 2e36042b-8fee-42e9-acfa-a18d7f8ec0c6 0 2023-01-25T09:51:56.102 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:56.097+0000 7fe269b4c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T09:51:56.171 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:56.166+0000 7fe269b4c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T09:51:56.191 INFO:teuthology.orchestra.run.smithi165.stdout:0 2023-01-25T09:51:56.204 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8 1 2023-01-25T09:51:56.261 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:56.256+0000 7fe269b4c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T09:51:56.444 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:56.439+0000 7fe269b4c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T09:51:56.444 INFO:teuthology.orchestra.run.smithi165.stdout:1 2023-01-25T09:51:56.458 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new d8a18c1a-5809-4a61-b9cb-c178a351482f 2 2023-01-25T09:51:56.491 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:56.485+0000 7f1e2d2ef200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T09:51:56.644 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:56.639+0000 7f1e2d2ef200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:51:56.687 INFO:teuthology.orchestra.run.smithi165.stdout:2 2023-01-25T09:51:56.700 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 373bfe91-4185-40a1-a1c2-71c1d6ec3494 3 2023-01-25T09:51:56.881 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:56.876+0000 7f1e2d2ef200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:51:56.983 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:56.978+0000 7f1e2d2ef200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:51:57.005 INFO:teuthology.orchestra.run.smithi165.stdout:3 2023-01-25T09:51:57.017 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new b697eb1b-ed40-4bfe-9c47-342812281d3e 4 2023-01-25T09:51:57.126 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:57.122+0000 7f1e2d2ef200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:51:57.216 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:57.211+0000 7fe269b4c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T09:51:57.238 INFO:teuthology.orchestra.run.smithi165.stdout:4 2023-01-25T09:51:57.251 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 2f9574e8-dbfd-4019-b831-6537ee307faf 5 2023-01-25T09:51:57.357 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:57.352+0000 7fe269b4c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T09:51:57.427 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:57.423+0000 7f1e2d2ef200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:51:57.485 INFO:teuthology.orchestra.run.smithi165.stdout:5 2023-01-25T09:51:57.499 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 5b0aa305-5c22-41af-be0e-5a016917f986 6 2023-01-25T09:51:57.579 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:57.574+0000 7fe269b4c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T09:51:57.621 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:57.617+0000 7f1e2d2ef200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:51:57.649 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:57.644+0000 7fe269b4c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T09:51:57.719 INFO:teuthology.orchestra.run.smithi165.stdout:6 2023-01-25T09:51:57.731 DEBUG:teuthology.orchestra.run.smithi165:> sudo ceph --cluster ceph osd new 8f056f80-4270-4889-a165-e1071a1e12a1 7 2023-01-25T09:51:57.770 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:57.766+0000 7f1e2d2ef200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:51:57.784 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:57.779+0000 7fe269b4c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:51:57.892 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:57.888+0000 7f1e2d2ef200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:51:57.947 INFO:teuthology.orchestra.run.smithi165.stdout:7 2023-01-25T09:51:57.960 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T09:51:57.960 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T09:51:57.963 INFO:tasks.ceph.osd.0:Started 2023-01-25T09:51:57.963 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T09:51:57.964 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T09:51:57.965 INFO:tasks.ceph.osd.1:Started 2023-01-25T09:51:57.966 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T09:51:57.966 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T09:51:57.968 INFO:tasks.ceph.osd.2:Started 2023-01-25T09:51:57.968 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T09:51:57.969 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T09:51:57.971 INFO:tasks.ceph.osd.3:Started 2023-01-25T09:51:57.972 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T09:51:57.972 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T09:51:58.002 INFO:tasks.ceph.osd.4:Started 2023-01-25T09:51:58.003 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T09:51:58.003 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T09:51:58.005 INFO:tasks.ceph.osd.5:Started 2023-01-25T09:51:58.005 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T09:51:58.006 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T09:51:58.008 INFO:tasks.ceph.osd.6:Started 2023-01-25T09:51:58.008 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T09:51:58.009 DEBUG:teuthology.orchestra.run.smithi165:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T09:51:58.011 INFO:tasks.ceph.osd.7:Started 2023-01-25T09:51:58.011 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:51:58.047 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:58.043+0000 7f1e2d2ef200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:51:58.080 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.075+0000 7fe269b4c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T09:51:58.151 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:58.147+0000 7f1e2d2ef200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:51:58.227 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:51:58.227 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":11,"fsid":"c987774b-2f2f-4b1a-8f5c-26157f155976","created":"2023-01-25T09:51:54.346392+0000","modified":"2023-01-25T09:51:57.941149+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:51:57.941149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"2e36042b-8fee-42e9-acfa-a18d7f8ec0c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d8a18c1a-5809-4a61-b9cb-c178a351482f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"373bfe91-4185-40a1-a1c2-71c1d6ec3494","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b697eb1b-ed40-4bfe-9c47-342812281d3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2f9574e8-dbfd-4019-b831-6537ee307faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5b0aa305-5c22-41af-be0e-5a016917f986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f056f80-4270-4889-a165-e1071a1e12a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:51:58.239 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T09:51:58.240 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T09:51:58.268 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.263+0000 7fe269b4c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T09:51:58.333 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:51:58.328+0000 7ff556f4a580 -1 Falling back to public interface 2023-01-25T09:51:58.371 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:58.367+0000 7f1e2d2ef200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:51:58.411 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.406+0000 7fe269b4c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T09:51:58.450 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:58.446+0000 7f1e2d2ef200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:51:58.523 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.518+0000 7fe269b4c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T09:51:58.579 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:51:58.573+0000 7fc66ce6d580 -1 Falling back to public interface 2023-01-25T09:51:58.594 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T09:51:58.589+0000 7f9407e44580 -1 Falling back to public interface 2023-01-25T09:51:58.602 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:51:58.598+0000 7fb81200d580 -1 Falling back to public interface 2023-01-25T09:51:58.615 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:51:58.611+0000 7f346e6f8580 -1 Falling back to public interface 2023-01-25T09:51:58.621 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:51:58.617+0000 7fbd00d98580 -1 Falling back to public interface 2023-01-25T09:51:58.622 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:51:58.617+0000 7fd0a36d6580 -1 Falling back to public interface 2023-01-25T09:51:58.640 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:51:58.636+0000 7f393c63d580 -1 Falling back to public interface 2023-01-25T09:51:58.665 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.660+0000 7fe269b4c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T09:51:58.743 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.738+0000 7fe269b4c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T09:51:58.960 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:58.955+0000 7fe269b4c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T09:51:59.036 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:59.031+0000 7fe269b4c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T09:51:59.045 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:51:59.069 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.065+0000 7f1e2d2ef200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:51:59.236 INFO:teuthology.misc.health.smithi085.stdout: 2023-01-25T09:51:59.237 INFO:teuthology.misc.health.smithi085.stdout:{"epoch":11,"fsid":"c987774b-2f2f-4b1a-8f5c-26157f155976","created":"2023-01-25T09:51:54.346392+0000","modified":"2023-01-25T09:51:57.941149+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T09:51:57.941149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"2e36042b-8fee-42e9-acfa-a18d7f8ec0c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d8a18c1a-5809-4a61-b9cb-c178a351482f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"373bfe91-4185-40a1-a1c2-71c1d6ec3494","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b697eb1b-ed40-4bfe-9c47-342812281d3e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2f9574e8-dbfd-4019-b831-6537ee307faf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5b0aa305-5c22-41af-be0e-5a016917f986","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f056f80-4270-4889-a165-e1071a1e12a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:51:59.248 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T09:51:59.332 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.327+0000 7f1e2d2ef200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:51:59.407 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.402+0000 7f1e2d2ef200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:51:59.491 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.486+0000 7f1e2d2ef200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:51:59.662 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:59.657+0000 7fe269b4c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T09:51:59.673 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.669+0000 7f1e2d2ef200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:51:59.746 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.742+0000 7f1e2d2ef200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:51:59.898 INFO:tasks.ceph.mgr.x.smithi165.stderr:2023-01-25T09:51:59.894+0000 7f1e2d2ef200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:51:59.914 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:59.910+0000 7fe269b4c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T09:51:59.990 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:51:59.985+0000 7fe269b4c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T09:52:00.070 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:00.065+0000 7fe269b4c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T09:52:00.254 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:00.249+0000 7fe269b4c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T09:52:00.324 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:00.319+0000 7fe269b4c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T09:52:00.472 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:00.467+0000 7fe269b4c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T09:52:01.495 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:01.490+0000 7fe22368c700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T09:52:01.501 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T09:52:01.496+0000 7fe22368c700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T09:52:01.833 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:01.828+0000 7ff556f4a580 -1 osd.0 0 log_to_monitors true 2023-01-25T09:52:02.049 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:02.044+0000 7fc66ce6d580 -1 osd.1 0 log_to_monitors true 2023-01-25T09:52:02.089 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:02.085+0000 7fd0a36d6580 -1 osd.5 0 log_to_monitors true 2023-01-25T09:52:02.098 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:52:02.093+0000 7fb81200d580 -1 osd.3 0 log_to_monitors true 2023-01-25T09:52:02.103 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T09:52:02.098+0000 7f9407e44580 -1 osd.2 0 log_to_monitors true 2023-01-25T09:52:02.152 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:02.148+0000 7f346e6f8580 -1 osd.4 0 log_to_monitors true 2023-01-25T09:52:02.175 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:52:02.171+0000 7fbd00d98580 -1 osd.6 0 log_to_monitors true 2023-01-25T09:52:02.182 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:52:02.178+0000 7f393c63d580 -1 osd.7 0 log_to_monitors true 2023-01-25T09:52:03.500 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:03.496+0000 7fd09727d700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T09:52:03.501 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:03.496+0000 7fd08dfad700 -1 osd.5 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.501 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:52:03.496+0000 7fbcf493f700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T09:52:03.501 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:52:03.496+0000 7f39301e4700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T09:52:03.502 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:52:03.497+0000 7fbceb66f700 -1 osd.6 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.502 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:03.497+0000 7f346229f700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T09:52:03.503 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:03.497+0000 7f3458fcf700 -1 osd.4 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.503 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:52:03.498+0000 7f3926f14700 -1 osd.7 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.503 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:03.495+0000 7fc660a14700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T09:52:03.504 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:03.497+0000 7ff54aaf1700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T09:52:03.504 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:52:03.499+0000 7fb805bb4700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T09:52:03.505 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T09:52:03.499+0000 7f93fb9eb700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T09:52:03.507 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:03.503+0000 7fc65cdf7700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.509 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:52:03.504+0000 7fb7fc8e4700 -1 osd.3 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.509 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T09:52:03.504+0000 7f93f271b700 -1 osd.2 0 handle_osd_map injecting map crc failure 2023-01-25T09:52:03.510 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:52:03.506+0000 7f392c5c7700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.514 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:52:03.509+0000 7fb801f97700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.516 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:03.511+0000 7f345e682700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.516 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:52:03.511+0000 7fbcf0d22700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.516 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:03.512+0000 7fd093660700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.517 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:03.512+0000 7ff5466d3700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:03.517 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T09:52:03.512+0000 7f93f7dce700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T09:52:06.055 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T09:52:06.374 INFO:teuthology.misc.health.smithi085.stdout: 2023-01-25T09:52:06.375 INFO:teuthology.misc.health.smithi085.stdout:{"epoch":15,"fsid":"c987774b-2f2f-4b1a-8f5c-26157f155976","created":"2023-01-25T09:51:54.346392+0000","modified":"2023-01-25T09:52:05.521565+0000","last_up_change":"2023-01-25T09:52:04.508212+0000","last_in_change":"2023-01-25T09:51:57.941149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"2e36042b-8fee-42e9-acfa-a18d7f8ec0c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106388}]},"public_addr":"172.21.15.85:6800/106388","cluster_addr":"172.21.15.85:6801/106388","heartbeat_back_addr":"172.21.15.85:6803/106388","heartbeat_front_addr":"172.21.15.85:6802/106388","state":["exists","up"]},{"osd":1,"uuid":"c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106389}]},"public_addr":"172.21.15.85:6804/106389","cluster_addr":"172.21.15.85:6805/106389","heartbeat_back_addr":"172.21.15.85:6807/106389","heartbeat_front_addr":"172.21.15.85:6806/106389","state":["exists","up"]},{"osd":2,"uuid":"d8a18c1a-5809-4a61-b9cb-c178a351482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106400}]},"public_addr":"172.21.15.85:6808/106400","cluster_addr":"172.21.15.85:6809/106400","heartbeat_back_addr":"172.21.15.85:6811/106400","heartbeat_front_addr":"172.21.15.85:6810/106400","state":["exists","up"]},{"osd":3,"uuid":"373bfe91-4185-40a1-a1c2-71c1d6ec3494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106410}]},"public_addr":"172.21.15.85:6812/106410","cluster_addr":"172.21.15.85:6813/106410","heartbeat_back_addr":"172.21.15.85:6815/106410","heartbeat_front_addr":"172.21.15.85:6814/106410","state":["exists","up"]},{"osd":4,"uuid":"b697eb1b-ed40-4bfe-9c47-342812281d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":106336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":106336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6803","nonce":106336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":106336}]},"public_addr":"172.21.15.165:6800/106336","cluster_addr":"172.21.15.165:6801/106336","heartbeat_back_addr":"172.21.15.165:6803/106336","heartbeat_front_addr":"172.21.15.165:6802/106336","state":["exists","up"]},{"osd":5,"uuid":"2f9574e8-dbfd-4019-b831-6537ee307faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":106338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6807","nonce":106338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":106338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6809","nonce":106338}]},"public_addr":"172.21.15.165:6805/106338","cluster_addr":"172.21.15.165:6807/106338","heartbeat_back_addr":"172.21.15.165:6811/106338","heartbeat_front_addr":"172.21.15.165:6809/106338","state":["exists","up"]},{"osd":6,"uuid":"5b0aa305-5c22-41af-be0e-5a016917f986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":106337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":106337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":106337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":106337}]},"public_addr":"172.21.15.165:6804/106337","cluster_addr":"172.21.15.165:6806/106337","heartbeat_back_addr":"172.21.15.165:6810/106337","heartbeat_front_addr":"172.21.15.165:6808/106337","state":["exists","up"]},{"osd":7,"uuid":"8f056f80-4270-4889-a165-e1071a1e12a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":106381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":106381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6815","nonce":106381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":106381}]},"public_addr":"172.21.15.165:6812/106381","cluster_addr":"172.21.15.165:6813/106381","heartbeat_back_addr":"172.21.15.165:6815/106381","heartbeat_front_addr":"172.21.15.165:6814/106381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:02.802799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.088203+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.052611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.119189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.168210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.067234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.174505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.204033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:52:06.387 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T09:52:06.388 INFO:tasks.ceph:Creating RBD pool 2023-01-25T09:52:06.388 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T09:52:06.591 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:06.586+0000 7ff541020700 -1 osd.0 14 handle_osd_map injecting map crc failure 2023-01-25T09:52:07.200 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:07.195+0000 7fc655740700 -1 osd.1 14 handle_osd_map injecting map crc failure 2023-01-25T09:52:07.597 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'rbd' created 2023-01-25T09:52:07.611 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T09:52:07.701 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:07.697+0000 7fd08bfa9700 -1 osd.5 16 handle_osd_map injecting map crc failure 2023-01-25T09:52:08.599 INFO:tasks.ceph.osd.6.smithi165.stderr:2023-01-25T09:52:08.593+0000 7fbceb66f700 -1 osd.6 17 handle_osd_map injecting map crc failure 2023-01-25T09:52:08.601 INFO:teuthology.orchestra.run.smithi085.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T09:52:08.613 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T09:52:08.614 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T09:52:08.614 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T09:52:08.614 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T09:52:08.615 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T09:52:08.984 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:08.997 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":5,"active_gid":4113,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6816","nonce":106092}]},"active_addr":"172.21.15.85:6816/106092","active_change":"2023-01-25T09:52:00.481945+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":380893530}]},{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":3697021602}]},{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":671868360}]}]}} 2023-01-25T09:52:09.001 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T09:52:09.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T09:52:09.002 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:52:09.320 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:09.321 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":18,"fsid":"c987774b-2f2f-4b1a-8f5c-26157f155976","created":"2023-01-25T09:51:54.346392+0000","modified":"2023-01-25T09:52:08.585482+0000","last_up_change":"2023-01-25T09:52:04.508212+0000","last_in_change":"2023-01-25T09:51:57.941149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T09:52:06.532033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T09:52:06.717489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2e36042b-8fee-42e9-acfa-a18d7f8ec0c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106388}]},"public_addr":"172.21.15.85:6800/106388","cluster_addr":"172.21.15.85:6801/106388","heartbeat_back_addr":"172.21.15.85:6803/106388","heartbeat_front_addr":"172.21.15.85:6802/106388","state":["exists","up"]},{"osd":1,"uuid":"c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106389}]},"public_addr":"172.21.15.85:6804/106389","cluster_addr":"172.21.15.85:6805/106389","heartbeat_back_addr":"172.21.15.85:6807/106389","heartbeat_front_addr":"172.21.15.85:6806/106389","state":["exists","up"]},{"osd":2,"uuid":"d8a18c1a-5809-4a61-b9cb-c178a351482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106400}]},"public_addr":"172.21.15.85:6808/106400","cluster_addr":"172.21.15.85:6809/106400","heartbeat_back_addr":"172.21.15.85:6811/106400","heartbeat_front_addr":"172.21.15.85:6810/106400","state":["exists","up"]},{"osd":3,"uuid":"373bfe91-4185-40a1-a1c2-71c1d6ec3494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106410}]},"public_addr":"172.21.15.85:6812/106410","cluster_addr":"172.21.15.85:6813/106410","heartbeat_back_addr":"172.21.15.85:6815/106410","heartbeat_front_addr":"172.21.15.85:6814/106410","state":["exists","up"]},{"osd":4,"uuid":"b697eb1b-ed40-4bfe-9c47-342812281d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":106336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":106336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6803","nonce":106336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":106336}]},"public_addr":"172.21.15.165:6800/106336","cluster_addr":"172.21.15.165:6801/106336","heartbeat_back_addr":"172.21.15.165:6803/106336","heartbeat_front_addr":"172.21.15.165:6802/106336","state":["exists","up"]},{"osd":5,"uuid":"2f9574e8-dbfd-4019-b831-6537ee307faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":106338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6807","nonce":106338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":106338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6809","nonce":106338}]},"public_addr":"172.21.15.165:6805/106338","cluster_addr":"172.21.15.165:6807/106338","heartbeat_back_addr":"172.21.15.165:6811/106338","heartbeat_front_addr":"172.21.15.165:6809/106338","state":["exists","up"]},{"osd":6,"uuid":"5b0aa305-5c22-41af-be0e-5a016917f986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":106337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":106337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":106337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":106337}]},"public_addr":"172.21.15.165:6804/106337","cluster_addr":"172.21.15.165:6806/106337","heartbeat_back_addr":"172.21.15.165:6810/106337","heartbeat_front_addr":"172.21.15.165:6808/106337","state":["exists","up"]},{"osd":7,"uuid":"8f056f80-4270-4889-a165-e1071a1e12a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":106381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":106381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6815","nonce":106381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":106381}]},"public_addr":"172.21.15.165:6812/106381","cluster_addr":"172.21.15.165:6813/106381","heartbeat_back_addr":"172.21.15.165:6815/106381","heartbeat_front_addr":"172.21.15.165:6814/106381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:02.802799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.088203+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.052611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.119189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.168210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.067234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.174505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.204033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:52:09.334 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T09:52:09.335 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T09:52:09.601 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:09.596+0000 7ff541020700 -1 osd.0 18 handle_osd_map injecting map crc failure 2023-01-25T09:52:09.650 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:09.650 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":19,"fsid":"c987774b-2f2f-4b1a-8f5c-26157f155976","created":"2023-01-25T09:51:54.346392+0000","modified":"2023-01-25T09:52:09.592004+0000","last_up_change":"2023-01-25T09:52:04.508212+0000","last_in_change":"2023-01-25T09:51:57.941149+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-01-25T09:52:06.532033+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-25T09:52:06.717489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"2e36042b-8fee-42e9-acfa-a18d7f8ec0c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106388}]},"public_addr":"172.21.15.85:6800/106388","cluster_addr":"172.21.15.85:6801/106388","heartbeat_back_addr":"172.21.15.85:6803/106388","heartbeat_front_addr":"172.21.15.85:6802/106388","state":["exists","up"]},{"osd":1,"uuid":"c0aec0f5-6a64-4dd7-a2e6-53a7dd6d8ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106389}]},"public_addr":"172.21.15.85:6804/106389","cluster_addr":"172.21.15.85:6805/106389","heartbeat_back_addr":"172.21.15.85:6807/106389","heartbeat_front_addr":"172.21.15.85:6806/106389","state":["exists","up"]},{"osd":2,"uuid":"d8a18c1a-5809-4a61-b9cb-c178a351482f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106400}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106400}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106400}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106400}]},"public_addr":"172.21.15.85:6808/106400","cluster_addr":"172.21.15.85:6809/106400","heartbeat_back_addr":"172.21.15.85:6811/106400","heartbeat_front_addr":"172.21.15.85:6810/106400","state":["exists","up"]},{"osd":3,"uuid":"373bfe91-4185-40a1-a1c2-71c1d6ec3494","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106410}]},"public_addr":"172.21.15.85:6812/106410","cluster_addr":"172.21.15.85:6813/106410","heartbeat_back_addr":"172.21.15.85:6815/106410","heartbeat_front_addr":"172.21.15.85:6814/106410","state":["exists","up"]},{"osd":4,"uuid":"b697eb1b-ed40-4bfe-9c47-342812281d3e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6800","nonce":106336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6801","nonce":106336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6803","nonce":106336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6802","nonce":106336}]},"public_addr":"172.21.15.165:6800/106336","cluster_addr":"172.21.15.165:6801/106336","heartbeat_back_addr":"172.21.15.165:6803/106336","heartbeat_front_addr":"172.21.15.165:6802/106336","state":["exists","up"]},{"osd":5,"uuid":"2f9574e8-dbfd-4019-b831-6537ee307faf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6805","nonce":106338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6807","nonce":106338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6811","nonce":106338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6809","nonce":106338}]},"public_addr":"172.21.15.165:6805/106338","cluster_addr":"172.21.15.165:6807/106338","heartbeat_back_addr":"172.21.15.165:6811/106338","heartbeat_front_addr":"172.21.15.165:6809/106338","state":["exists","up"]},{"osd":6,"uuid":"5b0aa305-5c22-41af-be0e-5a016917f986","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6804","nonce":106337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6806","nonce":106337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6810","nonce":106337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6808","nonce":106337}]},"public_addr":"172.21.15.165:6804/106337","cluster_addr":"172.21.15.165:6806/106337","heartbeat_back_addr":"172.21.15.165:6810/106337","heartbeat_front_addr":"172.21.15.165:6808/106337","state":["exists","up"]},{"osd":7,"uuid":"8f056f80-4270-4889-a165-e1071a1e12a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6812","nonce":106381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6813","nonce":106381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6815","nonce":106381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.165:6814","nonce":106381}]},"public_addr":"172.21.15.165:6812/106381","cluster_addr":"172.21.15.165:6813/106381","heartbeat_back_addr":"172.21.15.165:6815/106381","heartbeat_front_addr":"172.21.15.165:6814/106381","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:02.802799+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.088203+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.052611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.119189+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.168210+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.067234+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.174505+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T09:52:03.204033+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T09:52:09.664 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T09:52:09.665 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T09:52:09.665 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T09:52:09.666 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T09:52:09.667 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T09:52:09.667 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T09:52:09.668 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T09:52:09.669 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T09:52:09.948 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:09.948 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T09:52:09.956 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.957 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:52:09.958 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.959 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:52:09.981 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.981 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:52:09.982 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.983 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T09:52:09.984 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.985 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T09:52:09.987 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.988 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:52:09.999 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:09.999 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T09:52:10.561 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:10.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.2 2023-01-25T09:52:10.588 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:10.591 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:10.601 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:10.608 INFO:teuthology.orchestra.run.smithi085.stdout:60129542146 2023-01-25T09:52:10.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.4 2023-01-25T09:52:10.618 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:10.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.3 2023-01-25T09:52:10.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542146 for osd.6 2023-01-25T09:52:10.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542146 got 60129542146 for osd.5 2023-01-25T09:52:10.636 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:10.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.1 2023-01-25T09:52:10.639 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:10.639 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:10.649 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:10.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.7 2023-01-25T09:52:10.654 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:10.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.0 2023-01-25T09:52:10.664 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:11.582 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T09:52:11.616 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T09:52:11.627 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T09:52:11.629 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T09:52:11.956 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:11.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.2 2023-01-25T09:52:11.972 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:11.983 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:11.989 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:11.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.4 2023-01-25T09:52:11.998 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:12.004 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.3 2023-01-25T09:52:12.005 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:12.020 INFO:teuthology.orchestra.run.smithi085.stdout:60129542147 2023-01-25T09:52:12.034 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542147 got 60129542147 for osd.6 2023-01-25T09:52:12.034 DEBUG:teuthology.parallel:result is None 2023-01-25T09:52:12.034 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T09:52:12.035 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:52:12.383 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:12.386 INFO:teuthology.orchestra.run.smithi085.stderr:dumped all 2023-01-25T09:52:12.397 INFO:teuthology.orchestra.run.smithi085.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-01-25T09:52:10.491989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":42912,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":40064,"kb_avail":754931808,"statfs":{"total":773094113280,"available":773050171392,"internally_reserved":0,"allocated":2002944,"data_stored":1380303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41025536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:08.609779+0000","last_change":"2023-01-25T09:52:08.606947+0000","last_active":"2023-01-25T09:52:08.609779+0000","last_peered":"2023-01-25T09:52:08.609779+0000","last_clean":"2023-01-25T09:52:08.609779+0000","last_became_active":"2023-01-25T09:52:08.606708+0000","last_became_peered":"2023-01-25T09:52:08.606708+0000","last_unstale":"2023-01-25T09:52:08.609779+0000","last_undegraded":"2023-01-25T09:52:08.609779+0000","last_fullsized":"2023-01-25T09:52:08.609779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T18:48:56.362740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:08.601222+0000","last_change":"2023-01-25T09:52:08.600252+0000","last_active":"2023-01-25T09:52:08.601222+0000","last_peered":"2023-01-25T09:52:08.601222+0000","last_clean":"2023-01-25T09:52:08.601222+0000","last_became_active":"2023-01-25T09:52:08.600023+0000","last_became_peered":"2023-01-25T09:52:08.600023+0000","last_unstale":"2023-01-25T09:52:08.601222+0000","last_undegraded":"2023-01-25T09:52:08.601222+0000","last_fullsized":"2023-01-25T09:52:08.601222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T17:01:53.576170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599184+0000","last_change":"2023-01-25T09:52:08.956882+0000","last_active":"2023-01-25T09:52:09.599184+0000","last_peered":"2023-01-25T09:52:09.599184+0000","last_clean":"2023-01-25T09:52:09.599184+0000","last_became_active":"2023-01-25T09:52:08.956672+0000","last_became_peered":"2023-01-25T09:52:08.956672+0000","last_unstale":"2023-01-25T09:52:09.599184+0000","last_undegraded":"2023-01-25T09:52:09.599184+0000","last_fullsized":"2023-01-25T09:52:09.599184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:47:09.431502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599184+0000","last_change":"2023-01-25T09:52:08.600481+0000","last_active":"2023-01-25T09:52:09.599184+0000","last_peered":"2023-01-25T09:52:09.599184+0000","last_clean":"2023-01-25T09:52:09.599184+0000","last_became_active":"2023-01-25T09:52:08.600166+0000","last_became_peered":"2023-01-25T09:52:08.600166+0000","last_unstale":"2023-01-25T09:52:09.599184+0000","last_undegraded":"2023-01-25T09:52:09.599184+0000","last_fullsized":"2023-01-25T09:52:09.599184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T20:05:17.073583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599158+0000","last_change":"2023-01-25T09:52:07.595289+0000","last_active":"2023-01-25T09:52:09.599158+0000","last_peered":"2023-01-25T09:52:09.599158+0000","last_clean":"2023-01-25T09:52:09.599158+0000","last_became_active":"2023-01-25T09:52:07.594602+0000","last_became_peered":"2023-01-25T09:52:07.594602+0000","last_unstale":"2023-01-25T09:52:09.599158+0000","last_undegraded":"2023-01-25T09:52:09.599158+0000","last_fullsized":"2023-01-25T09:52:09.599158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:06.582197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:06.582197+0000","last_clean_scrub_stamp":"2023-01-25T09:52:06.582197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T12:14:35.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.598777+0000","last_change":"2023-01-25T09:52:08.600513+0000","last_active":"2023-01-25T09:52:09.598777+0000","last_peered":"2023-01-25T09:52:09.598777+0000","last_clean":"2023-01-25T09:52:09.598777+0000","last_became_active":"2023-01-25T09:52:08.600215+0000","last_became_peered":"2023-01-25T09:52:08.600215+0000","last_unstale":"2023-01-25T09:52:09.598777+0000","last_undegraded":"2023-01-25T09:52:09.598777+0000","last_fullsized":"2023-01-25T09:52:09.598777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T21:33:22.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.602088+0000","last_change":"2023-01-25T09:52:09.053605+0000","last_active":"2023-01-25T09:52:09.602088+0000","last_peered":"2023-01-25T09:52:09.602088+0000","last_clean":"2023-01-25T09:52:09.602088+0000","last_became_active":"2023-01-25T09:52:09.053342+0000","last_became_peered":"2023-01-25T09:52:09.053342+0000","last_unstale":"2023-01-25T09:52:09.602088+0000","last_undegraded":"2023-01-25T09:52:09.602088+0000","last_fullsized":"2023-01-25T09:52:09.602088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T16:34:12.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.598762+0000","last_change":"2023-01-25T09:52:08.600509+0000","last_active":"2023-01-25T09:52:09.598762+0000","last_peered":"2023-01-25T09:52:09.598762+0000","last_clean":"2023-01-25T09:52:09.598762+0000","last_became_active":"2023-01-25T09:52:08.600192+0000","last_became_peered":"2023-01-25T09:52:08.600192+0000","last_unstale":"2023-01-25T09:52:09.598762+0000","last_undegraded":"2023-01-25T09:52:09.598762+0000","last_fullsized":"2023-01-25T09:52:09.598762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:55:50.538935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:08.957192+0000","last_change":"2023-01-25T09:52:08.956738+0000","last_active":"2023-01-25T09:52:08.957192+0000","last_peered":"2023-01-25T09:52:08.957192+0000","last_clean":"2023-01-25T09:52:08.957192+0000","last_became_active":"2023-01-25T09:52:08.956497+0000","last_became_peered":"2023-01-25T09:52:08.956497+0000","last_unstale":"2023-01-25T09:52:08.957192+0000","last_undegraded":"2023-01-25T09:52:08.957192+0000","last_fullsized":"2023-01-25T09:52:08.957192+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T19:52:14.818643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6472,"kb_used_data":644,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365368,"statfs":{"total":96636764160,"available":96630136832,"internally_reserved":0,"allocated":659456,"data_stored":571902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":94208,"data_stored":38061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542147,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6420,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365420,"statfs":{"total":96636764160,"available":96630190080,"internally_reserved":0,"allocated":667648,"data_stored":568053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":44374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":94208,"data_stored":34979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542147,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4972,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366868,"statfs":{"total":96636764160,"available":96631672832,"internally_reserved":0,"allocated":102400,"data_stored":40017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542146,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4960,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366880,"statfs":{"total":96636764160,"available":96631685120,"internally_reserved":0,"allocated":90112,"data_stored":37790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:52:12.398 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T09:52:12.711 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:12.713 INFO:teuthology.orchestra.run.smithi085.stderr:dumped all 2023-01-25T09:52:12.724 INFO:teuthology.orchestra.run.smithi085.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2023-01-25T09:52:12.492408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":43016,"kb_used_data":1996,"kb_used_omap":0,"kb_used_meta":40128,"kb_avail":754931704,"statfs":{"total":773094113280,"available":773050064896,"internally_reserved":0,"allocated":2043904,"data_stored":1407727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41091072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000419"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.944482+0000","last_change":"2023-01-25T09:52:08.606947+0000","last_active":"2023-01-25T09:52:09.944482+0000","last_peered":"2023-01-25T09:52:09.944482+0000","last_clean":"2023-01-25T09:52:09.944482+0000","last_became_active":"2023-01-25T09:52:08.606708+0000","last_became_peered":"2023-01-25T09:52:08.606708+0000","last_unstale":"2023-01-25T09:52:09.944482+0000","last_undegraded":"2023-01-25T09:52:09.944482+0000","last_fullsized":"2023-01-25T09:52:09.944482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T18:48:56.362740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.925206+0000","last_change":"2023-01-25T09:52:08.600252+0000","last_active":"2023-01-25T09:52:09.925206+0000","last_peered":"2023-01-25T09:52:09.925206+0000","last_clean":"2023-01-25T09:52:09.925206+0000","last_became_active":"2023-01-25T09:52:08.600023+0000","last_became_peered":"2023-01-25T09:52:08.600023+0000","last_unstale":"2023-01-25T09:52:09.925206+0000","last_undegraded":"2023-01-25T09:52:09.925206+0000","last_fullsized":"2023-01-25T09:52:09.925206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T17:01:53.576170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599184+0000","last_change":"2023-01-25T09:52:08.956882+0000","last_active":"2023-01-25T09:52:09.599184+0000","last_peered":"2023-01-25T09:52:09.599184+0000","last_clean":"2023-01-25T09:52:09.599184+0000","last_became_active":"2023-01-25T09:52:08.956672+0000","last_became_peered":"2023-01-25T09:52:08.956672+0000","last_unstale":"2023-01-25T09:52:09.599184+0000","last_undegraded":"2023-01-25T09:52:09.599184+0000","last_fullsized":"2023-01-25T09:52:09.599184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:47:09.431502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599184+0000","last_change":"2023-01-25T09:52:08.600481+0000","last_active":"2023-01-25T09:52:09.599184+0000","last_peered":"2023-01-25T09:52:09.599184+0000","last_clean":"2023-01-25T09:52:09.599184+0000","last_became_active":"2023-01-25T09:52:08.600166+0000","last_became_peered":"2023-01-25T09:52:08.600166+0000","last_unstale":"2023-01-25T09:52:09.599184+0000","last_undegraded":"2023-01-25T09:52:09.599184+0000","last_fullsized":"2023-01-25T09:52:09.599184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T20:05:17.073583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.599158+0000","last_change":"2023-01-25T09:52:07.595289+0000","last_active":"2023-01-25T09:52:09.599158+0000","last_peered":"2023-01-25T09:52:09.599158+0000","last_clean":"2023-01-25T09:52:09.599158+0000","last_became_active":"2023-01-25T09:52:07.594602+0000","last_became_peered":"2023-01-25T09:52:07.594602+0000","last_unstale":"2023-01-25T09:52:09.599158+0000","last_undegraded":"2023-01-25T09:52:09.599158+0000","last_fullsized":"2023-01-25T09:52:09.599158+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:06.582197+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:06.582197+0000","last_clean_scrub_stamp":"2023-01-25T09:52:06.582197+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T12:14:35.620622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.598777+0000","last_change":"2023-01-25T09:52:08.600513+0000","last_active":"2023-01-25T09:52:09.598777+0000","last_peered":"2023-01-25T09:52:09.598777+0000","last_clean":"2023-01-25T09:52:09.598777+0000","last_became_active":"2023-01-25T09:52:08.600215+0000","last_became_peered":"2023-01-25T09:52:08.600215+0000","last_unstale":"2023-01-25T09:52:09.598777+0000","last_undegraded":"2023-01-25T09:52:09.598777+0000","last_fullsized":"2023-01-25T09:52:09.598777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T21:33:22.195351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.602088+0000","last_change":"2023-01-25T09:52:09.053605+0000","last_active":"2023-01-25T09:52:09.602088+0000","last_peered":"2023-01-25T09:52:09.602088+0000","last_clean":"2023-01-25T09:52:09.602088+0000","last_became_active":"2023-01-25T09:52:09.053342+0000","last_became_peered":"2023-01-25T09:52:09.053342+0000","last_unstale":"2023-01-25T09:52:09.602088+0000","last_undegraded":"2023-01-25T09:52:09.602088+0000","last_fullsized":"2023-01-25T09:52:09.602088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T16:34:12.667275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.598762+0000","last_change":"2023-01-25T09:52:08.600509+0000","last_active":"2023-01-25T09:52:09.598762+0000","last_peered":"2023-01-25T09:52:09.598762+0000","last_clean":"2023-01-25T09:52:09.598762+0000","last_became_active":"2023-01-25T09:52:08.600192+0000","last_became_peered":"2023-01-25T09:52:08.600192+0000","last_unstale":"2023-01-25T09:52:09.598762+0000","last_undegraded":"2023-01-25T09:52:09.598762+0000","last_fullsized":"2023-01-25T09:52:09.598762+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T14:55:50.538935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-01-25T09:52:09.925191+0000","last_change":"2023-01-25T09:52:08.956738+0000","last_active":"2023-01-25T09:52:09.925191+0000","last_peered":"2023-01-25T09:52:09.925191+0000","last_clean":"2023-01-25T09:52:09.925191+0000","last_became_active":"2023-01-25T09:52:08.956497+0000","last_became_peered":"2023-01-25T09:52:08.956497+0000","last_unstale":"2023-01-25T09:52:09.925191+0000","last_undegraded":"2023-01-25T09:52:09.925191+0000","last_fullsized":"2023-01-25T09:52:09.925191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T09:52:07.583736+0000","last_clean_scrub_stamp":"2023-01-25T09:52:07.583736+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T19:52:14.818643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6480,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365360,"statfs":{"total":96636764160,"available":96630128640,"internally_reserved":0,"allocated":667648,"data_stored":576530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4964,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366876,"statfs":{"total":96636764160,"available":96631681024,"internally_reserved":0,"allocated":94208,"data_stored":38061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5080,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366760,"statfs":{"total":96636764160,"available":96631562240,"internally_reserved":0,"allocated":147456,"data_stored":45127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6432,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":5376,"kb_avail":94365408,"statfs":{"total":96636764160,"available":96630177792,"internally_reserved":0,"allocated":679936,"data_stored":577137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5505024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.6210000000000004}]}]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5084,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366756,"statfs":{"total":96636764160,"available":96631558144,"internally_reserved":0,"allocated":151552,"data_stored":48420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4972,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366868,"statfs":{"total":96636764160,"available":96631672832,"internally_reserved":0,"allocated":102400,"data_stored":40017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4972,"kb_used_data":100,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366868,"statfs":{"total":96636764160,"available":96631672832,"internally_reserved":0,"allocated":102400,"data_stored":40017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542147,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":98304,"data_stored":42418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T09:52:12.726 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T09:52:12.726 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T09:52:12.726 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T09:52:12.727 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T09:52:13.075 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T09:52:13.076 INFO:teuthology.orchestra.run.smithi085.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T09:52:13.089 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T09:52:13.090 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T09:52:13.100 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T09:52:13.100 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:52:13.101 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2023-01-25T09:52:13.412 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2023-01-25T09:52:13.413 INFO:teuthology.orchestra.run.smithi085.stdout: "active": true, 2023-01-25T09:52:13.413 INFO:teuthology.orchestra.run.smithi085.stdout: "last_optimize_duration": "0:00:00.000543", 2023-01-25T09:52:13.413 INFO:teuthology.orchestra.run.smithi085.stdout: "last_optimize_started": "Wed Jan 25 09:52:00 2023", 2023-01-25T09:52:13.413 INFO:teuthology.orchestra.run.smithi085.stdout: "mode": "upmap", 2023-01-25T09:52:13.414 INFO:teuthology.orchestra.run.smithi085.stdout: "no_optimization_needed": false, 2023-01-25T09:52:13.414 INFO:teuthology.orchestra.run.smithi085.stdout: "optimize_result": "No pools available", 2023-01-25T09:52:13.414 INFO:teuthology.orchestra.run.smithi085.stdout: "plans": [] 2023-01-25T09:52:13.414 INFO:teuthology.orchestra.run.smithi085.stdout:} 2023-01-25T09:52:13.426 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2023-01-25T09:52:14.622 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:14.617+0000 7f3458fcf700 -1 osd.4 19 handle_osd_map injecting map crc failure 2023-01-25T09:52:14.647 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2023-01-25T09:52:14.974 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T09:52:14.982 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T09:52:14.983 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T09:52:14.983 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create base 4' 2023-01-25T09:52:16.117 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:16.112+0000 7ff541020700 -1 osd.0 20 handle_osd_map injecting map crc failure 2023-01-25T09:52:16.125 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'base' created 2023-01-25T09:52:16.138 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool application enable base rados' 2023-01-25T09:52:17.126 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:17.121+0000 7fc657744700 -1 osd.1 21 handle_osd_map injecting map crc failure 2023-01-25T09:52:17.130 INFO:teuthology.orchestra.run.smithi085.stderr:enabled application 'rados' on pool 'base' 2023-01-25T09:52:17.144 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-01-25T09:52:17.806 INFO:tasks.ceph.osd.5.smithi165.stderr:2023-01-25T09:52:17.801+0000 7fd08bfa9700 -1 osd.5 21 handle_osd_map injecting map crc failure 2023-01-25T09:52:18.132 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'cache' created 2023-01-25T09:52:18.146 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add base cache' 2023-01-25T09:52:19.136 INFO:tasks.ceph.osd.4.smithi165.stderr:2023-01-25T09:52:19.131+0000 7f3458fcf700 -1 osd.4 23 handle_osd_map injecting map crc failure 2023-01-25T09:52:19.137 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'cache' is now (or already was) a tier of 'base' 2023-01-25T09:52:19.153 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-01-25T09:52:20.143 INFO:teuthology.orchestra.run.smithi085.stderr:set cache-mode for pool 'cache' to writeback 2023-01-25T09:52:20.155 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay base cache' 2023-01-25T09:52:20.756 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T09:52:20.751+0000 7ff53f01c700 -1 osd.0 24 handle_osd_map injecting map crc failure 2023-01-25T09:52:21.148 INFO:teuthology.orchestra.run.smithi085.stderr:overlay for 'base' is now (or already was) 'cache' 2023-01-25T09:52:21.161 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-01-25T09:52:21.888 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T09:52:21.882+0000 7fb7fa8e0700 -1 osd.3 25 handle_osd_map injecting map crc failure 2023-01-25T09:52:22.152 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_type to bloom 2023-01-25T09:52:22.165 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-01-25T09:52:23.158 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_count to 8 2023-01-25T09:52:23.171 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 3600' 2023-01-25T09:52:24.160 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_period to 3600 2023-01-25T09:52:24.173 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache min_read_recency_for_promote 0' 2023-01-25T09:52:24.857 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T09:52:24.852+0000 7fc655740700 -1 osd.1 26 handle_osd_map injecting map crc failure 2023-01-25T09:52:25.172 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 min_read_recency_for_promote to 0 2023-01-25T09:52:25.185 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache min_write_recency_for_promote 0' 2023-01-25T09:52:26.176 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 min_write_recency_for_promote to 0 2023-01-25T09:52:26.189 INFO:teuthology.run_tasks:Running task rados... 2023-01-25T09:52:26.205 INFO:tasks.rados:Beginning rados... 2023-01-25T09:52:26.206 DEBUG:teuthology.run_tasks:Unwinding manager rados 2023-01-25T09:52:26.224 INFO:tasks.rados:joining rados 2023-01-25T09:52:26.225 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2023-01-25T09:52:26.225 INFO:tasks.rados:starting run 0 out of 1 2023-01-25T09:52:26.225 DEBUG:teuthology.orchestra.run.smithi085:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op cache_flush 50 --op cache_try_flush 50 --op cache_evict 50 --op write_excl 50 --pool base 2023-01-25T09:52:26.258 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight read -> 100 2023-01-25T09:52:26.258 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight write -> 50 2023-01-25T09:52:26.258 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight delete -> 50 2023-01-25T09:52:26.258 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight copy_from -> 50 2023-01-25T09:52:26.259 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_flush -> 50 2023-01-25T09:52:26.259 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_try_flush -> 50 2023-01-25T09:52:26.260 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_evict -> 50 2023-01-25T09:52:26.260 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight write_excl -> 50 2023-01-25T09:52:26.260 INFO:tasks.rados.rados.0.smithi085.stdout:ceph version 18.0.0-1986-g44e4095d (44e4095da12a8269eb6cfe163cbb0d00b1a6412c) reef (dev) 2023-01-25T09:52:26.260 INFO:tasks.rados.rados.0.smithi085.stdout:Configuration: 2023-01-25T09:52:26.261 INFO:tasks.rados.rados.0.smithi085.stdout: Number of operations: 4000 2023-01-25T09:52:26.261 INFO:tasks.rados.rados.0.smithi085.stdout: Number of objects: 500 2023-01-25T09:52:26.261 INFO:tasks.rados.rados.0.smithi085.stdout: Max in flight operations: 16 2023-01-25T09:52:26.261 INFO:tasks.rados.rados.0.smithi085.stdout: Object size (in bytes): 4000000 2023-01-25T09:52:26.261 INFO:tasks.rados.rados.0.smithi085.stdout: Write stride min: 400000 2023-01-25T09:52:26.262 INFO:tasks.rados.rados.0.smithi085.stdout: Write stride max: 800000 2023-01-25T09:52:27.173 INFO:tasks.ceph.osd.7.smithi165.stderr:2023-01-25T09:52:27.168+0000 7f3926f14700 -1 osd.7 31 handle_osd_map injecting map crc failure 2023-01-25T09:52:27.175 INFO:tasks.rados.rados.0.smithi085.stdout:1: write initial oid 1 2023-01-25T09:52:27.175 INFO:tasks.rados.rados.0.smithi085.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2023-01-25T09:52:27.180 INFO:tasks.rados.rados.0.smithi085.stdout:1: writing smithi085112025-1 from 416807 to 892056 tid 1 2023-01-25T09:52:27.187 INFO:tasks.rados.rados.0.smithi085.stdout:1: writing smithi085112025-1 from 1542129 to 2016807 tid 2 2023-01-25T09:52:27.187 INFO:tasks.rados.rados.0.smithi085.stdout:2: write initial oid 2 2023-01-25T09:52:27.187 INFO:tasks.rados.rados.0.smithi085.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2023-01-25T09:52:27.191 INFO:tasks.rados.rados.0.smithi085.stdout:2: writing smithi085112025-2 from 416807 to 892056 tid 1 2023-01-25T09:52:27.198 INFO:tasks.rados.rados.0.smithi085.stdout:2: writing smithi085112025-2 from 1542129 to 2016807 tid 2 2023-01-25T09:52:27.199 INFO:tasks.rados.rados.0.smithi085.stdout:3: write initial oid 3 2023-01-25T09:52:27.199 INFO:tasks.rados.rados.0.smithi085.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2023-01-25T09:52:27.204 INFO:tasks.rados.rados.0.smithi085.stdout:3: writing smithi085112025-3 from 433614 to 984112 tid 1 2023-01-25T09:52:27.210 INFO:tasks.rados.rados.0.smithi085.stdout:3: writing smithi085112025-3 from 1600611 to 2033614 tid 2 2023-01-25T09:52:27.210 INFO:tasks.rados.rados.0.smithi085.stdout:4: write initial oid 4 2023-01-25T09:52:27.210 INFO:tasks.rados.rados.0.smithi085.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2023-01-25T09:52:27.216 INFO:tasks.rados.rados.0.smithi085.stdout:4: writing smithi085112025-4 from 450421 to 1076168 tid 1 2023-01-25T09:52:27.221 INFO:tasks.rados.rados.0.smithi085.stdout:4: writing smithi085112025-4 from 1659093 to 2050421 tid 2 2023-01-25T09:52:27.221 INFO:tasks.rados.rados.0.smithi085.stdout:5: write initial oid 5 2023-01-25T09:52:27.222 INFO:tasks.rados.rados.0.smithi085.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2023-01-25T09:52:27.228 INFO:tasks.rados.rados.0.smithi085.stdout:5: writing smithi085112025-5 from 467228 to 1168224 tid 1 2023-01-25T09:52:27.233 INFO:tasks.rados.rados.0.smithi085.stdout:5: writing smithi085112025-5 from 1717575 to 2067228 tid 2 2023-01-25T09:52:27.233 INFO:tasks.rados.rados.0.smithi085.stdout:6: write initial oid 6 2023-01-25T09:52:27.234 INFO:tasks.rados.rados.0.smithi085.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2023-01-25T09:52:27.240 INFO:tasks.rados.rados.0.smithi085.stdout:6: writing smithi085112025-6 from 484035 to 1260280 tid 1 2023-01-25T09:52:27.245 INFO:tasks.rados.rados.0.smithi085.stdout:6: writing smithi085112025-6 from 2059704 to 2084035 tid 2 2023-01-25T09:52:27.246 INFO:tasks.rados.rados.0.smithi085.stdout:7: write initial oid 7 2023-01-25T09:52:27.246 INFO:tasks.rados.rados.0.smithi085.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2023-01-25T09:52:27.251 INFO:tasks.rados.rados.0.smithi085.stdout:7: writing smithi085112025-7 from 500842 to 952336 tid 1 2023-01-25T09:52:27.258 INFO:tasks.rados.rados.0.smithi085.stdout:7: writing smithi085112025-7 from 1718186 to 2100842 tid 2 2023-01-25T09:52:27.258 INFO:tasks.rados.rados.0.smithi085.stdout:8: write initial oid 8 2023-01-25T09:52:27.259 INFO:tasks.rados.rados.0.smithi085.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2023-01-25T09:52:27.263 INFO:tasks.rados.rados.0.smithi085.stdout:8: writing smithi085112025-8 from 517649 to 1044392 tid 1 2023-01-25T09:52:27.270 INFO:tasks.rados.rados.0.smithi085.stdout:8: writing smithi085112025-8 from 1776668 to 2117649 tid 2 2023-01-25T09:52:27.270 INFO:tasks.rados.rados.0.smithi085.stdout:9: write initial oid 9 2023-01-25T09:52:27.270 INFO:tasks.rados.rados.0.smithi085.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2023-01-25T09:52:27.277 INFO:tasks.rados.rados.0.smithi085.stdout:9: writing smithi085112025-9 from 534456 to 1252801 tid 1 2023-01-25T09:52:27.282 INFO:tasks.rados.rados.0.smithi085.stdout:9: writing smithi085112025-9 from 1951503 to 2134456 tid 2 2023-01-25T09:52:27.282 INFO:tasks.rados.rados.0.smithi085.stdout:10: write initial oid 10 2023-01-25T09:52:27.282 INFO:tasks.rados.rados.0.smithi085.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2023-01-25T09:52:27.289 INFO:tasks.rados.rados.0.smithi085.stdout:10: writing smithi085112025-10 from 551263 to 1344857 tid 1 2023-01-25T09:52:27.294 INFO:tasks.rados.rados.0.smithi085.stdout:10: writing smithi085112025-10 from 1893632 to 2151263 tid 2 2023-01-25T09:52:27.294 INFO:tasks.rados.rados.0.smithi085.stdout:11: write initial oid 11 2023-01-25T09:52:27.294 INFO:tasks.rados.rados.0.smithi085.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2023-01-25T09:52:27.300 INFO:tasks.rados.rados.0.smithi085.stdout:11: writing smithi085112025-11 from 568070 to 1036913 tid 1 2023-01-25T09:52:27.307 INFO:tasks.rados.rados.0.smithi085.stdout:11: writing smithi085112025-11 from 1552114 to 2168070 tid 2 2023-01-25T09:52:27.307 INFO:tasks.rados.rados.0.smithi085.stdout:12: write initial oid 12 2023-01-25T09:52:27.307 INFO:tasks.rados.rados.0.smithi085.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2023-01-25T09:52:27.314 INFO:tasks.rados.rados.0.smithi085.stdout:12: writing smithi085112025-12 from 584877 to 1128969 tid 1 2023-01-25T09:52:27.319 INFO:tasks.rados.rados.0.smithi085.stdout:12: writing smithi085112025-12 from 1610596 to 2172599 tid 2 2023-01-25T09:52:27.319 INFO:tasks.rados.rados.0.smithi085.stdout:13: write initial oid 13 2023-01-25T09:52:27.319 INFO:tasks.rados.rados.0.smithi085.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2023-01-25T09:52:27.326 INFO:tasks.rados.rados.0.smithi085.stdout:13: writing smithi085112025-13 from 601684 to 1221025 tid 1 2023-01-25T09:52:27.331 INFO:tasks.rados.rados.0.smithi085.stdout:13: writing smithi085112025-13 from 1669078 to 2201684 tid 2 2023-01-25T09:52:27.332 INFO:tasks.rados.rados.0.smithi085.stdout:14: write initial oid 14 2023-01-25T09:52:27.333 INFO:tasks.rados.rados.0.smithi085.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2023-01-25T09:52:27.339 INFO:tasks.rados.rados.0.smithi085.stdout:14: writing smithi085112025-14 from 618491 to 1313081 tid 1 2023-01-25T09:52:27.344 INFO:tasks.rados.rados.0.smithi085.stdout:14: writing smithi085112025-14 from 2011207 to 2218491 tid 2 2023-01-25T09:52:27.344 INFO:tasks.rados.rados.0.smithi085.stdout:15: write initial oid 15 2023-01-25T09:52:27.344 INFO:tasks.rados.rados.0.smithi085.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2023-01-25T09:52:27.351 INFO:tasks.rados.rados.0.smithi085.stdout:15: writing smithi085112025-15 from 635298 to 1405137 tid 1 2023-01-25T09:52:27.356 INFO:tasks.rados.rados.0.smithi085.stdout:15: writing smithi085112025-15 from 2069689 to 2235298 tid 2 2023-01-25T09:52:27.356 INFO:tasks.rados.rados.0.smithi085.stdout:16: write initial oid 16 2023-01-25T09:52:27.357 INFO:tasks.rados.rados.0.smithi085.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2023-01-25T09:52:27.362 INFO:tasks.rados.rados.0.smithi085.stdout:16: writing smithi085112025-16 from 652105 to 1097193 tid 1 2023-01-25T09:52:27.369 INFO:tasks.rados.rados.0.smithi085.stdout:16: writing smithi085112025-16 from 1728171 to 2181159 tid 2 2023-01-25T09:52:27.370 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.370 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 1 to smithi085112025-2 2023-01-25T09:52:27.370 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 2 to smithi085112025-2 2023-01-25T09:52:27.370 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 3 to smithi085112025-2 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 4 to smithi085112025-2 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 0 to 1 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 1 to 2 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 2 to 3 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2023-01-25T09:52:27.371 INFO:tasks.rados.rados.0.smithi085.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2023-01-25T09:52:27.372 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 1 to smithi085112025-3 2023-01-25T09:52:27.372 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 2 to smithi085112025-3 2023-01-25T09:52:27.372 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 3 to smithi085112025-3 2023-01-25T09:52:27.372 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 4 to smithi085112025-3 2023-01-25T09:52:27.372 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 updating version 0 to 3 2023-01-25T09:52:27.373 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 version 3 is already newer than 2 2023-01-25T09:52:27.373 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 version 3 is already newer than 1 2023-01-25T09:52:27.373 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2023-01-25T09:52:27.373 INFO:tasks.rados.rados.0.smithi085.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2023-01-25T09:52:27.373 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 1 to smithi085112025-5 2023-01-25T09:52:27.374 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 2 to smithi085112025-5 2023-01-25T09:52:27.374 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 3 to smithi085112025-5 2023-01-25T09:52:27.374 INFO:tasks.rados.rados.0.smithi085.stdout:2: done (15 left) 2023-01-25T09:52:27.374 INFO:tasks.rados.rados.0.smithi085.stdout:3: done (14 left) 2023-01-25T09:52:27.374 INFO:tasks.rados.rados.0.smithi085.stdout:17: write initial oid 17 2023-01-25T09:52:27.375 INFO:tasks.rados.rados.0.smithi085.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2023-01-25T09:52:27.376 INFO:tasks.rados.rados.0.smithi085.stdout:17: writing smithi085112025-17 from 668912 to 1305602 tid 1 2023-01-25T09:52:27.382 INFO:tasks.rados.rados.0.smithi085.stdout:17: writing smithi085112025-17 from 1903006 to 2268912 tid 2 2023-01-25T09:52:27.382 INFO:tasks.rados.rados.0.smithi085.stdout:18: write initial oid 18 2023-01-25T09:52:27.382 INFO:tasks.rados.rados.0.smithi085.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2023-01-25T09:52:27.390 INFO:tasks.rados.rados.0.smithi085.stdout:18: writing smithi085112025-18 from 685719 to 1397658 tid 1 2023-01-25T09:52:27.396 INFO:tasks.rados.rados.0.smithi085.stdout:18: writing smithi085112025-18 from 1845135 to 2285719 tid 2 2023-01-25T09:52:27.396 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.396 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 4 to smithi085112025-5 2023-01-25T09:52:27.397 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 updating version 0 to 2 2023-01-25T09:52:27.397 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 updating version 2 to 6 2023-01-25T09:52:27.397 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 version 6 is already newer than 5 2023-01-25T09:52:27.397 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 5 v 6 (ObjNum 4 snap 0 seq_num 4) dirty exists 2023-01-25T09:52:27.397 INFO:tasks.rados.rados.0.smithi085.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2023-01-25T09:52:27.398 INFO:tasks.rados.rados.0.smithi085.stdout:5: done (15 left) 2023-01-25T09:52:27.398 INFO:tasks.rados.rados.0.smithi085.stdout:19: write initial oid 19 2023-01-25T09:52:27.398 INFO:tasks.rados.rados.0.smithi085.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2023-01-25T09:52:27.404 INFO:tasks.rados.rados.0.smithi085.stdout:19: writing smithi085112025-19 from 702526 to 1489714 tid 1 2023-01-25T09:52:27.410 INFO:tasks.rados.rados.0.smithi085.stdout:19: writing smithi085112025-19 from 1903617 to 2302526 tid 2 2023-01-25T09:52:27.410 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.410 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 1 to smithi085112025-6 2023-01-25T09:52:27.411 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 1 to smithi085112025-7 2023-01-25T09:52:27.411 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 2 to smithi085112025-6 2023-01-25T09:52:27.411 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 3 to smithi085112025-6 2023-01-25T09:52:27.411 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 4 to smithi085112025-6 2023-01-25T09:52:27.411 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 updating version 0 to 3 2023-01-25T09:52:27.412 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 version 3 is already newer than 1 2023-01-25T09:52:27.412 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 version 3 is already newer than 2 2023-01-25T09:52:27.412 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 6 v 3 (ObjNum 5 snap 0 seq_num 5) dirty exists 2023-01-25T09:52:27.412 INFO:tasks.rados.rados.0.smithi085.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2023-01-25T09:52:27.412 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 2 to smithi085112025-7 2023-01-25T09:52:27.413 INFO:tasks.rados.rados.0.smithi085.stdout:6: done (15 left) 2023-01-25T09:52:27.413 INFO:tasks.rados.rados.0.smithi085.stdout:20: write initial oid 20 2023-01-25T09:52:27.413 INFO:tasks.rados.rados.0.smithi085.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2023-01-25T09:52:27.416 INFO:tasks.rados.rados.0.smithi085.stdout:20: writing smithi085112025-20 from 719333 to 1181770 tid 1 2023-01-25T09:52:27.423 INFO:tasks.rados.rados.0.smithi085.stdout:20: writing smithi085112025-20 from 1962099 to 2319333 tid 2 2023-01-25T09:52:27.424 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.424 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 3 to smithi085112025-7 2023-01-25T09:52:27.424 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 4 to smithi085112025-7 2023-01-25T09:52:27.424 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 updating version 0 to 3 2023-01-25T09:52:27.425 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 updating version 3 to 9 2023-01-25T09:52:27.425 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 version 9 is already newer than 8 2023-01-25T09:52:27.425 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 7 v 9 (ObjNum 6 snap 0 seq_num 6) dirty exists 2023-01-25T09:52:27.425 INFO:tasks.rados.rados.0.smithi085.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2023-01-25T09:52:27.425 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 1 to smithi085112025-8 2023-01-25T09:52:27.426 INFO:tasks.rados.rados.0.smithi085.stdout:7: done (15 left) 2023-01-25T09:52:27.426 INFO:tasks.rados.rados.0.smithi085.stdout:21: write initial oid 21 2023-01-25T09:52:27.426 INFO:tasks.rados.rados.0.smithi085.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2023-01-25T09:52:27.430 INFO:tasks.rados.rados.0.smithi085.stdout:21: writing smithi085112025-21 from 736140 to 1273826 tid 1 2023-01-25T09:52:27.437 INFO:tasks.rados.rados.0.smithi085.stdout:21: writing smithi085112025-21 from 2020581 to 2336140 tid 2 2023-01-25T09:52:27.437 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.437 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 2 to smithi085112025-8 2023-01-25T09:52:27.438 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 3 to smithi085112025-8 2023-01-25T09:52:27.438 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 4 to smithi085112025-8 2023-01-25T09:52:27.438 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 0 to 2 2023-01-25T09:52:27.438 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 2 to 5 2023-01-25T09:52:27.438 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 5 to 6 2023-01-25T09:52:27.439 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 8 v 6 (ObjNum 7 snap 0 seq_num 7) dirty exists 2023-01-25T09:52:27.439 INFO:tasks.rados.rados.0.smithi085.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2023-01-25T09:52:27.439 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 1 to smithi085112025-10 2023-01-25T09:52:27.439 INFO:tasks.rados.rados.0.smithi085.stdout:8: done (15 left) 2023-01-25T09:52:27.439 INFO:tasks.rados.rados.0.smithi085.stdout:22: write initial oid 22 2023-01-25T09:52:27.440 INFO:tasks.rados.rados.0.smithi085.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2023-01-25T09:52:27.444 INFO:tasks.rados.rados.0.smithi085.stdout:22: writing smithi085112025-22 from 752947 to 1365882 tid 1 2023-01-25T09:52:27.450 INFO:tasks.rados.rados.0.smithi085.stdout:22: writing smithi085112025-22 from 1962710 to 2352947 tid 2 2023-01-25T09:52:27.450 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.450 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 1 to smithi085112025-11 2023-01-25T09:52:27.450 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 2 to smithi085112025-10 2023-01-25T09:52:27.451 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 3 to smithi085112025-10 2023-01-25T09:52:27.451 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 4 to smithi085112025-10 2023-01-25T09:52:27.451 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 updating version 0 to 2 2023-01-25T09:52:27.451 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 updating version 2 to 6 2023-01-25T09:52:27.451 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 version 6 is already newer than 5 2023-01-25T09:52:27.452 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 10 v 6 (ObjNum 9 snap 0 seq_num 9) dirty exists 2023-01-25T09:52:27.452 INFO:tasks.rados.rados.0.smithi085.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2023-01-25T09:52:27.452 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 2 to smithi085112025-11 2023-01-25T09:52:27.452 INFO:tasks.rados.rados.0.smithi085.stdout:10: done (15 left) 2023-01-25T09:52:27.452 INFO:tasks.rados.rados.0.smithi085.stdout:23: write initial oid 23 2023-01-25T09:52:27.453 INFO:tasks.rados.rados.0.smithi085.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2023-01-25T09:52:27.457 INFO:tasks.rados.rados.0.smithi085.stdout:23: writing smithi085112025-23 from 769754 to 1457938 tid 1 2023-01-25T09:52:27.463 INFO:tasks.rados.rados.0.smithi085.stdout:23: writing smithi085112025-23 from 2021192 to 2369754 tid 2 2023-01-25T09:52:27.463 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 3 to smithi085112025-11 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 4 to smithi085112025-11 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 updating version 0 to 3 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 updating version 3 to 8 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 updating version 8 to 9 2023-01-25T09:52:27.464 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 11 v 9 (ObjNum 10 snap 0 seq_num 10) dirty exists 2023-01-25T09:52:27.465 INFO:tasks.rados.rados.0.smithi085.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2023-01-25T09:52:27.465 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 1 to smithi085112025-12 2023-01-25T09:52:27.465 INFO:tasks.rados.rados.0.smithi085.stdout:11: done (15 left) 2023-01-25T09:52:27.465 INFO:tasks.rados.rados.0.smithi085.stdout:24: write initial oid 24 2023-01-25T09:52:27.465 INFO:tasks.rados.rados.0.smithi085.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2023-01-25T09:52:27.470 INFO:tasks.rados.rados.0.smithi085.stdout:24: writing smithi085112025-24 from 786561 to 1266347 tid 1 2023-01-25T09:52:27.476 INFO:tasks.rados.rados.0.smithi085.stdout:24: writing smithi085112025-24 from 1796027 to 2263691 tid 2 2023-01-25T09:52:27.476 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.476 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 2 to smithi085112025-12 2023-01-25T09:52:27.476 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 3 to smithi085112025-12 2023-01-25T09:52:27.477 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 4 to smithi085112025-12 2023-01-25T09:52:27.477 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 updating version 0 to 12 2023-01-25T09:52:27.477 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 version 12 is already newer than 4 2023-01-25T09:52:27.477 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 version 12 is already newer than 11 2023-01-25T09:52:27.477 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 12 v 12 (ObjNum 11 snap 0 seq_num 11) dirty exists 2023-01-25T09:52:27.478 INFO:tasks.rados.rados.0.smithi085.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2023-01-25T09:52:27.478 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 1 to smithi085112025-15 2023-01-25T09:52:27.478 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 1 to smithi085112025-16 2023-01-25T09:52:27.478 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 2 to smithi085112025-15 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 3 to smithi085112025-15 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 4 to smithi085112025-15 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 updating version 0 to 14 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 version 14 is already newer than 5 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 updating version 14 to 15 2023-01-25T09:52:27.479 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 15 v 15 (ObjNum 14 snap 0 seq_num 14) dirty exists 2023-01-25T09:52:27.480 INFO:tasks.rados.rados.0.smithi085.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2023-01-25T09:52:27.480 INFO:tasks.rados.rados.0.smithi085.stdout:12: done (15 left) 2023-01-25T09:52:27.480 INFO:tasks.rados.rados.0.smithi085.stdout:15: done (14 left) 2023-01-25T09:52:27.480 INFO:tasks.rados.rados.0.smithi085.stdout:25: write initial oid 25 2023-01-25T09:52:27.480 INFO:tasks.rados.rados.0.smithi085.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2023-01-25T09:52:27.481 INFO:tasks.rados.rados.0.smithi085.stdout:25: writing smithi085112025-25 from 403368 to 958403 tid 1 2023-01-25T09:52:27.488 INFO:tasks.rados.rados.0.smithi085.stdout:25: writing smithi085112025-25 from 1454509 to 2182184 tid 2 2023-01-25T09:52:27.488 INFO:tasks.rados.rados.0.smithi085.stdout:26: write initial oid 26 2023-01-25T09:52:27.488 INFO:tasks.rados.rados.0.smithi085.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2023-01-25T09:52:27.494 INFO:tasks.rados.rados.0.smithi085.stdout:26: writing smithi085112025-26 from 420175 to 1050459 tid 1 2023-01-25T09:52:27.501 INFO:tasks.rados.rados.0.smithi085.stdout:26: writing smithi085112025-26 from 1796638 to 2267971 tid 2 2023-01-25T09:52:27.502 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.502 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 2 to smithi085112025-16 2023-01-25T09:52:27.503 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 3 to smithi085112025-16 2023-01-25T09:52:27.503 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 4 to smithi085112025-16 2023-01-25T09:52:27.503 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 updating version 0 to 8 2023-01-25T09:52:27.503 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 version 8 is already newer than 3 2023-01-25T09:52:27.503 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 updating version 8 to 9 2023-01-25T09:52:27.504 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 16 v 9 (ObjNum 15 snap 0 seq_num 15) dirty exists 2023-01-25T09:52:27.504 INFO:tasks.rados.rados.0.smithi085.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2023-01-25T09:52:27.504 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 1 to smithi085112025-17 2023-01-25T09:52:27.504 INFO:tasks.rados.rados.0.smithi085.stdout:16: done (15 left) 2023-01-25T09:52:27.505 INFO:tasks.rados.rados.0.smithi085.stdout:27: write initial oid 27 2023-01-25T09:52:27.505 INFO:tasks.rados.rados.0.smithi085.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2023-01-25T09:52:27.507 INFO:tasks.rados.rados.0.smithi085.stdout:27: writing smithi085112025-27 from 436982 to 1142515 tid 1 2023-01-25T09:52:27.515 INFO:tasks.rados.rados.0.smithi085.stdout:27: writing smithi085112025-27 from 1855120 to 2436982 tid 2 2023-01-25T09:52:27.516 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.516 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 2 to smithi085112025-17 2023-01-25T09:52:27.516 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 3 to smithi085112025-17 2023-01-25T09:52:27.517 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 4 to smithi085112025-17 2023-01-25T09:52:27.517 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 updating version 0 to 18 2023-01-25T09:52:27.517 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 version 18 is already newer than 17 2023-01-25T09:52:27.517 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 version 18 is already newer than 6 2023-01-25T09:52:27.517 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 17 v 18 (ObjNum 16 snap 0 seq_num 16) dirty exists 2023-01-25T09:52:27.518 INFO:tasks.rados.rados.0.smithi085.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2023-01-25T09:52:27.518 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 1 to smithi085112025-1 2023-01-25T09:52:27.518 INFO:tasks.rados.rados.0.smithi085.stdout:17: done (15 left) 2023-01-25T09:52:27.518 INFO:tasks.rados.rados.0.smithi085.stdout:28: write initial oid 28 2023-01-25T09:52:27.518 INFO:tasks.rados.rados.0.smithi085.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2023-01-25T09:52:27.521 INFO:tasks.rados.rados.0.smithi085.stdout:28: writing smithi085112025-28 from 453789 to 1234571 tid 1 2023-01-25T09:52:27.529 INFO:tasks.rados.rados.0.smithi085.stdout:28: writing smithi085112025-28 from 1913602 to 2388604 tid 2 2023-01-25T09:52:27.529 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.530 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 1 to smithi085112025-18 2023-01-25T09:52:27.530 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 1 to smithi085112025-4 2023-01-25T09:52:27.530 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 1 to smithi085112025-9 2023-01-25T09:52:27.531 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 1 to smithi085112025-13 2023-01-25T09:52:27.531 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 2 to smithi085112025-1 2023-01-25T09:52:27.531 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 3 to smithi085112025-1 2023-01-25T09:52:27.532 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 4 to smithi085112025-1 2023-01-25T09:52:27.532 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 0 to 1 2023-01-25T09:52:27.532 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 1 to 2 2023-01-25T09:52:27.533 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 2 to 3 2023-01-25T09:52:27.533 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2023-01-25T09:52:27.533 INFO:tasks.rados.rados.0.smithi085.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2023-01-25T09:52:27.534 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 2 to smithi085112025-9 2023-01-25T09:52:27.534 INFO:tasks.rados.rados.0.smithi085.stdout:1: done (15 left) 2023-01-25T09:52:27.534 INFO:tasks.rados.rados.0.smithi085.stdout:29: write initial oid 29 2023-01-25T09:52:27.534 INFO:tasks.rados.rados.0.smithi085.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2023-01-25T09:52:27.535 INFO:tasks.rados.rados.0.smithi085.stdout:29: writing smithi085112025-29 from 470596 to 926627 tid 1 2023-01-25T09:52:27.540 INFO:tasks.rados.rados.0.smithi085.stdout:29: writing smithi085112025-29 from 1572084 to 2190744 tid 2 2023-01-25T09:52:27.540 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.541 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 3 to smithi085112025-9 2023-01-25T09:52:27.541 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 4 to smithi085112025-9 2023-01-25T09:52:27.541 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 updating version 0 to 5 2023-01-25T09:52:27.541 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 updating version 5 to 6 2023-01-25T09:52:27.542 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 version 6 is already newer than 3 2023-01-25T09:52:27.542 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2023-01-25T09:52:27.542 INFO:tasks.rados.rados.0.smithi085.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2023-01-25T09:52:27.542 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 2 to smithi085112025-4 2023-01-25T09:52:27.542 INFO:tasks.rados.rados.0.smithi085.stdout:9: done (15 left) 2023-01-25T09:52:27.543 INFO:tasks.rados.rados.0.smithi085.stdout:30: write initial oid 30 2023-01-25T09:52:27.543 INFO:tasks.rados.rados.0.smithi085.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2023-01-25T09:52:27.546 INFO:tasks.rados.rados.0.smithi085.stdout:30: writing smithi085112025-30 from 487403 to 1018683 tid 1 2023-01-25T09:52:27.553 INFO:tasks.rados.rados.0.smithi085.stdout:30: writing smithi085112025-30 from 1514213 to 1992884 tid 2 2023-01-25T09:52:27.554 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.554 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 1 to smithi085112025-14 2023-01-25T09:52:27.554 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 2 to smithi085112025-18 2023-01-25T09:52:27.554 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 3 to smithi085112025-18 2023-01-25T09:52:27.554 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 4 to smithi085112025-18 2023-01-25T09:52:27.555 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 updating version 0 to 11 2023-01-25T09:52:27.555 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 updating version 11 to 12 2023-01-25T09:52:27.555 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 version 12 is already newer than 4 2023-01-25T09:52:27.555 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 18 v 12 (ObjNum 17 snap 0 seq_num 17) dirty exists 2023-01-25T09:52:27.555 INFO:tasks.rados.rados.0.smithi085.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2023-01-25T09:52:27.556 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 1 to smithi085112025-19 2023-01-25T09:52:27.556 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 2 to smithi085112025-13 2023-01-25T09:52:27.556 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 3 to smithi085112025-13 2023-01-25T09:52:27.556 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 4 to smithi085112025-13 2023-01-25T09:52:27.556 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 0 to 4 2023-01-25T09:52:27.557 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 4 to 10 2023-01-25T09:52:27.557 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 10 to 11 2023-01-25T09:52:27.557 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 13 v 11 (ObjNum 12 snap 0 seq_num 12) dirty exists 2023-01-25T09:52:27.557 INFO:tasks.rados.rados.0.smithi085.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2023-01-25T09:52:27.557 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 3 to smithi085112025-4 2023-01-25T09:52:27.558 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 4 to smithi085112025-4 2023-01-25T09:52:27.558 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 updating version 0 to 2 2023-01-25T09:52:27.558 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 updating version 2 to 8 2023-01-25T09:52:27.558 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 updating version 8 to 12 2023-01-25T09:52:27.558 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 4 v 12 (ObjNum 3 snap 0 seq_num 3) dirty exists 2023-01-25T09:52:27.559 INFO:tasks.rados.rados.0.smithi085.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2023-01-25T09:52:27.559 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 1 to smithi085112025-20 2023-01-25T09:52:27.559 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 2 to smithi085112025-14 2023-01-25T09:52:27.559 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 3 to smithi085112025-14 2023-01-25T09:52:27.559 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 4 to smithi085112025-14 2023-01-25T09:52:27.560 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 updating version 0 to 14 2023-01-25T09:52:27.560 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 version 14 is already newer than 5 2023-01-25T09:52:27.560 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 updating version 14 to 15 2023-01-25T09:52:27.560 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 14 v 15 (ObjNum 13 snap 0 seq_num 13) dirty exists 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 2 to smithi085112025-19 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 3 to smithi085112025-19 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 4 to smithi085112025-19 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 updating version 0 to 18 2023-01-25T09:52:27.561 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 version 18 is already newer than 17 2023-01-25T09:52:27.562 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 version 18 is already newer than 6 2023-01-25T09:52:27.562 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 19 v 18 (ObjNum 18 snap 0 seq_num 18) dirty exists 2023-01-25T09:52:27.562 INFO:tasks.rados.rados.0.smithi085.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2023-01-25T09:52:27.562 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 2 to smithi085112025-20 2023-01-25T09:52:27.562 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 3 to smithi085112025-20 2023-01-25T09:52:27.563 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 4 to smithi085112025-20 2023-01-25T09:52:27.563 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 updating version 0 to 21 2023-01-25T09:52:27.563 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 version 21 is already newer than 20 2023-01-25T09:52:27.563 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 version 21 is already newer than 7 2023-01-25T09:52:27.563 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 20 v 21 (ObjNum 19 snap 0 seq_num 19) dirty exists 2023-01-25T09:52:27.564 INFO:tasks.rados.rados.0.smithi085.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2023-01-25T09:52:27.564 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 1 to smithi085112025-21 2023-01-25T09:52:27.564 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 2 to smithi085112025-21 2023-01-25T09:52:27.564 INFO:tasks.rados.rados.0.smithi085.stdout:4: done (15 left) 2023-01-25T09:52:27.564 INFO:tasks.rados.rados.0.smithi085.stdout:13: done (14 left) 2023-01-25T09:52:27.565 INFO:tasks.rados.rados.0.smithi085.stdout:14: done (13 left) 2023-01-25T09:52:27.565 INFO:tasks.rados.rados.0.smithi085.stdout:18: done (12 left) 2023-01-25T09:52:27.565 INFO:tasks.rados.rados.0.smithi085.stdout:19: done (11 left) 2023-01-25T09:52:27.565 INFO:tasks.rados.rados.0.smithi085.stdout:20: done (10 left) 2023-01-25T09:52:27.565 INFO:tasks.rados.rados.0.smithi085.stdout:31: write initial oid 31 2023-01-25T09:52:27.566 INFO:tasks.rados.rados.0.smithi085.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2023-01-25T09:52:27.566 INFO:tasks.rados.rados.0.smithi085.stdout:31: writing smithi085112025-31 from 504210 to 1110739 tid 1 2023-01-25T09:52:27.567 INFO:tasks.rados.rados.0.smithi085.stdout:31: writing smithi085112025-31 from 1572695 to 2195024 tid 2 2023-01-25T09:52:27.567 INFO:tasks.rados.rados.0.smithi085.stdout:32: write initial oid 32 2023-01-25T09:52:27.567 INFO:tasks.rados.rados.0.smithi085.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2023-01-25T09:52:27.571 INFO:tasks.rados.rados.0.smithi085.stdout:32: writing smithi085112025-32 from 521017 to 1319148 tid 1 2023-01-25T09:52:27.577 INFO:tasks.rados.rados.0.smithi085.stdout:32: writing smithi085112025-32 from 1747530 to 2229870 tid 2 2023-01-25T09:52:27.577 INFO:tasks.rados.rados.0.smithi085.stdout:33: write initial oid 33 2023-01-25T09:52:27.577 INFO:tasks.rados.rados.0.smithi085.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2023-01-25T09:52:27.582 INFO:tasks.rados.rados.0.smithi085.stdout:33: writing smithi085112025-33 from 537824 to 1011204 tid 1 2023-01-25T09:52:27.591 INFO:tasks.rados.rados.0.smithi085.stdout:33: writing smithi085112025-33 from 1806012 to 2432010 tid 2 2023-01-25T09:52:27.591 INFO:tasks.rados.rados.0.smithi085.stdout:34: write initial oid 34 2023-01-25T09:52:27.591 INFO:tasks.rados.rados.0.smithi085.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2023-01-25T09:52:27.597 INFO:tasks.rados.rados.0.smithi085.stdout:34: writing smithi085112025-34 from 554631 to 1103260 tid 1 2023-01-25T09:52:27.603 INFO:tasks.rados.rados.0.smithi085.stdout:34: writing smithi085112025-34 from 1748141 to 2234150 tid 2 2023-01-25T09:52:27.603 INFO:tasks.rados.rados.0.smithi085.stdout:35: write initial oid 35 2023-01-25T09:52:27.604 INFO:tasks.rados.rados.0.smithi085.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2023-01-25T09:52:27.610 INFO:tasks.rados.rados.0.smithi085.stdout:35: writing smithi085112025-35 from 571438 to 1195316 tid 1 2023-01-25T09:52:27.617 INFO:tasks.rados.rados.0.smithi085.stdout:35: writing smithi085112025-35 from 1806623 to 2436290 tid 2 2023-01-25T09:52:27.618 INFO:tasks.rados.rados.0.smithi085.stdout:36: write initial oid 36 2023-01-25T09:52:27.618 INFO:tasks.rados.rados.0.smithi085.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2023-01-25T09:52:27.624 INFO:tasks.rados.rados.0.smithi085.stdout:36: writing smithi085112025-36 from 588245 to 1287372 tid 1 2023-01-25T09:52:27.630 INFO:tasks.rados.rados.0.smithi085.stdout:36: writing smithi085112025-36 from 1865105 to 2354783 tid 2 2023-01-25T09:52:27.631 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.631 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 3 to smithi085112025-21 2023-01-25T09:52:27.631 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 4 to smithi085112025-21 2023-01-25T09:52:27.631 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 updating version 0 to 11 2023-01-25T09:52:27.632 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 updating version 11 to 12 2023-01-25T09:52:27.632 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 version 12 is already newer than 4 2023-01-25T09:52:27.632 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 21 v 12 (ObjNum 20 snap 0 seq_num 20) dirty exists 2023-01-25T09:52:27.632 INFO:tasks.rados.rados.0.smithi085.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2023-01-25T09:52:27.633 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 1 to smithi085112025-22 2023-01-25T09:52:27.633 INFO:tasks.rados.rados.0.smithi085.stdout:21: done (15 left) 2023-01-25T09:52:27.633 INFO:tasks.rados.rados.0.smithi085.stdout:37: write initial oid 37 2023-01-25T09:52:27.633 INFO:tasks.rados.rados.0.smithi085.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2023-01-25T09:52:27.638 INFO:tasks.rados.rados.0.smithi085.stdout:37: writing smithi085112025-37 from 605052 to 1379428 tid 1 2023-01-25T09:52:27.645 INFO:tasks.rados.rados.0.smithi085.stdout:37: writing smithi085112025-37 from 1923587 to 2556923 tid 2 2023-01-25T09:52:27.646 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.646 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 2 to smithi085112025-22 2023-01-25T09:52:27.646 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 3 to smithi085112025-22 2023-01-25T09:52:27.646 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 4 to smithi085112025-22 2023-01-25T09:52:27.647 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 updating version 0 to 5 2023-01-25T09:52:27.647 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 updating version 5 to 14 2023-01-25T09:52:27.647 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 updating version 14 to 15 2023-01-25T09:52:27.647 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 22 v 15 (ObjNum 21 snap 0 seq_num 21) dirty exists 2023-01-25T09:52:27.647 INFO:tasks.rados.rados.0.smithi085.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2023-01-25T09:52:27.648 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 1 to smithi085112025-23 2023-01-25T09:52:27.648 INFO:tasks.rados.rados.0.smithi085.stdout:22: done (15 left) 2023-01-25T09:52:27.648 INFO:tasks.rados.rados.0.smithi085.stdout:38: write initial oid 38 2023-01-25T09:52:27.648 INFO:tasks.rados.rados.0.smithi085.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2023-01-25T09:52:27.651 INFO:tasks.rados.rados.0.smithi085.stdout:38: writing smithi085112025-38 from 621859 to 1071484 tid 1 2023-01-25T09:52:27.662 INFO:tasks.rados.rados.0.smithi085.stdout:38: writing smithi085112025-38 from 1865716 to 2621859 tid 2 2023-01-25T09:52:27.662 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.662 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 2 to smithi085112025-23 2023-01-25T09:52:27.663 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 3 to smithi085112025-23 2023-01-25T09:52:27.663 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 1 to smithi085112025-24 2023-01-25T09:52:27.663 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 4 to smithi085112025-23 2023-01-25T09:52:27.663 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 updating version 0 to 6 2023-01-25T09:52:27.664 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 updating version 6 to 18 2023-01-25T09:52:27.664 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 version 18 is already newer than 17 2023-01-25T09:52:27.664 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 23 v 18 (ObjNum 22 snap 0 seq_num 22) dirty exists 2023-01-25T09:52:27.664 INFO:tasks.rados.rados.0.smithi085.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2023-01-25T09:52:27.665 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 2 to smithi085112025-24 2023-01-25T09:52:27.665 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 3 to smithi085112025-24 2023-01-25T09:52:27.665 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 4 to smithi085112025-24 2023-01-25T09:52:27.666 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 updating version 0 to 15 2023-01-25T09:52:27.666 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 version 15 is already newer than 5 2023-01-25T09:52:27.666 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 version 15 is already newer than 14 2023-01-25T09:52:27.666 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 24 v 15 (ObjNum 23 snap 0 seq_num 23) dirty exists 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 1 to smithi085112025-25 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 2 to smithi085112025-25 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 3 to smithi085112025-25 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 4 to smithi085112025-25 2023-01-25T09:52:27.667 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 updating version 0 to 21 2023-01-25T09:52:27.668 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 version 21 is already newer than 20 2023-01-25T09:52:27.668 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 version 21 is already newer than 7 2023-01-25T09:52:27.668 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 25 v 21 (ObjNum 24 snap 0 seq_num 24) dirty exists 2023-01-25T09:52:27.668 INFO:tasks.rados.rados.0.smithi085.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2023-01-25T09:52:27.668 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 1 to smithi085112025-26 2023-01-25T09:52:27.669 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 2 to smithi085112025-26 2023-01-25T09:52:27.669 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 3 to smithi085112025-26 2023-01-25T09:52:27.669 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 4 to smithi085112025-26 2023-01-25T09:52:27.669 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 updating version 0 to 17 2023-01-25T09:52:27.670 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 updating version 17 to 18 2023-01-25T09:52:27.670 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 version 18 is already newer than 6 2023-01-25T09:52:27.670 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 26 v 18 (ObjNum 25 snap 0 seq_num 25) dirty exists 2023-01-25T09:52:27.671 INFO:tasks.rados.rados.0.smithi085.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2023-01-25T09:52:27.671 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 1 to smithi085112025-27 2023-01-25T09:52:27.671 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 2 to smithi085112025-27 2023-01-25T09:52:27.672 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 3 to smithi085112025-27 2023-01-25T09:52:27.672 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 4 to smithi085112025-27 2023-01-25T09:52:27.672 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 updating version 0 to 8 2023-01-25T09:52:27.673 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 updating version 8 to 23 2023-01-25T09:52:27.673 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 updating version 23 to 24 2023-01-25T09:52:27.673 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 27 v 24 (ObjNum 26 snap 0 seq_num 26) dirty exists 2023-01-25T09:52:27.674 INFO:tasks.rados.rados.0.smithi085.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2023-01-25T09:52:27.674 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 1 to smithi085112025-28 2023-01-25T09:52:27.674 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 2 to smithi085112025-28 2023-01-25T09:52:27.674 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 3 to smithi085112025-28 2023-01-25T09:52:27.674 INFO:tasks.rados.rados.0.smithi085.stdout:23: done (15 left) 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:24: done (14 left) 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:25: done (13 left) 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:26: done (12 left) 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:27: done (11 left) 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:39: write initial oid 39 2023-01-25T09:52:27.675 INFO:tasks.rados.rados.0.smithi085.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2023-01-25T09:52:27.676 INFO:tasks.rados.rados.0.smithi085.stdout:39: writing smithi085112025-39 from 638666 to 1163540 tid 1 2023-01-25T09:52:27.677 INFO:tasks.rados.rados.0.smithi085.stdout:39: writing smithi085112025-39 from 1924198 to 2561203 tid 2 2023-01-25T09:52:27.677 INFO:tasks.rados.rados.0.smithi085.stdout:40: write initial oid 40 2023-01-25T09:52:27.677 INFO:tasks.rados.rados.0.smithi085.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2023-01-25T09:52:27.681 INFO:tasks.rados.rados.0.smithi085.stdout:40: writing smithi085112025-40 from 655473 to 1371949 tid 1 2023-01-25T09:52:27.688 INFO:tasks.rados.rados.0.smithi085.stdout:40: writing smithi085112025-40 from 2099033 to 2655473 tid 2 2023-01-25T09:52:27.688 INFO:tasks.rados.rados.0.smithi085.stdout:41: write initial oid 41 2023-01-25T09:52:27.689 INFO:tasks.rados.rados.0.smithi085.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2023-01-25T09:52:27.696 INFO:tasks.rados.rados.0.smithi085.stdout:41: writing smithi085112025-41 from 672280 to 1464005 tid 1 2023-01-25T09:52:27.703 INFO:tasks.rados.rados.0.smithi085.stdout:41: writing smithi085112025-41 from 2157515 to 2672280 tid 2 2023-01-25T09:52:27.704 INFO:tasks.rados.rados.0.smithi085.stdout:42: write initial oid 42 2023-01-25T09:52:27.704 INFO:tasks.rados.rados.0.smithi085.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2023-01-25T09:52:27.709 INFO:tasks.rados.rados.0.smithi085.stdout:42: writing smithi085112025-42 from 689087 to 1156061 tid 1 2023-01-25T09:52:27.717 INFO:tasks.rados.rados.0.smithi085.stdout:42: writing smithi085112025-42 from 1699644 to 2483976 tid 2 2023-01-25T09:52:27.717 INFO:tasks.rados.rados.0.smithi085.stdout:43: write initial oid 43 2023-01-25T09:52:27.717 INFO:tasks.rados.rados.0.smithi085.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2023-01-25T09:52:27.723 INFO:tasks.rados.rados.0.smithi085.stdout:43: writing smithi085112025-43 from 705894 to 1248117 tid 1 2023-01-25T09:52:27.730 INFO:tasks.rados.rados.0.smithi085.stdout:43: writing smithi085112025-43 from 1758126 to 2402469 tid 2 2023-01-25T09:52:27.730 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.731 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 4 to smithi085112025-28 2023-01-25T09:52:27.731 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 updating version 0 to 21 2023-01-25T09:52:27.731 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 version 21 is already newer than 7 2023-01-25T09:52:27.731 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 version 21 is already newer than 20 2023-01-25T09:52:27.731 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 28 v 21 (ObjNum 27 snap 0 seq_num 27) dirty exists 2023-01-25T09:52:27.732 INFO:tasks.rados.rados.0.smithi085.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2023-01-25T09:52:27.732 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 1 to smithi085112025-29 2023-01-25T09:52:27.732 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 2 to smithi085112025-29 2023-01-25T09:52:27.732 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 3 to smithi085112025-29 2023-01-25T09:52:27.732 INFO:tasks.rados.rados.0.smithi085.stdout:28: done (15 left) 2023-01-25T09:52:27.733 INFO:tasks.rados.rados.0.smithi085.stdout:44: write initial oid 44 2023-01-25T09:52:27.733 INFO:tasks.rados.rados.0.smithi085.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2023-01-25T09:52:27.737 INFO:tasks.rados.rados.0.smithi085.stdout:44: writing smithi085112025-44 from 722701 to 1340173 tid 1 2023-01-25T09:52:27.745 INFO:tasks.rados.rados.0.smithi085.stdout:44: writing smithi085112025-44 from 1816608 to 2604609 tid 2 2023-01-25T09:52:27.746 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.746 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 4 to smithi085112025-29 2023-01-25T09:52:27.746 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 updating version 0 to 20 2023-01-25T09:52:27.746 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 version 20 is already newer than 7 2023-01-25T09:52:27.747 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 updating version 20 to 21 2023-01-25T09:52:27.747 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 29 v 21 (ObjNum 28 snap 0 seq_num 28) dirty exists 2023-01-25T09:52:27.747 INFO:tasks.rados.rados.0.smithi085.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2023-01-25T09:52:27.747 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 1 to smithi085112025-30 2023-01-25T09:52:27.747 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 2 to smithi085112025-30 2023-01-25T09:52:27.748 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 3 to smithi085112025-30 2023-01-25T09:52:27.748 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 4 to smithi085112025-30 2023-01-25T09:52:27.748 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 updating version 0 to 8 2023-01-25T09:52:27.748 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 updating version 8 to 24 2023-01-25T09:52:27.748 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 version 24 is already newer than 23 2023-01-25T09:52:27.749 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 30 v 24 (ObjNum 29 snap 0 seq_num 29) dirty exists 2023-01-25T09:52:27.749 INFO:tasks.rados.rados.0.smithi085.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2023-01-25T09:52:27.749 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 1 to smithi085112025-31 2023-01-25T09:52:27.749 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 2 to smithi085112025-31 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 3 to smithi085112025-31 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 4 to smithi085112025-31 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 updating version 0 to 26 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 version 26 is already newer than 9 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 updating version 26 to 27 2023-01-25T09:52:27.750 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 31 v 27 (ObjNum 30 snap 0 seq_num 30) dirty exists 2023-01-25T09:52:27.751 INFO:tasks.rados.rados.0.smithi085.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2023-01-25T09:52:27.751 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 1 to smithi085112025-32 2023-01-25T09:52:27.751 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 1 to smithi085112025-33 2023-01-25T09:52:27.751 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 2 to smithi085112025-32 2023-01-25T09:52:27.751 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 3 to smithi085112025-32 2023-01-25T09:52:27.752 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 4 to smithi085112025-32 2023-01-25T09:52:27.752 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 updating version 0 to 24 2023-01-25T09:52:27.752 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 version 24 is already newer than 8 2023-01-25T09:52:27.752 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 version 24 is already newer than 23 2023-01-25T09:52:27.752 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 32 v 24 (ObjNum 31 snap 0 seq_num 31) dirty exists 2023-01-25T09:52:27.753 INFO:tasks.rados.rados.0.smithi085.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2023-01-25T09:52:27.753 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 2 to smithi085112025-33 2023-01-25T09:52:27.753 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 3 to smithi085112025-33 2023-01-25T09:52:27.753 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 4 to smithi085112025-33 2023-01-25T09:52:27.753 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 updating version 0 to 8 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 updating version 8 to 23 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 updating version 23 to 24 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 33 v 24 (ObjNum 32 snap 0 seq_num 32) dirty exists 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 1 to smithi085112025-34 2023-01-25T09:52:27.754 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 2 to smithi085112025-34 2023-01-25T09:52:27.755 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 3 to smithi085112025-34 2023-01-25T09:52:27.755 INFO:tasks.rados.rados.0.smithi085.stdout:29: done (15 left) 2023-01-25T09:52:27.755 INFO:tasks.rados.rados.0.smithi085.stdout:30: done (14 left) 2023-01-25T09:52:27.755 INFO:tasks.rados.rados.0.smithi085.stdout:31: done (13 left) 2023-01-25T09:52:27.755 INFO:tasks.rados.rados.0.smithi085.stdout:32: done (12 left) 2023-01-25T09:52:27.756 INFO:tasks.rados.rados.0.smithi085.stdout:33: done (11 left) 2023-01-25T09:52:27.756 INFO:tasks.rados.rados.0.smithi085.stdout:45: write initial oid 45 2023-01-25T09:52:27.756 INFO:tasks.rados.rados.0.smithi085.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2023-01-25T09:52:27.757 INFO:tasks.rados.rados.0.smithi085.stdout:45: writing smithi085112025-45 from 739508 to 1432229 tid 1 2023-01-25T09:52:27.758 INFO:tasks.rados.rados.0.smithi085.stdout:45: writing smithi085112025-45 from 1875090 to 2523102 tid 2 2023-01-25T09:52:27.758 INFO:tasks.rados.rados.0.smithi085.stdout:46: write initial oid 46 2023-01-25T09:52:27.759 INFO:tasks.rados.rados.0.smithi085.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2023-01-25T09:52:27.767 INFO:tasks.rados.rados.0.smithi085.stdout:46: writing smithi085112025-46 from 756315 to 1524285 tid 1 2023-01-25T09:52:27.774 INFO:tasks.rados.rados.0.smithi085.stdout:46: writing smithi085112025-46 from 1933572 to 2725242 tid 2 2023-01-25T09:52:27.774 INFO:tasks.rados.rados.0.smithi085.stdout:47: write initial oid 47 2023-01-25T09:52:27.774 INFO:tasks.rados.rados.0.smithi085.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2023-01-25T09:52:27.781 INFO:tasks.rados.rados.0.smithi085.stdout:47: writing smithi085112025-47 from 773122 to 1332694 tid 1 2023-01-25T09:52:27.788 INFO:tasks.rados.rados.0.smithi085.stdout:47: writing smithi085112025-47 from 1992054 to 2643735 tid 2 2023-01-25T09:52:27.789 INFO:tasks.rados.rados.0.smithi085.stdout:48: write initial oid 48 2023-01-25T09:52:27.789 INFO:tasks.rados.rados.0.smithi085.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2023-01-25T09:52:27.796 INFO:tasks.rados.rados.0.smithi085.stdout:48: writing smithi085112025-48 from 789929 to 1424750 tid 1 2023-01-25T09:52:27.804 INFO:tasks.rados.rados.0.smithi085.stdout:48: writing smithi085112025-48 from 2050536 to 2789929 tid 2 2023-01-25T09:52:27.804 INFO:tasks.rados.rados.0.smithi085.stdout:49: write initial oid 49 2023-01-25T09:52:27.804 INFO:tasks.rados.rados.0.smithi085.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2023-01-25T09:52:27.810 INFO:tasks.rados.rados.0.smithi085.stdout:49: writing smithi085112025-49 from 406736 to 1116806 tid 1 2023-01-25T09:52:27.818 INFO:tasks.rados.rados.0.smithi085.stdout:49: writing smithi085112025-49 from 1709018 to 2364368 tid 2 2023-01-25T09:52:27.818 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.818 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 4 to smithi085112025-34 2023-01-25T09:52:27.818 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 updating version 0 to 30 2023-01-25T09:52:27.818 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 version 30 is already newer than 29 2023-01-25T09:52:27.819 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 version 30 is already newer than 10 2023-01-25T09:52:27.819 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 34 v 30 (ObjNum 33 snap 0 seq_num 33) dirty exists 2023-01-25T09:52:27.819 INFO:tasks.rados.rados.0.smithi085.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2023-01-25T09:52:27.819 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 1 to smithi085112025-35 2023-01-25T09:52:27.819 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 2 to smithi085112025-35 2023-01-25T09:52:27.820 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 3 to smithi085112025-35 2023-01-25T09:52:27.820 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 4 to smithi085112025-35 2023-01-25T09:52:27.820 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 updating version 0 to 13 2023-01-25T09:52:27.820 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 version 13 is already newer than 12 2023-01-25T09:52:27.820 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 version 13 is already newer than 11 2023-01-25T09:52:27.821 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 35 v 13 (ObjNum 34 snap 0 seq_num 34) dirty exists 2023-01-25T09:52:27.821 INFO:tasks.rados.rados.0.smithi085.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2023-01-25T09:52:27.821 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 1 to smithi085112025-36 2023-01-25T09:52:27.821 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 2 to smithi085112025-36 2023-01-25T09:52:27.821 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 3 to smithi085112025-36 2023-01-25T09:52:27.822 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 4 to smithi085112025-36 2023-01-25T09:52:27.822 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 updating version 0 to 9 2023-01-25T09:52:27.822 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 updating version 9 to 27 2023-01-25T09:52:27.822 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 version 27 is already newer than 26 2023-01-25T09:52:27.822 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 36 v 27 (ObjNum 35 snap 0 seq_num 35) dirty exists 2023-01-25T09:52:27.823 INFO:tasks.rados.rados.0.smithi085.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2023-01-25T09:52:27.823 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 1 to smithi085112025-37 2023-01-25T09:52:27.823 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 2 to smithi085112025-37 2023-01-25T09:52:27.823 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 3 to smithi085112025-37 2023-01-25T09:52:27.823 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 4 to smithi085112025-37 2023-01-25T09:52:27.824 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 0 to 9 2023-01-25T09:52:27.824 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 9 to 26 2023-01-25T09:52:27.824 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 26 to 27 2023-01-25T09:52:27.824 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 37 v 27 (ObjNum 36 snap 0 seq_num 36) dirty exists 2023-01-25T09:52:27.824 INFO:tasks.rados.rados.0.smithi085.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2023-01-25T09:52:27.825 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 1 to smithi085112025-38 2023-01-25T09:52:27.825 INFO:tasks.rados.rados.0.smithi085.stdout:34: done (15 left) 2023-01-25T09:52:27.825 INFO:tasks.rados.rados.0.smithi085.stdout:35: done (14 left) 2023-01-25T09:52:27.825 INFO:tasks.rados.rados.0.smithi085.stdout:36: done (13 left) 2023-01-25T09:52:27.825 INFO:tasks.rados.rados.0.smithi085.stdout:37: done (12 left) 2023-01-25T09:52:27.826 INFO:tasks.rados.rados.0.smithi085.stdout:50: write initial oid 50 2023-01-25T09:52:27.826 INFO:tasks.rados.rados.0.smithi085.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2023-01-25T09:52:27.826 INFO:tasks.rados.rados.0.smithi085.stdout:50: writing smithi085112025-50 from 423543 to 1208862 tid 1 2023-01-25T09:52:27.832 INFO:tasks.rados.rados.0.smithi085.stdout:50: writing smithi085112025-50 from 1767500 to 2566508 tid 2 2023-01-25T09:52:27.832 INFO:tasks.rados.rados.0.smithi085.stdout:51: write initial oid 51 2023-01-25T09:52:27.832 INFO:tasks.rados.rados.0.smithi085.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2023-01-25T09:52:27.837 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112025-51 from 440350 to 900918 tid 1 2023-01-25T09:52:27.843 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112025-51 from 1309629 to 1852295 tid 2 2023-01-25T09:52:27.848 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112025-51 from 2323973 to 2840350 tid 3 2023-01-25T09:52:27.848 INFO:tasks.rados.rados.0.smithi085.stdout:52: write initial oid 52 2023-01-25T09:52:27.849 INFO:tasks.rados.rados.0.smithi085.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2023-01-25T09:52:27.854 INFO:tasks.rados.rados.0.smithi085.stdout:52: writing smithi085112025-52 from 457157 to 992974 tid 1 2023-01-25T09:52:27.860 INFO:tasks.rados.rados.0.smithi085.stdout:52: writing smithi085112025-52 from 1768111 to 2170788 tid 2 2023-01-25T09:52:27.861 INFO:tasks.rados.rados.0.smithi085.stdout:53: write initial oid 53 2023-01-25T09:52:27.861 INFO:tasks.rados.rados.0.smithi085.stdout:53: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2023-01-25T09:52:27.866 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112025-53 from 473964 to 1085030 tid 1 2023-01-25T09:52:27.874 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112025-53 from 1826593 to 2372928 tid 2 2023-01-25T09:52:27.877 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112025-53 from 2778819 to 2873964 tid 3 2023-01-25T09:52:27.877 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.878 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 2 to smithi085112025-38 2023-01-25T09:52:27.878 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 3 to smithi085112025-38 2023-01-25T09:52:27.878 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 4 to smithi085112025-38 2023-01-25T09:52:27.878 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 updating version 0 to 9 2023-01-25T09:52:27.879 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 updating version 9 to 27 2023-01-25T09:52:27.879 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 version 27 is already newer than 26 2023-01-25T09:52:27.879 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 38 v 27 (ObjNum 37 snap 0 seq_num 37) dirty exists 2023-01-25T09:52:27.879 INFO:tasks.rados.rados.0.smithi085.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2023-01-25T09:52:27.879 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 1 to smithi085112025-39 2023-01-25T09:52:27.880 INFO:tasks.rados.rados.0.smithi085.stdout:38: done (15 left) 2023-01-25T09:52:27.880 INFO:tasks.rados.rados.0.smithi085.stdout:54: write initial oid 54 2023-01-25T09:52:27.880 INFO:tasks.rados.rados.0.smithi085.stdout:54: seq_num 53 ranges {490771=686315,1885075=406346} 2023-01-25T09:52:27.883 INFO:tasks.rados.rados.0.smithi085.stdout:54: writing smithi085112025-54 from 490771 to 1177086 tid 1 2023-01-25T09:52:27.890 INFO:tasks.rados.rados.0.smithi085.stdout:54: writing smithi085112025-54 from 1885075 to 2291421 tid 2 2023-01-25T09:52:27.891 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.891 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 2 to smithi085112025-39 2023-01-25T09:52:27.891 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 3 to smithi085112025-39 2023-01-25T09:52:27.891 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 4 to smithi085112025-39 2023-01-25T09:52:27.891 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 updating version 0 to 10 2023-01-25T09:52:27.892 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 updating version 10 to 12 2023-01-25T09:52:27.892 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 version 12 is already newer than 11 2023-01-25T09:52:27.892 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 39 v 12 (ObjNum 38 snap 0 seq_num 38) dirty exists 2023-01-25T09:52:27.892 INFO:tasks.rados.rados.0.smithi085.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2023-01-25T09:52:27.892 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 1 to smithi085112025-40 2023-01-25T09:52:27.893 INFO:tasks.rados.rados.0.smithi085.stdout:39: done (15 left) 2023-01-25T09:52:27.893 INFO:tasks.rados.rados.0.smithi085.stdout:55: write initial oid 55 2023-01-25T09:52:27.893 INFO:tasks.rados.rados.0.smithi085.stdout:55: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2023-01-25T09:52:27.895 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112025-55 from 507578 to 985495 tid 1 2023-01-25T09:52:27.902 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112025-55 from 1543557 to 2093561 tid 2 2023-01-25T09:52:27.907 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112025-55 from 2833665 to 2907578 tid 3 2023-01-25T09:52:27.907 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.907 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 2 to smithi085112025-40 2023-01-25T09:52:27.908 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 3 to smithi085112025-40 2023-01-25T09:52:27.908 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 4 to smithi085112025-40 2023-01-25T09:52:27.908 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 updating version 0 to 14 2023-01-25T09:52:27.908 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 version 14 is already newer than 13 2023-01-25T09:52:27.908 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 updating version 14 to 15 2023-01-25T09:52:27.909 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 40 v 15 (ObjNum 39 snap 0 seq_num 39) dirty exists 2023-01-25T09:52:27.909 INFO:tasks.rados.rados.0.smithi085.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2023-01-25T09:52:27.909 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 1 to smithi085112025-41 2023-01-25T09:52:27.909 INFO:tasks.rados.rados.0.smithi085.stdout:40: done (15 left) 2023-01-25T09:52:27.910 INFO:tasks.rados.rados.0.smithi085.stdout:56: write initial oid 56 2023-01-25T09:52:27.910 INFO:tasks.rados.rados.0.smithi085.stdout:56: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2023-01-25T09:52:27.912 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112025-56 from 524385 to 1077551 tid 1 2023-01-25T09:52:27.917 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112025-56 from 1602039 to 2012054 tid 2 2023-01-25T09:52:27.923 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112025-56 from 2577441 to 2924385 tid 3 2023-01-25T09:52:27.924 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.924 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 2 to smithi085112025-41 2023-01-25T09:52:27.924 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 3 to smithi085112025-41 2023-01-25T09:52:27.924 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 4 to smithi085112025-41 2023-01-25T09:52:27.924 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 updating version 0 to 10 2023-01-25T09:52:27.925 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 updating version 10 to 29 2023-01-25T09:52:27.925 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 updating version 29 to 30 2023-01-25T09:52:27.925 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 41 v 30 (ObjNum 40 snap 0 seq_num 40) dirty exists 2023-01-25T09:52:27.925 INFO:tasks.rados.rados.0.smithi085.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2023-01-25T09:52:27.926 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 1 to smithi085112025-42 2023-01-25T09:52:27.926 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 2 to smithi085112025-42 2023-01-25T09:52:27.926 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 3 to smithi085112025-42 2023-01-25T09:52:27.926 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 4 to smithi085112025-42 2023-01-25T09:52:27.926 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 updating version 0 to 29 2023-01-25T09:52:27.927 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 updating version 29 to 30 2023-01-25T09:52:27.927 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 version 30 is already newer than 10 2023-01-25T09:52:27.927 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 42 v 30 (ObjNum 41 snap 0 seq_num 41) dirty exists 2023-01-25T09:52:27.927 INFO:tasks.rados.rados.0.smithi085.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2023-01-25T09:52:27.927 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 1 to smithi085112025-43 2023-01-25T09:52:27.928 INFO:tasks.rados.rados.0.smithi085.stdout:41: done (15 left) 2023-01-25T09:52:27.928 INFO:tasks.rados.rados.0.smithi085.stdout:42: done (14 left) 2023-01-25T09:52:27.928 INFO:tasks.rados.rados.0.smithi085.stdout:57: write initial oid 57 2023-01-25T09:52:27.928 INFO:tasks.rados.rados.0.smithi085.stdout:57: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2023-01-25T09:52:27.929 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112025-57 from 541192 to 1169607 tid 1 2023-01-25T09:52:27.935 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112025-57 from 1660521 to 2214194 tid 2 2023-01-25T09:52:27.939 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112025-57 from 2888511 to 2941192 tid 3 2023-01-25T09:52:27.940 INFO:tasks.rados.rados.0.smithi085.stdout:58: write initial oid 58 2023-01-25T09:52:27.940 INFO:tasks.rados.rados.0.smithi085.stdout:58: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2023-01-25T09:52:27.946 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112025-58 from 557999 to 1261663 tid 1 2023-01-25T09:52:27.951 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112025-58 from 1719003 to 2132687 tid 2 2023-01-25T09:52:27.956 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112025-58 from 2632287 to 2957999 tid 3 2023-01-25T09:52:27.957 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.957 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 2 to smithi085112025-43 2023-01-25T09:52:27.957 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 3 to smithi085112025-43 2023-01-25T09:52:27.957 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 4 to smithi085112025-43 2023-01-25T09:52:27.957 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 updating version 0 to 16 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 updating version 16 to 17 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 updating version 17 to 18 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 43 v 18 (ObjNum 42 snap 0 seq_num 42) dirty exists 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 1 to smithi085112025-44 2023-01-25T09:52:27.958 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 2 to smithi085112025-44 2023-01-25T09:52:27.959 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 3 to smithi085112025-44 2023-01-25T09:52:27.959 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 4 to smithi085112025-44 2023-01-25T09:52:27.959 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 updating version 0 to 13 2023-01-25T09:52:27.959 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 version 13 is already newer than 12 2023-01-25T09:52:27.959 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 version 13 is already newer than 11 2023-01-25T09:52:27.960 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 44 v 13 (ObjNum 43 snap 0 seq_num 43) dirty exists 2023-01-25T09:52:27.960 INFO:tasks.rados.rados.0.smithi085.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2023-01-25T09:52:27.960 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 1 to smithi085112025-45 2023-01-25T09:52:27.960 INFO:tasks.rados.rados.0.smithi085.stdout:43: done (15 left) 2023-01-25T09:52:27.961 INFO:tasks.rados.rados.0.smithi085.stdout:44: done (14 left) 2023-01-25T09:52:27.961 INFO:tasks.rados.rados.0.smithi085.stdout:59: write initial oid 59 2023-01-25T09:52:27.961 INFO:tasks.rados.rados.0.smithi085.stdout:59: seq_num 58 ranges {574806=778913,2061132=557342} 2023-01-25T09:52:27.963 INFO:tasks.rados.rados.0.smithi085.stdout:59: writing smithi085112025-59 from 574806 to 1353719 tid 1 2023-01-25T09:52:27.970 INFO:tasks.rados.rados.0.smithi085.stdout:59: writing smithi085112025-59 from 2061132 to 2618474 tid 2 2023-01-25T09:52:27.971 INFO:tasks.rados.rados.0.smithi085.stdout:60: write initial oid 60 2023-01-25T09:52:27.971 INFO:tasks.rados.rados.0.smithi085.stdout:60: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2023-01-25T09:52:27.976 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112025-60 from 591613 to 1045775 tid 1 2023-01-25T09:52:27.982 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112025-60 from 1719614 to 2136967 tid 2 2023-01-25T09:52:27.988 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112025-60 from 2570780 to 2991613 tid 3 2023-01-25T09:52:27.988 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:27.988 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 2 to smithi085112025-45 2023-01-25T09:52:27.989 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 3 to smithi085112025-45 2023-01-25T09:52:27.989 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 4 to smithi085112025-45 2023-01-25T09:52:27.989 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 updating version 0 to 15 2023-01-25T09:52:27.989 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 updating version 15 to 16 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 version 16 is already newer than 14 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 45 v 16 (ObjNum 44 snap 0 seq_num 44) dirty exists 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 1 to smithi085112025-46 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 1 to smithi085112025-47 2023-01-25T09:52:27.990 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 2 to smithi085112025-46 2023-01-25T09:52:27.991 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 3 to smithi085112025-46 2023-01-25T09:52:27.991 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 4 to smithi085112025-46 2023-01-25T09:52:27.991 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 updating version 0 to 33 2023-01-25T09:52:27.991 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 version 33 is already newer than 11 2023-01-25T09:52:27.991 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 version 33 is already newer than 32 2023-01-25T09:52:27.992 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 46 v 33 (ObjNum 45 snap 0 seq_num 45) dirty exists 2023-01-25T09:52:27.992 INFO:tasks.rados.rados.0.smithi085.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2023-01-25T09:52:27.992 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 2 to smithi085112025-47 2023-01-25T09:52:27.992 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 3 to smithi085112025-47 2023-01-25T09:52:27.992 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 4 to smithi085112025-47 2023-01-25T09:52:27.993 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 updating version 0 to 16 2023-01-25T09:52:27.993 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 version 16 is already newer than 14 2023-01-25T09:52:27.993 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 version 16 is already newer than 15 2023-01-25T09:52:27.993 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 47 v 16 (ObjNum 46 snap 0 seq_num 46) dirty exists 2023-01-25T09:52:27.993 INFO:tasks.rados.rados.0.smithi085.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 1 to smithi085112025-48 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:45: done (15 left) 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:46: done (14 left) 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:47: done (13 left) 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:61: write initial oid 61 2023-01-25T09:52:27.994 INFO:tasks.rados.rados.0.smithi085.stdout:61: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2023-01-25T09:52:27.995 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112025-61 from 608420 to 1137831 tid 1 2023-01-25T09:52:28.000 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112025-61 from 1778096 to 2339107 tid 2 2023-01-25T09:52:28.004 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112025-61 from 2881850 to 3008420 tid 3 2023-01-25T09:52:28.005 INFO:tasks.rados.rados.0.smithi085.stdout:62: write initial oid 62 2023-01-25T09:52:28.005 INFO:tasks.rados.rados.0.smithi085.stdout:62: seq_num 61 ranges {625227=721013,1952931=704669} 2023-01-25T09:52:28.011 INFO:tasks.rados.rados.0.smithi085.stdout:62: writing smithi085112025-62 from 625227 to 1346240 tid 1 2023-01-25T09:52:28.019 INFO:tasks.rados.rados.0.smithi085.stdout:62: writing smithi085112025-62 from 1952931 to 2657600 tid 2 2023-01-25T09:52:28.019 INFO:tasks.rados.rados.0.smithi085.stdout:63: write initial oid 63 2023-01-25T09:52:28.019 INFO:tasks.rados.rados.0.smithi085.stdout:63: seq_num 62 ranges {642034=796262,1895060=564680} 2023-01-25T09:52:28.027 INFO:tasks.rados.rados.0.smithi085.stdout:63: writing smithi085112025-63 from 642034 to 1438296 tid 1 2023-01-25T09:52:28.033 INFO:tasks.rados.rados.0.smithi085.stdout:63: writing smithi085112025-63 from 1895060 to 2459740 tid 2 2023-01-25T09:52:28.033 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.033 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 2 to smithi085112025-48 2023-01-25T09:52:28.034 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 3 to smithi085112025-48 2023-01-25T09:52:28.034 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 4 to smithi085112025-48 2023-01-25T09:52:28.034 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 updating version 0 to 17 2023-01-25T09:52:28.034 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 updating version 17 to 18 2023-01-25T09:52:28.034 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 updating version 18 to 19 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 48 v 19 (ObjNum 47 snap 0 seq_num 47) dirty exists 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 1 to smithi085112025-49 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:48: done (15 left) 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:64: write initial oid 64 2023-01-25T09:52:28.035 INFO:tasks.rados.rados.0.smithi085.stdout:64: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2023-01-25T09:52:28.039 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112025-64 from 658841 to 1130352 tid 1 2023-01-25T09:52:28.045 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112025-64 from 1553542 to 2261880 tid 2 2023-01-25T09:52:28.050 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112025-64 from 2964119 to 3058841 tid 3 2023-01-25T09:52:28.050 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.050 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 2 to smithi085112025-49 2023-01-25T09:52:28.051 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 3 to smithi085112025-49 2023-01-25T09:52:28.051 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 4 to smithi085112025-49 2023-01-25T09:52:28.051 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 updating version 0 to 21 2023-01-25T09:52:28.051 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 version 21 is already newer than 20 2023-01-25T09:52:28.051 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 version 21 is already newer than 19 2023-01-25T09:52:28.052 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 49 v 21 (ObjNum 48 snap 0 seq_num 48) dirty exists 2023-01-25T09:52:28.052 INFO:tasks.rados.rados.0.smithi085.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2023-01-25T09:52:28.052 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 1 to smithi085112025-50 2023-01-25T09:52:28.052 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 2 to smithi085112025-50 2023-01-25T09:52:28.052 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 3 to smithi085112025-50 2023-01-25T09:52:28.053 INFO:tasks.rados.rados.0.smithi085.stdout:49: done (15 left) 2023-01-25T09:52:28.053 INFO:tasks.rados.rados.0.smithi085.stdout:65: write initial oid 65 2023-01-25T09:52:28.053 INFO:tasks.rados.rados.0.smithi085.stdout:65: seq_num 64 ranges {675648=546760,2012024=568349} 2023-01-25T09:52:28.056 INFO:tasks.rados.rados.0.smithi085.stdout:65: writing smithi085112025-65 from 675648 to 1222408 tid 1 2023-01-25T09:52:28.065 INFO:tasks.rados.rados.0.smithi085.stdout:65: writing smithi085112025-65 from 2012024 to 2580373 tid 2 2023-01-25T09:52:28.066 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.066 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 1 to smithi085112025-51 2023-01-25T09:52:28.066 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 4 to smithi085112025-50 2023-01-25T09:52:28.066 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 updating version 0 to 13 2023-01-25T09:52:28.066 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 updating version 13 to 14 2023-01-25T09:52:28.067 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 version 14 is already newer than 12 2023-01-25T09:52:28.067 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 50 v 14 (ObjNum 49 snap 0 seq_num 49) dirty exists 2023-01-25T09:52:28.067 INFO:tasks.rados.rados.0.smithi085.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2023-01-25T09:52:28.067 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 2 to smithi085112025-51 2023-01-25T09:52:28.067 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 3 to smithi085112025-51 2023-01-25T09:52:28.068 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 4 to smithi085112025-51 2023-01-25T09:52:28.068 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 5 to smithi085112025-51 2023-01-25T09:52:28.068 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 0 to 22 2023-01-25T09:52:28.068 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 22 to 23 2023-01-25T09:52:28.068 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 23 to 24 2023-01-25T09:52:28.069 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 24 to 25 2023-01-25T09:52:28.069 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 51 v 25 (ObjNum 50 snap 0 seq_num 50) dirty exists 2023-01-25T09:52:28.069 INFO:tasks.rados.rados.0.smithi085.stdout:51: left oid 51 (ObjNum 50 snap 0 seq_num 50) 2023-01-25T09:52:28.069 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 1 to smithi085112025-52 2023-01-25T09:52:28.069 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 2 to smithi085112025-52 2023-01-25T09:52:28.070 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 3 to smithi085112025-52 2023-01-25T09:52:28.070 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 4 to smithi085112025-52 2023-01-25T09:52:28.070 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 updating version 0 to 28 2023-01-25T09:52:28.070 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 version 28 is already newer than 27 2023-01-25T09:52:28.070 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 version 28 is already newer than 26 2023-01-25T09:52:28.071 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 52 v 28 (ObjNum 51 snap 0 seq_num 51) dirty exists 2023-01-25T09:52:28.071 INFO:tasks.rados.rados.0.smithi085.stdout:52: left oid 52 (ObjNum 51 snap 0 seq_num 51) 2023-01-25T09:52:28.071 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 1 to smithi085112025-53 2023-01-25T09:52:28.071 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 2 to smithi085112025-53 2023-01-25T09:52:28.072 INFO:tasks.rados.rados.0.smithi085.stdout:50: done (15 left) 2023-01-25T09:52:28.072 INFO:tasks.rados.rados.0.smithi085.stdout:51: done (14 left) 2023-01-25T09:52:28.072 INFO:tasks.rados.rados.0.smithi085.stdout:52: done (13 left) 2023-01-25T09:52:28.072 INFO:tasks.rados.rados.0.smithi085.stdout:66: write initial oid 66 2023-01-25T09:52:28.072 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 3 to smithi085112025-53 2023-01-25T09:52:28.073 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 4 to smithi085112025-53 2023-01-25T09:52:28.073 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 5 to smithi085112025-53 2023-01-25T09:52:28.073 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 0 to 16 2023-01-25T09:52:28.073 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 version 16 is already newer than 15 2023-01-25T09:52:28.073 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 16 to 17 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 17 to 18 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 53 v 18 (ObjNum 52 snap 0 seq_num 52) dirty exists 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:53: left oid 53 (ObjNum 52 snap 0 seq_num 52) 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 1 to smithi085112025-54 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 2 to smithi085112025-54 2023-01-25T09:52:28.074 INFO:tasks.rados.rados.0.smithi085.stdout:66: seq_num 65 ranges {692455=622009,2070506=712007} 2023-01-25T09:52:28.075 INFO:tasks.rados.rados.0.smithi085.stdout:66: writing smithi085112025-66 from 692455 to 1314464 tid 1 2023-01-25T09:52:28.080 INFO:tasks.rados.rados.0.smithi085.stdout:66: writing smithi085112025-66 from 2070506 to 2782513 tid 2 2023-01-25T09:52:28.080 INFO:tasks.rados.rados.0.smithi085.stdout:53: done (13 left) 2023-01-25T09:52:28.080 INFO:tasks.rados.rados.0.smithi085.stdout:67: write initial oid 67 2023-01-25T09:52:28.080 INFO:tasks.rados.rados.0.smithi085.stdout:67: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2023-01-25T09:52:28.087 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112025-67 from 709262 to 1406520 tid 1 2023-01-25T09:52:28.094 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112025-67 from 2012635 to 2584653 tid 2 2023-01-25T09:52:28.097 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112025-67 from 3046388 to 3109262 tid 3 2023-01-25T09:52:28.097 INFO:tasks.rados.rados.0.smithi085.stdout:68: write initial oid 68 2023-01-25T09:52:28.097 INFO:tasks.rados.rados.0.smithi085.stdout:68: seq_num 67 ranges {726069=772507,2071117=715676} 2023-01-25T09:52:28.105 INFO:tasks.rados.rados.0.smithi085.stdout:68: writing smithi085112025-68 from 726069 to 1498576 tid 1 2023-01-25T09:52:28.112 INFO:tasks.rados.rados.0.smithi085.stdout:68: writing smithi085112025-68 from 2071117 to 2786793 tid 2 2023-01-25T09:52:28.112 INFO:tasks.rados.rados.0.smithi085.stdout:69: write initial oid 69 2023-01-25T09:52:28.113 INFO:tasks.rados.rados.0.smithi085.stdout:69: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2023-01-25T09:52:28.118 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112025-69 from 742876 to 1190632 tid 1 2023-01-25T09:52:28.125 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112025-69 from 1729599 to 2305286 tid 2 2023-01-25T09:52:28.130 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112025-69 from 3101234 to 3142876 tid 3 2023-01-25T09:52:28.130 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.130 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 3 to smithi085112025-54 2023-01-25T09:52:28.131 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 4 to smithi085112025-54 2023-01-25T09:52:28.131 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 updating version 0 to 20 2023-01-25T09:52:28.131 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 updating version 20 to 21 2023-01-25T09:52:28.131 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 version 21 is already newer than 19 2023-01-25T09:52:28.131 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 54 v 21 (ObjNum 53 snap 0 seq_num 53) dirty exists 2023-01-25T09:52:28.132 INFO:tasks.rados.rados.0.smithi085.stdout:54: left oid 54 (ObjNum 53 snap 0 seq_num 53) 2023-01-25T09:52:28.132 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 1 to smithi085112025-55 2023-01-25T09:52:28.132 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 2 to smithi085112025-55 2023-01-25T09:52:28.132 INFO:tasks.rados.rados.0.smithi085.stdout:54: done (15 left) 2023-01-25T09:52:28.133 INFO:tasks.rados.rados.0.smithi085.stdout:70: write initial oid 70 2023-01-25T09:52:28.133 INFO:tasks.rados.rados.0.smithi085.stdout:70: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2023-01-25T09:52:28.137 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112025-70 from 759683 to 1399041 tid 1 2023-01-25T09:52:28.144 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112025-70 from 1904434 to 2623779 tid 2 2023-01-25T09:52:28.148 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112025-70 from 3128657 to 3159683 tid 3 2023-01-25T09:52:28.148 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.148 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 3 to smithi085112025-55 2023-01-25T09:52:28.148 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 4 to smithi085112025-55 2023-01-25T09:52:28.148 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 5 to smithi085112025-55 2023-01-25T09:52:28.149 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 updating version 0 to 21 2023-01-25T09:52:28.149 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 version 21 is already newer than 20 2023-01-25T09:52:28.149 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 updating version 21 to 22 2023-01-25T09:52:28.149 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 updating version 22 to 23 2023-01-25T09:52:28.149 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 55 v 23 (ObjNum 54 snap 0 seq_num 54) dirty exists 2023-01-25T09:52:28.150 INFO:tasks.rados.rados.0.smithi085.stdout:55: left oid 55 (ObjNum 54 snap 0 seq_num 54) 2023-01-25T09:52:28.150 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 1 to smithi085112025-56 2023-01-25T09:52:28.150 INFO:tasks.rados.rados.0.smithi085.stdout:55: done (15 left) 2023-01-25T09:52:28.150 INFO:tasks.rados.rados.0.smithi085.stdout:71: write initial oid 71 2023-01-25T09:52:28.150 INFO:tasks.rados.rados.0.smithi085.stdout:71: seq_num 70 ranges {776490=714607,2246563=579356} 2023-01-25T09:52:28.155 INFO:tasks.rados.rados.0.smithi085.stdout:71: writing smithi085112025-71 from 776490 to 1491097 tid 1 2023-01-25T09:52:28.163 INFO:tasks.rados.rados.0.smithi085.stdout:71: writing smithi085112025-71 from 2246563 to 2825919 tid 2 2023-01-25T09:52:28.163 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.164 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 2 to smithi085112025-56 2023-01-25T09:52:28.164 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 3 to smithi085112025-56 2023-01-25T09:52:28.164 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 4 to smithi085112025-56 2023-01-25T09:52:28.164 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 5 to smithi085112025-56 2023-01-25T09:52:28.164 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 updating version 0 to 25 2023-01-25T09:52:28.165 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 version 25 is already newer than 22 2023-01-25T09:52:28.165 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 version 25 is already newer than 24 2023-01-25T09:52:28.165 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 version 25 is already newer than 23 2023-01-25T09:52:28.165 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 56 v 25 (ObjNum 55 snap 0 seq_num 55) dirty exists 2023-01-25T09:52:28.165 INFO:tasks.rados.rados.0.smithi085.stdout:56: left oid 56 (ObjNum 55 snap 0 seq_num 55) 2023-01-25T09:52:28.166 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 1 to smithi085112025-57 2023-01-25T09:52:28.166 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 2 to smithi085112025-57 2023-01-25T09:52:28.166 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 3 to smithi085112025-57 2023-01-25T09:52:28.166 INFO:tasks.rados.rados.0.smithi085.stdout:56: done (15 left) 2023-01-25T09:52:28.166 INFO:tasks.rados.rados.0.smithi085.stdout:72: write initial oid 72 2023-01-25T09:52:28.167 INFO:tasks.rados.rados.0.smithi085.stdout:72: seq_num 71 ranges {793297=789856,2305045=723014} 2023-01-25T09:52:28.171 INFO:tasks.rados.rados.0.smithi085.stdout:72: writing smithi085112025-72 from 793297 to 1583153 tid 1 2023-01-25T09:52:28.181 INFO:tasks.rados.rados.0.smithi085.stdout:72: writing smithi085112025-72 from 2305045 to 3028059 tid 2 2023-01-25T09:52:28.181 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.181 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 4 to smithi085112025-57 2023-01-25T09:52:28.182 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 5 to smithi085112025-57 2023-01-25T09:52:28.182 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 updating version 0 to 17 2023-01-25T09:52:28.182 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 updating version 17 to 20 2023-01-25T09:52:28.182 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 version 20 is already newer than 19 2023-01-25T09:52:28.182 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 version 20 is already newer than 18 2023-01-25T09:52:28.183 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 57 v 20 (ObjNum 56 snap 0 seq_num 56) dirty exists 2023-01-25T09:52:28.183 INFO:tasks.rados.rados.0.smithi085.stdout:57: left oid 57 (ObjNum 56 snap 0 seq_num 56) 2023-01-25T09:52:28.183 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 1 to smithi085112025-58 2023-01-25T09:52:28.183 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 2 to smithi085112025-58 2023-01-25T09:52:28.183 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 3 to smithi085112025-58 2023-01-25T09:52:28.184 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 4 to smithi085112025-58 2023-01-25T09:52:28.184 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 5 to smithi085112025-58 2023-01-25T09:52:28.184 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 updating version 0 to 26 2023-01-25T09:52:28.184 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 updating version 26 to 27 2023-01-25T09:52:28.184 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 version 27 is already newer than 24 2023-01-25T09:52:28.185 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 version 27 is already newer than 25 2023-01-25T09:52:28.185 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 58 v 27 (ObjNum 57 snap 0 seq_num 57) dirty exists 2023-01-25T09:52:28.185 INFO:tasks.rados.rados.0.smithi085.stdout:58: left oid 58 (ObjNum 57 snap 0 seq_num 57) 2023-01-25T09:52:28.185 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 1 to smithi085112025-59 2023-01-25T09:52:28.185 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 2 to smithi085112025-59 2023-01-25T09:52:28.186 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 3 to smithi085112025-59 2023-01-25T09:52:28.186 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 4 to smithi085112025-59 2023-01-25T09:52:28.186 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 updating version 0 to 23 2023-01-25T09:52:28.186 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 version 23 is already newer than 22 2023-01-25T09:52:28.186 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 version 23 is already newer than 21 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 59 v 23 (ObjNum 58 snap 0 seq_num 58) dirty exists 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:59: left oid 59 (ObjNum 58 snap 0 seq_num 58) 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:57: done (15 left) 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:58: done (14 left) 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:59: done (13 left) 2023-01-25T09:52:28.187 INFO:tasks.rados.rados.0.smithi085.stdout:73: write initial oid 73 2023-01-25T09:52:28.188 INFO:tasks.rados.rados.0.smithi085.stdout:73: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2023-01-25T09:52:28.188 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112025-73 from 410104 to 875209 tid 1 2023-01-25T09:52:28.191 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112025-73 from 1563527 to 2146552 tid 2 2023-01-25T09:52:28.197 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112025-73 from 2810926 to 3210104 tid 3 2023-01-25T09:52:28.198 INFO:tasks.rados.rados.0.smithi085.stdout:74: write initial oid 74 2023-01-25T09:52:28.198 INFO:tasks.rados.rados.0.smithi085.stdout:74: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2023-01-25T09:52:28.203 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112025-74 from 426911 to 967265 tid 1 2023-01-25T09:52:28.211 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112025-74 from 1622009 to 2348692 tid 2 2023-01-25T09:52:28.216 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112025-74 from 3121996 to 3226911 tid 3 2023-01-25T09:52:28.216 INFO:tasks.rados.rados.0.smithi085.stdout:75: write initial oid 75 2023-01-25T09:52:28.216 INFO:tasks.rados.rados.0.smithi085.stdout:75: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2023-01-25T09:52:28.222 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112025-75 from 443718 to 1059321 tid 1 2023-01-25T09:52:28.227 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112025-75 from 1564138 to 2034479 tid 2 2023-01-25T09:52:28.234 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112025-75 from 2633066 to 3243718 tid 3 2023-01-25T09:52:28.234 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.235 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 1 to smithi085112025-60 2023-01-25T09:52:28.235 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 2 to smithi085112025-60 2023-01-25T09:52:28.235 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 3 to smithi085112025-60 2023-01-25T09:52:28.235 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 4 to smithi085112025-60 2023-01-25T09:52:28.236 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 5 to smithi085112025-60 2023-01-25T09:52:28.236 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 updating version 0 to 28 2023-01-25T09:52:28.236 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 updating version 28 to 29 2023-01-25T09:52:28.236 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 version 29 is already newer than 26 2023-01-25T09:52:28.237 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 version 29 is already newer than 27 2023-01-25T09:52:28.237 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 60 v 29 (ObjNum 59 snap 0 seq_num 59) dirty exists 2023-01-25T09:52:28.237 INFO:tasks.rados.rados.0.smithi085.stdout:60: left oid 60 (ObjNum 59 snap 0 seq_num 59) 2023-01-25T09:52:28.237 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 1 to smithi085112025-61 2023-01-25T09:52:28.237 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 2 to smithi085112025-61 2023-01-25T09:52:28.238 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 3 to smithi085112025-61 2023-01-25T09:52:28.238 INFO:tasks.rados.rados.0.smithi085.stdout:60: done (15 left) 2023-01-25T09:52:28.238 INFO:tasks.rados.rados.0.smithi085.stdout:76: write initial oid 76 2023-01-25T09:52:28.238 INFO:tasks.rados.rados.0.smithi085.stdout:76: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2023-01-25T09:52:28.240 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112025-76 from 460525 to 1151377 tid 1 2023-01-25T09:52:28.247 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112025-76 from 1622620 to 2352972 tid 2 2023-01-25T09:52:28.253 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112025-76 from 3060489 to 3260525 tid 3 2023-01-25T09:52:28.253 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.254 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 4 to smithi085112025-61 2023-01-25T09:52:28.254 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 5 to smithi085112025-61 2023-01-25T09:52:28.254 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 0 to 24 2023-01-25T09:52:28.255 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 24 to 26 2023-01-25T09:52:28.255 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 version 26 is already newer than 25 2023-01-25T09:52:28.256 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 26 to 27 2023-01-25T09:52:28.256 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 61 v 27 (ObjNum 60 snap 0 seq_num 60) dirty exists 2023-01-25T09:52:28.256 INFO:tasks.rados.rados.0.smithi085.stdout:61: left oid 61 (ObjNum 60 snap 0 seq_num 60) 2023-01-25T09:52:28.257 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 1 to smithi085112025-62 2023-01-25T09:52:28.257 INFO:tasks.rados.rados.0.smithi085.stdout:61: done (15 left) 2023-01-25T09:52:28.257 INFO:tasks.rados.rados.0.smithi085.stdout:77: write initial oid 77 2023-01-25T09:52:28.257 INFO:tasks.rados.rados.0.smithi085.stdout:77: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2023-01-25T09:52:28.260 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112025-77 from 477332 to 1243433 tid 1 2023-01-25T09:52:28.266 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112025-77 from 1681102 to 2155112 tid 2 2023-01-25T09:52:28.272 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112025-77 from 2687912 to 3277332 tid 3 2023-01-25T09:52:28.272 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.272 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 2 to smithi085112025-62 2023-01-25T09:52:28.273 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 3 to smithi085112025-62 2023-01-25T09:52:28.273 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 4 to smithi085112025-62 2023-01-25T09:52:28.273 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 updating version 0 to 30 2023-01-25T09:52:28.273 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 version 30 is already newer than 28 2023-01-25T09:52:28.274 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 version 30 is already newer than 29 2023-01-25T09:52:28.274 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 62 v 30 (ObjNum 61 snap 0 seq_num 61) dirty exists 2023-01-25T09:52:28.274 INFO:tasks.rados.rados.0.smithi085.stdout:62: left oid 62 (ObjNum 61 snap 0 seq_num 61) 2023-01-25T09:52:28.274 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 1 to smithi085112025-63 2023-01-25T09:52:28.274 INFO:tasks.rados.rados.0.smithi085.stdout:62: done (15 left) 2023-01-25T09:52:28.275 INFO:tasks.rados.rados.0.smithi085.stdout:78: write initial oid 78 2023-01-25T09:52:28.275 INFO:tasks.rados.rados.0.smithi085.stdout:78: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2023-01-25T09:52:28.277 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112025-78 from 494139 to 1051842 tid 1 2023-01-25T09:52:28.283 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112025-78 from 1455937 to 2189958 tid 2 2023-01-25T09:52:28.290 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112025-78 from 2948041 to 3294139 tid 3 2023-01-25T09:52:28.290 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.291 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 2 to smithi085112025-63 2023-01-25T09:52:28.291 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 3 to smithi085112025-63 2023-01-25T09:52:28.291 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 4 to smithi085112025-63 2023-01-25T09:52:28.291 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 updating version 0 to 32 2023-01-25T09:52:28.292 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 updating version 32 to 33 2023-01-25T09:52:28.292 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 version 33 is already newer than 31 2023-01-25T09:52:28.292 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 63 v 33 (ObjNum 62 snap 0 seq_num 62) dirty exists 2023-01-25T09:52:28.292 INFO:tasks.rados.rados.0.smithi085.stdout:63: left oid 63 (ObjNum 62 snap 0 seq_num 62) 2023-01-25T09:52:28.292 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 1 to smithi085112025-64 2023-01-25T09:52:28.293 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 2 to smithi085112025-64 2023-01-25T09:52:28.293 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 3 to smithi085112025-64 2023-01-25T09:52:28.293 INFO:tasks.rados.rados.0.smithi085.stdout:63: done (15 left) 2023-01-25T09:52:28.293 INFO:tasks.rados.rados.0.smithi085.stdout:79: write initial oid 79 2023-01-25T09:52:28.294 INFO:tasks.rados.rados.0.smithi085.stdout:79: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2023-01-25T09:52:28.296 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112025-79 from 510946 to 1143898 tid 1 2023-01-25T09:52:28.302 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112025-79 from 1798066 to 2275745 tid 2 2023-01-25T09:52:28.311 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112025-79 from 2742758 to 3199975 tid 3 2023-01-25T09:52:28.312 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.312 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 1 to smithi085112025-65 2023-01-25T09:52:28.312 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 4 to smithi085112025-64 2023-01-25T09:52:28.313 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 5 to smithi085112025-64 2023-01-25T09:52:28.313 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 updating version 0 to 28 2023-01-25T09:52:28.313 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 updating version 28 to 33 2023-01-25T09:52:28.314 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 version 33 is already newer than 32 2023-01-25T09:52:28.314 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 version 33 is already newer than 29 2023-01-25T09:52:28.315 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 64 v 33 (ObjNum 63 snap 0 seq_num 63) dirty exists 2023-01-25T09:52:28.315 INFO:tasks.rados.rados.0.smithi085.stdout:64: left oid 64 (ObjNum 63 snap 0 seq_num 63) 2023-01-25T09:52:28.315 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 2 to smithi085112025-65 2023-01-25T09:52:28.315 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 3 to smithi085112025-65 2023-01-25T09:52:28.315 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 4 to smithi085112025-65 2023-01-25T09:52:28.316 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 updating version 0 to 36 2023-01-25T09:52:28.316 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 version 36 is already newer than 35 2023-01-25T09:52:28.316 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 version 36 is already newer than 34 2023-01-25T09:52:28.317 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 65 v 36 (ObjNum 64 snap 0 seq_num 64) dirty exists 2023-01-25T09:52:28.317 INFO:tasks.rados.rados.0.smithi085.stdout:65: left oid 65 (ObjNum 64 snap 0 seq_num 64) 2023-01-25T09:52:28.317 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 1 to smithi085112025-66 2023-01-25T09:52:28.318 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 2 to smithi085112025-66 2023-01-25T09:52:28.318 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 3 to smithi085112025-66 2023-01-25T09:52:28.318 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 4 to smithi085112025-66 2023-01-25T09:52:28.318 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 updating version 0 to 38 2023-01-25T09:52:28.319 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 version 38 is already newer than 37 2023-01-25T09:52:28.319 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 updating version 38 to 39 2023-01-25T09:52:28.319 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 66 v 39 (ObjNum 65 snap 0 seq_num 65) dirty exists 2023-01-25T09:52:28.319 INFO:tasks.rados.rados.0.smithi085.stdout:66: left oid 66 (ObjNum 65 snap 0 seq_num 65) 2023-01-25T09:52:28.319 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 1 to smithi085112025-67 2023-01-25T09:52:28.320 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 2 to smithi085112025-67 2023-01-25T09:52:28.320 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 3 to smithi085112025-67 2023-01-25T09:52:28.320 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 4 to smithi085112025-67 2023-01-25T09:52:28.320 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 5 to smithi085112025-67 2023-01-25T09:52:28.321 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 updating version 0 to 31 2023-01-25T09:52:28.321 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 version 31 is already newer than 29 2023-01-25T09:52:28.321 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 version 31 is already newer than 30 2023-01-25T09:52:28.321 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 updating version 31 to 32 2023-01-25T09:52:28.321 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 67 v 32 (ObjNum 66 snap 0 seq_num 66) dirty exists 2023-01-25T09:52:28.322 INFO:tasks.rados.rados.0.smithi085.stdout:67: left oid 67 (ObjNum 66 snap 0 seq_num 66) 2023-01-25T09:52:28.322 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 1 to smithi085112025-68 2023-01-25T09:52:28.322 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 2 to smithi085112025-68 2023-01-25T09:52:28.322 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 3 to smithi085112025-68 2023-01-25T09:52:28.322 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 4 to smithi085112025-68 2023-01-25T09:52:28.323 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 updating version 0 to 35 2023-01-25T09:52:28.323 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 version 35 is already newer than 34 2023-01-25T09:52:28.323 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 version 35 is already newer than 33 2023-01-25T09:52:28.323 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 68 v 35 (ObjNum 67 snap 0 seq_num 67) dirty exists 2023-01-25T09:52:28.323 INFO:tasks.rados.rados.0.smithi085.stdout:68: left oid 68 (ObjNum 67 snap 0 seq_num 67) 2023-01-25T09:52:28.324 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 1 to smithi085112025-69 2023-01-25T09:52:28.324 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 2 to smithi085112025-69 2023-01-25T09:52:28.324 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 3 to smithi085112025-69 2023-01-25T09:52:28.324 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 4 to smithi085112025-69 2023-01-25T09:52:28.324 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 5 to smithi085112025-69 2023-01-25T09:52:28.325 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 updating version 0 to 40 2023-01-25T09:52:28.325 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 updating version 40 to 41 2023-01-25T09:52:28.325 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 updating version 41 to 43 2023-01-25T09:52:28.325 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 version 43 is already newer than 42 2023-01-25T09:52:28.325 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 69 v 43 (ObjNum 68 snap 0 seq_num 68) dirty exists 2023-01-25T09:52:28.326 INFO:tasks.rados.rados.0.smithi085.stdout:69: left oid 69 (ObjNum 68 snap 0 seq_num 68) 2023-01-25T09:52:28.326 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 1 to smithi085112025-70 2023-01-25T09:52:28.326 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 2 to smithi085112025-70 2023-01-25T09:52:28.326 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 3 to smithi085112025-70 2023-01-25T09:52:28.326 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 4 to smithi085112025-70 2023-01-25T09:52:28.327 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 5 to smithi085112025-70 2023-01-25T09:52:28.327 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 updating version 0 to 44 2023-01-25T09:52:28.327 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 updating version 44 to 47 2023-01-25T09:52:28.328 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 version 47 is already newer than 46 2023-01-25T09:52:28.328 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 version 47 is already newer than 45 2023-01-25T09:52:28.328 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 70 v 47 (ObjNum 69 snap 0 seq_num 69) dirty exists 2023-01-25T09:52:28.329 INFO:tasks.rados.rados.0.smithi085.stdout:70: left oid 70 (ObjNum 69 snap 0 seq_num 69) 2023-01-25T09:52:28.329 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 1 to smithi085112025-71 2023-01-25T09:52:28.330 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 2 to smithi085112025-71 2023-01-25T09:52:28.330 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 3 to smithi085112025-71 2023-01-25T09:52:28.330 INFO:tasks.rados.rados.0.smithi085.stdout:64: done (15 left) 2023-01-25T09:52:28.331 INFO:tasks.rados.rados.0.smithi085.stdout:65: done (14 left) 2023-01-25T09:52:28.331 INFO:tasks.rados.rados.0.smithi085.stdout:66: done (13 left) 2023-01-25T09:52:28.331 INFO:tasks.rados.rados.0.smithi085.stdout:67: done (12 left) 2023-01-25T09:52:28.331 INFO:tasks.rados.rados.0.smithi085.stdout:68: done (11 left) 2023-01-25T09:52:28.332 INFO:tasks.rados.rados.0.smithi085.stdout:69: done (10 left) 2023-01-25T09:52:28.332 INFO:tasks.rados.rados.0.smithi085.stdout:70: done (9 left) 2023-01-25T09:52:28.332 INFO:tasks.rados.rados.0.smithi085.stdout:80: write initial oid 80 2023-01-25T09:52:28.332 INFO:tasks.rados.rados.0.smithi085.stdout:80: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2023-01-25T09:52:28.333 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112025-80 from 527753 to 1235954 tid 1 2023-01-25T09:52:28.333 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112025-80 from 1856548 to 2594238 tid 2 2023-01-25T09:52:28.334 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112025-80 from 3286534 to 3327753 tid 3 2023-01-25T09:52:28.334 INFO:tasks.rados.rados.0.smithi085.stdout:81: write initial oid 81 2023-01-25T09:52:28.334 INFO:tasks.rados.rados.0.smithi085.stdout:81: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2023-01-25T09:52:28.334 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112025-81 from 544560 to 1328010 tid 1 2023-01-25T09:52:28.339 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112025-81 from 1915030 to 2396378 tid 2 2023-01-25T09:52:28.344 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112025-81 from 2797604 to 3277365 tid 3 2023-01-25T09:52:28.344 INFO:tasks.rados.rados.0.smithi085.stdout:82: write initial oid 82 2023-01-25T09:52:28.345 INFO:tasks.rados.rados.0.smithi085.stdout:82: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2023-01-25T09:52:28.350 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112025-82 from 561367 to 1020066 tid 1 2023-01-25T09:52:28.357 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112025-82 from 1573512 to 2314871 tid 2 2023-01-25T09:52:28.363 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112025-82 from 2941380 to 3361367 tid 3 2023-01-25T09:52:28.363 INFO:tasks.rados.rados.0.smithi085.stdout:83: write initial oid 83 2023-01-25T09:52:28.363 INFO:tasks.rados.rados.0.smithi085.stdout:83: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2023-01-25T09:52:28.368 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112025-83 from 578174 to 1112122 tid 1 2023-01-25T09:52:28.374 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112025-83 from 1515641 to 2000658 tid 2 2023-01-25T09:52:28.381 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112025-83 from 2736097 to 3238402 tid 3 2023-01-25T09:52:28.381 INFO:tasks.rados.rados.0.smithi085.stdout:84: write initial oid 84 2023-01-25T09:52:28.381 INFO:tasks.rados.rados.0.smithi085.stdout:84: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2023-01-25T09:52:28.387 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112025-84 from 594981 to 1204178 tid 1 2023-01-25T09:52:28.396 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112025-84 from 1974123 to 2719151 tid 2 2023-01-25T09:52:28.400 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112025-84 from 3279873 to 3394981 tid 3 2023-01-25T09:52:28.400 INFO:tasks.rados.rados.0.smithi085.stdout:85: write initial oid 85 2023-01-25T09:52:28.400 INFO:tasks.rados.rados.0.smithi085.stdout:85: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2023-01-25T09:52:28.405 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112025-85 from 611788 to 1012587 tid 1 2023-01-25T09:52:28.412 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112025-85 from 1748958 to 2237644 tid 2 2023-01-25T09:52:28.418 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112025-85 from 2907296 to 3411788 tid 3 2023-01-25T09:52:28.419 INFO:tasks.rados.rados.0.smithi085.stdout:86: write initial oid 86 2023-01-25T09:52:28.419 INFO:tasks.rados.rados.0.smithi085.stdout:86: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2023-01-25T09:52:28.424 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112025-86 from 628595 to 1104643 tid 1 2023-01-25T09:52:28.431 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112025-86 from 1807440 to 2439784 tid 2 2023-01-25T09:52:28.437 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112025-86 from 2934719 to 3387193 tid 3 2023-01-25T09:52:28.438 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.438 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 4 to smithi085112025-71 2023-01-25T09:52:28.439 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 updating version 0 to 30 2023-01-25T09:52:28.439 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 updating version 30 to 31 2023-01-25T09:52:28.439 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 updating version 31 to 32 2023-01-25T09:52:28.440 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 71 v 32 (ObjNum 70 snap 0 seq_num 70) dirty exists 2023-01-25T09:52:28.440 INFO:tasks.rados.rados.0.smithi085.stdout:71: left oid 71 (ObjNum 70 snap 0 seq_num 70) 2023-01-25T09:52:28.441 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 1 to smithi085112025-72 2023-01-25T09:52:28.441 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 2 to smithi085112025-72 2023-01-25T09:52:28.441 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 3 to smithi085112025-72 2023-01-25T09:52:28.442 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 4 to smithi085112025-72 2023-01-25T09:52:28.442 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 0 to 33 2023-01-25T09:52:28.443 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 33 to 34 2023-01-25T09:52:28.443 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 34 to 35 2023-01-25T09:52:28.443 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 72 v 35 (ObjNum 71 snap 0 seq_num 71) dirty exists 2023-01-25T09:52:28.444 INFO:tasks.rados.rados.0.smithi085.stdout:72: left oid 72 (ObjNum 71 snap 0 seq_num 71) 2023-01-25T09:52:28.444 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 1 to smithi085112025-73 2023-01-25T09:52:28.445 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 2 to smithi085112025-73 2023-01-25T09:52:28.445 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 3 to smithi085112025-73 2023-01-25T09:52:28.445 INFO:tasks.rados.rados.0.smithi085.stdout:71: done (15 left) 2023-01-25T09:52:28.446 INFO:tasks.rados.rados.0.smithi085.stdout:72: done (14 left) 2023-01-25T09:52:28.446 INFO:tasks.rados.rados.0.smithi085.stdout:87: write initial oid 87 2023-01-25T09:52:28.446 INFO:tasks.rados.rados.0.smithi085.stdout:87: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2023-01-25T09:52:28.447 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112025-87 from 645402 to 1196699 tid 1 2023-01-25T09:52:28.449 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112025-87 from 1749569 to 2241924 tid 2 2023-01-25T09:52:28.456 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112025-87 from 2845789 to 3445402 tid 3 2023-01-25T09:52:28.456 INFO:tasks.rados.rados.0.smithi085.stdout:88: write initial oid 88 2023-01-25T09:52:28.457 INFO:tasks.rados.rados.0.smithi085.stdout:88: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2023-01-25T09:52:28.463 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112025-88 from 662209 to 1288755 tid 1 2023-01-25T09:52:28.469 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112025-88 from 1808051 to 2444064 tid 2 2023-01-25T09:52:28.475 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112025-88 from 2873212 to 3462209 tid 3 2023-01-25T09:52:28.476 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.476 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 4 to smithi085112025-73 2023-01-25T09:52:28.476 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 1 to smithi085112025-74 2023-01-25T09:52:28.476 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 5 to smithi085112025-73 2023-01-25T09:52:28.477 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 0 to 30 2023-01-25T09:52:28.477 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 30 to 31 2023-01-25T09:52:28.477 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 31 to 32 2023-01-25T09:52:28.477 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 32 to 33 2023-01-25T09:52:28.477 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 73 v 33 (ObjNum 72 snap 0 seq_num 72) dirty exists 2023-01-25T09:52:28.478 INFO:tasks.rados.rados.0.smithi085.stdout:73: left oid 73 (ObjNum 72 snap 0 seq_num 72) 2023-01-25T09:52:28.478 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 2 to smithi085112025-74 2023-01-25T09:52:28.478 INFO:tasks.rados.rados.0.smithi085.stdout:73: done (15 left) 2023-01-25T09:52:28.478 INFO:tasks.rados.rados.0.smithi085.stdout:89: write initial oid 89 2023-01-25T09:52:28.478 INFO:tasks.rados.rados.0.smithi085.stdout:89: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2023-01-25T09:52:28.482 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112025-89 from 679016 to 1380811 tid 1 2023-01-25T09:52:28.488 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112025-89 from 1866533 to 2362557 tid 2 2023-01-25T09:52:28.496 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112025-89 from 2900635 to 3303278 tid 3 2023-01-25T09:52:28.496 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.496 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 3 to smithi085112025-74 2023-01-25T09:52:28.496 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 4 to smithi085112025-74 2023-01-25T09:52:28.496 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 5 to smithi085112025-74 2023-01-25T09:52:28.497 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 updating version 0 to 36 2023-01-25T09:52:28.497 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 updating version 36 to 37 2023-01-25T09:52:28.497 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 updating version 37 to 39 2023-01-25T09:52:28.497 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 version 39 is already newer than 38 2023-01-25T09:52:28.497 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 74 v 39 (ObjNum 73 snap 0 seq_num 73) dirty exists 2023-01-25T09:52:28.498 INFO:tasks.rados.rados.0.smithi085.stdout:74: left oid 74 (ObjNum 73 snap 0 seq_num 73) 2023-01-25T09:52:28.498 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 1 to smithi085112025-75 2023-01-25T09:52:28.498 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 2 to smithi085112025-75 2023-01-25T09:52:28.498 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 3 to smithi085112025-75 2023-01-25T09:52:28.498 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 4 to smithi085112025-75 2023-01-25T09:52:28.499 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 5 to smithi085112025-75 2023-01-25T09:52:28.499 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 updating version 0 to 50 2023-01-25T09:52:28.499 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 updating version 50 to 51 2023-01-25T09:52:28.499 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 version 51 is already newer than 49 2023-01-25T09:52:28.499 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 version 51 is already newer than 48 2023-01-25T09:52:28.500 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 75 v 51 (ObjNum 74 snap 0 seq_num 74) dirty exists 2023-01-25T09:52:28.500 INFO:tasks.rados.rados.0.smithi085.stdout:75: left oid 75 (ObjNum 74 snap 0 seq_num 74) 2023-01-25T09:52:28.500 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 1 to smithi085112025-76 2023-01-25T09:52:28.500 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 2 to smithi085112025-76 2023-01-25T09:52:28.500 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 3 to smithi085112025-76 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 4 to smithi085112025-76 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 5 to smithi085112025-76 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 updating version 0 to 37 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 updating version 37 to 40 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 updating version 40 to 42 2023-01-25T09:52:28.501 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 version 42 is already newer than 41 2023-01-25T09:52:28.502 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 76 v 42 (ObjNum 75 snap 0 seq_num 75) dirty exists 2023-01-25T09:52:28.502 INFO:tasks.rados.rados.0.smithi085.stdout:76: left oid 76 (ObjNum 75 snap 0 seq_num 75) 2023-01-25T09:52:28.502 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 1 to smithi085112025-77 2023-01-25T09:52:28.502 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 2 to smithi085112025-77 2023-01-25T09:52:28.502 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 3 to smithi085112025-77 2023-01-25T09:52:28.503 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 4 to smithi085112025-77 2023-01-25T09:52:28.503 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 5 to smithi085112025-77 2023-01-25T09:52:28.503 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 updating version 0 to 36 2023-01-25T09:52:28.503 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 version 36 is already newer than 35 2023-01-25T09:52:28.504 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 updating version 36 to 37 2023-01-25T09:52:28.504 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 version 37 is already newer than 34 2023-01-25T09:52:28.504 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 77 v 37 (ObjNum 76 snap 0 seq_num 76) dirty exists 2023-01-25T09:52:28.504 INFO:tasks.rados.rados.0.smithi085.stdout:77: left oid 77 (ObjNum 76 snap 0 seq_num 76) 2023-01-25T09:52:28.505 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 1 to smithi085112025-78 2023-01-25T09:52:28.505 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 2 to smithi085112025-78 2023-01-25T09:52:28.505 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 3 to smithi085112025-78 2023-01-25T09:52:28.505 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 4 to smithi085112025-78 2023-01-25T09:52:28.505 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 5 to smithi085112025-78 2023-01-25T09:52:28.506 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 0 to 38 2023-01-25T09:52:28.506 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 38 to 39 2023-01-25T09:52:28.506 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 39 to 41 2023-01-25T09:52:28.506 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 version 41 is already newer than 40 2023-01-25T09:52:28.506 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 78 v 41 (ObjNum 77 snap 0 seq_num 77) dirty exists 2023-01-25T09:52:28.507 INFO:tasks.rados.rados.0.smithi085.stdout:78: left oid 78 (ObjNum 77 snap 0 seq_num 77) 2023-01-25T09:52:28.507 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 1 to smithi085112025-79 2023-01-25T09:52:28.507 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 2 to smithi085112025-79 2023-01-25T09:52:28.507 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 3 to smithi085112025-79 2023-01-25T09:52:28.507 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 4 to smithi085112025-79 2023-01-25T09:52:28.508 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 5 to smithi085112025-79 2023-01-25T09:52:28.508 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 updating version 0 to 36 2023-01-25T09:52:28.508 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 updating version 36 to 38 2023-01-25T09:52:28.508 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 version 38 is already newer than 37 2023-01-25T09:52:28.508 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 updating version 38 to 39 2023-01-25T09:52:28.509 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 79 v 39 (ObjNum 78 snap 0 seq_num 78) dirty exists 2023-01-25T09:52:28.509 INFO:tasks.rados.rados.0.smithi085.stdout:79: left oid 79 (ObjNum 78 snap 0 seq_num 78) 2023-01-25T09:52:28.509 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 1 to smithi085112025-80 2023-01-25T09:52:28.509 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 2 to smithi085112025-80 2023-01-25T09:52:28.509 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 3 to smithi085112025-80 2023-01-25T09:52:28.510 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 4 to smithi085112025-80 2023-01-25T09:52:28.510 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 5 to smithi085112025-80 2023-01-25T09:52:28.510 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 updating version 0 to 45 2023-01-25T09:52:28.510 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 version 45 is already newer than 42 2023-01-25T09:52:28.510 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 version 45 is already newer than 43 2023-01-25T09:52:28.511 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 version 45 is already newer than 44 2023-01-25T09:52:28.511 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 80 v 45 (ObjNum 79 snap 0 seq_num 79) dirty exists 2023-01-25T09:52:28.511 INFO:tasks.rados.rados.0.smithi085.stdout:80: left oid 80 (ObjNum 79 snap 0 seq_num 79) 2023-01-25T09:52:28.511 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 1 to smithi085112025-81 2023-01-25T09:52:28.511 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 2 to smithi085112025-81 2023-01-25T09:52:28.512 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 3 to smithi085112025-81 2023-01-25T09:52:28.512 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 4 to smithi085112025-81 2023-01-25T09:52:28.512 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 5 to smithi085112025-81 2023-01-25T09:52:28.512 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 updating version 0 to 38 2023-01-25T09:52:28.512 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 updating version 38 to 45 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 version 45 is already newer than 43 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 version 45 is already newer than 44 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 81 v 45 (ObjNum 80 snap 0 seq_num 80) dirty exists 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:81: left oid 81 (ObjNum 80 snap 0 seq_num 80) 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 1 to smithi085112025-82 2023-01-25T09:52:28.513 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 2 to smithi085112025-82 2023-01-25T09:52:28.514 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 3 to smithi085112025-82 2023-01-25T09:52:28.514 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 4 to smithi085112025-82 2023-01-25T09:52:28.514 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 5 to smithi085112025-82 2023-01-25T09:52:28.515 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 updating version 0 to 41 2023-01-25T09:52:28.515 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 version 41 is already newer than 37 2023-01-25T09:52:28.515 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 updating version 41 to 42 2023-01-25T09:52:28.515 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 version 42 is already newer than 40 2023-01-25T09:52:28.515 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 82 v 42 (ObjNum 81 snap 0 seq_num 81) dirty exists 2023-01-25T09:52:28.516 INFO:tasks.rados.rados.0.smithi085.stdout:82: left oid 82 (ObjNum 81 snap 0 seq_num 81) 2023-01-25T09:52:28.516 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 1 to smithi085112025-83 2023-01-25T09:52:28.516 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 2 to smithi085112025-83 2023-01-25T09:52:28.516 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 3 to smithi085112025-83 2023-01-25T09:52:28.516 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 4 to smithi085112025-83 2023-01-25T09:52:28.517 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 5 to smithi085112025-83 2023-01-25T09:52:28.517 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 updating version 0 to 54 2023-01-25T09:52:28.517 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 version 54 is already newer than 52 2023-01-25T09:52:28.517 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 updating version 54 to 55 2023-01-25T09:52:28.517 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 version 55 is already newer than 53 2023-01-25T09:52:28.518 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 83 v 55 (ObjNum 82 snap 0 seq_num 82) dirty exists 2023-01-25T09:52:28.518 INFO:tasks.rados.rados.0.smithi085.stdout:83: left oid 83 (ObjNum 82 snap 0 seq_num 82) 2023-01-25T09:52:28.518 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 1 to smithi085112025-84 2023-01-25T09:52:28.518 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 2 to smithi085112025-84 2023-01-25T09:52:28.518 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 1 to smithi085112025-85 2023-01-25T09:52:28.519 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 3 to smithi085112025-84 2023-01-25T09:52:28.519 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 4 to smithi085112025-84 2023-01-25T09:52:28.519 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 5 to smithi085112025-84 2023-01-25T09:52:28.519 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 updating version 0 to 39 2023-01-25T09:52:28.519 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 updating version 39 to 47 2023-01-25T09:52:28.520 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 version 47 is already newer than 46 2023-01-25T09:52:28.520 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 version 47 is already newer than 40 2023-01-25T09:52:28.520 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 84 v 47 (ObjNum 83 snap 0 seq_num 83) dirty exists 2023-01-25T09:52:28.520 INFO:tasks.rados.rados.0.smithi085.stdout:84: left oid 84 (ObjNum 83 snap 0 seq_num 83) 2023-01-25T09:52:28.520 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 2 to smithi085112025-85 2023-01-25T09:52:28.521 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 3 to smithi085112025-85 2023-01-25T09:52:28.521 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 4 to smithi085112025-85 2023-01-25T09:52:28.521 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 5 to smithi085112025-85 2023-01-25T09:52:28.521 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 0 to 43 2023-01-25T09:52:28.521 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 43 to 44 2023-01-25T09:52:28.522 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 44 to 45 2023-01-25T09:52:28.522 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 version 45 is already newer than 38 2023-01-25T09:52:28.522 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 85 v 45 (ObjNum 84 snap 0 seq_num 84) dirty exists 2023-01-25T09:52:28.522 INFO:tasks.rados.rados.0.smithi085.stdout:85: left oid 85 (ObjNum 84 snap 0 seq_num 84) 2023-01-25T09:52:28.522 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 1 to smithi085112025-86 2023-01-25T09:52:28.523 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 2 to smithi085112025-86 2023-01-25T09:52:28.523 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 3 to smithi085112025-86 2023-01-25T09:52:28.523 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 4 to smithi085112025-86 2023-01-25T09:52:28.523 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 5 to smithi085112025-86 2023-01-25T09:52:28.523 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 0 to 46 2023-01-25T09:52:28.524 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 46 to 48 2023-01-25T09:52:28.524 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 version 48 is already newer than 47 2023-01-25T09:52:28.524 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 48 to 49 2023-01-25T09:52:28.524 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 86 v 49 (ObjNum 85 snap 0 seq_num 85) dirty exists 2023-01-25T09:52:28.525 INFO:tasks.rados.rados.0.smithi085.stdout:86: left oid 86 (ObjNum 85 snap 0 seq_num 85) 2023-01-25T09:52:28.525 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 1 to smithi085112025-87 2023-01-25T09:52:28.525 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 2 to smithi085112025-87 2023-01-25T09:52:28.525 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 3 to smithi085112025-87 2023-01-25T09:52:28.525 INFO:tasks.rados.rados.0.smithi085.stdout:74: done (15 left) 2023-01-25T09:52:28.526 INFO:tasks.rados.rados.0.smithi085.stdout:75: done (14 left) 2023-01-25T09:52:28.526 INFO:tasks.rados.rados.0.smithi085.stdout:76: done (13 left) 2023-01-25T09:52:28.526 INFO:tasks.rados.rados.0.smithi085.stdout:77: done (12 left) 2023-01-25T09:52:28.526 INFO:tasks.rados.rados.0.smithi085.stdout:78: done (11 left) 2023-01-25T09:52:28.526 INFO:tasks.rados.rados.0.smithi085.stdout:79: done (10 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:80: done (9 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:81: done (8 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:82: done (7 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:83: done (6 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:84: done (5 left) 2023-01-25T09:52:28.527 INFO:tasks.rados.rados.0.smithi085.stdout:85: done (4 left) 2023-01-25T09:52:28.528 INFO:tasks.rados.rados.0.smithi085.stdout:86: done (3 left) 2023-01-25T09:52:28.528 INFO:tasks.rados.rados.0.smithi085.stdout:90: write initial oid 90 2023-01-25T09:52:28.528 INFO:tasks.rados.rados.0.smithi085.stdout:90: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2023-01-25T09:52:28.529 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112025-90 from 695823 to 1472867 tid 1 2023-01-25T09:52:28.530 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112025-90 from 1925015 to 2564697 tid 2 2023-01-25T09:52:28.530 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112025-90 from 3328058 to 3495823 tid 3 2023-01-25T09:52:28.530 INFO:tasks.rados.rados.0.smithi085.stdout:91: write initial oid 91 2023-01-25T09:52:28.530 INFO:tasks.rados.rados.0.smithi085.stdout:91: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2023-01-25T09:52:28.531 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112025-91 from 712630 to 1164923 tid 1 2023-01-25T09:52:28.531 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112025-91 from 1583497 to 2083190 tid 2 2023-01-25T09:52:28.531 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112025-91 from 2555481 to 2980668 tid 3 2023-01-25T09:52:28.531 INFO:tasks.rados.rados.0.smithi085.stdout:92: write initial oid 92 2023-01-25T09:52:28.531 INFO:tasks.rados.rados.0.smithi085.stdout:92: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2023-01-25T09:52:28.536 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112025-92 from 729437 to 1256979 tid 1 2023-01-25T09:52:28.543 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112025-92 from 1925626 to 2568977 tid 2 2023-01-25T09:52:28.549 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112025-92 from 3266551 to 3529437 tid 3 2023-01-25T09:52:28.549 INFO:tasks.rados.rados.0.smithi085.stdout:93: write initial oid 93 2023-01-25T09:52:28.549 INFO:tasks.rados.rados.0.smithi085.stdout:93: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2023-01-25T09:52:28.557 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112025-93 from 746244 to 1465388 tid 1 2023-01-25T09:52:28.563 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112025-93 from 2100461 to 2603823 tid 2 2023-01-25T09:52:28.569 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112025-93 from 3126680 to 3546244 tid 3 2023-01-25T09:52:28.569 INFO:tasks.rados.rados.0.smithi085.stdout:94: write initial oid 94 2023-01-25T09:52:28.569 INFO:tasks.rados.rados.0.smithi085.stdout:94: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2023-01-25T09:52:28.577 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112025-94 from 763051 to 1557444 tid 1 2023-01-25T09:52:28.584 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112025-94 from 2158943 to 2805963 tid 2 2023-01-25T09:52:28.588 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112025-94 from 3437750 to 3563051 tid 3 2023-01-25T09:52:28.588 INFO:tasks.rados.rados.0.smithi085.stdout:95: write initial oid 95 2023-01-25T09:52:28.589 INFO:tasks.rados.rados.0.smithi085.stdout:95: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2023-01-25T09:52:28.595 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112025-95 from 779858 to 1249500 tid 1 2023-01-25T09:52:28.601 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112025-95 from 1817425 to 2324456 tid 2 2023-01-25T09:52:28.607 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112025-95 from 2781526 to 3368154 tid 3 2023-01-25T09:52:28.607 INFO:tasks.rados.rados.0.smithi085.stdout:96: write initial oid 96 2023-01-25T09:52:28.608 INFO:tasks.rados.rados.0.smithi085.stdout:96: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2023-01-25T09:52:28.614 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112025-96 from 796665 to 1341556 tid 1 2023-01-25T09:52:28.620 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112025-96 from 1759554 to 2410243 tid 2 2023-01-25T09:52:28.627 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112025-96 from 2976243 to 3596665 tid 3 2023-01-25T09:52:28.627 INFO:tasks.rados.rados.0.smithi085.stdout:97: write initial oid 97 2023-01-25T09:52:28.627 INFO:tasks.rados.rados.0.smithi085.stdout:97: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2023-01-25T09:52:28.632 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112025-97 from 413472 to 1033612 tid 1 2023-01-25T09:52:28.639 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112025-97 from 1818036 to 2328736 tid 2 2023-01-25T09:52:28.647 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112025-97 from 3120019 to 3613472 tid 3 2023-01-25T09:52:28.648 INFO:tasks.rados.rados.0.smithi085.stdout:98: write initial oid 98 2023-01-25T09:52:28.648 INFO:tasks.rados.rados.0.smithi085.stdout:98: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2023-01-25T09:52:28.652 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112025-98 from 430279 to 1125668 tid 1 2023-01-25T09:52:28.660 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112025-98 from 1876518 to 2530876 tid 2 2023-01-25T09:52:28.666 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112025-98 from 3031089 to 3567886 tid 3 2023-01-25T09:52:28.666 INFO:tasks.rados.rados.0.smithi085.stdout:99: write initial oid 99 2023-01-25T09:52:28.666 INFO:tasks.rados.rados.0.smithi085.stdout:99: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2023-01-25T09:52:28.672 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112025-99 from 447086 to 1217724 tid 1 2023-01-25T09:52:28.681 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112025-99 from 1935000 to 2733016 tid 2 2023-01-25T09:52:28.686 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112025-99 from 3458512 to 3647086 tid 3 2023-01-25T09:52:28.686 INFO:tasks.rados.rados.0.smithi085.stdout:100: write initial oid 100 2023-01-25T09:52:28.686 INFO:tasks.rados.rados.0.smithi085.stdout:100: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2023-01-25T09:52:28.692 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112025-100 from 463893 to 1026133 tid 1 2023-01-25T09:52:28.698 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112025-100 from 1593482 to 2251509 tid 2 2023-01-25T09:52:28.704 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112025-100 from 2685935 to 3245276 tid 3 2023-01-25T09:52:28.704 INFO:tasks.rados.rados.0.smithi085.stdout:101: write initial oid 101 2023-01-25T09:52:28.705 INFO:tasks.rados.rados.0.smithi085.stdout:101: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2023-01-25T09:52:28.710 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112025-101 from 480700 to 1118189 tid 1 2023-01-25T09:52:28.715 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112025-101 from 1651964 to 2053649 tid 2 2023-01-25T09:52:28.723 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112025-101 from 2713358 to 3483971 tid 3 2023-01-25T09:52:28.724 INFO:tasks.rados.rados.0.smithi085.stdout:102: write initial oid 102 2023-01-25T09:52:28.724 INFO:tasks.rados.rados.0.smithi085.stdout:102: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2023-01-25T09:52:28.730 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112025-102 from 497507 to 1210245 tid 1 2023-01-25T09:52:28.736 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112025-102 from 1710446 to 2372142 tid 2 2023-01-25T09:52:28.745 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112025-102 from 3140781 to 3697507 tid 3 2023-01-25T09:52:28.745 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.745 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 4 to smithi085112025-87 2023-01-25T09:52:28.745 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 5 to smithi085112025-87 2023-01-25T09:52:28.745 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 0 to 43 2023-01-25T09:52:28.746 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 version 43 is already newer than 42 2023-01-25T09:52:28.746 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 43 to 44 2023-01-25T09:52:28.746 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 version 44 is already newer than 41 2023-01-25T09:52:28.746 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 87 v 44 (ObjNum 86 snap 0 seq_num 86) dirty exists 2023-01-25T09:52:28.746 INFO:tasks.rados.rados.0.smithi085.stdout:87: left oid 87 (ObjNum 86 snap 0 seq_num 86) 2023-01-25T09:52:28.747 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 1 to smithi085112025-88 2023-01-25T09:52:28.747 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 2 to smithi085112025-88 2023-01-25T09:52:28.747 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 1 to smithi085112025-89 2023-01-25T09:52:28.747 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 3 to smithi085112025-88 2023-01-25T09:52:28.747 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 4 to smithi085112025-88 2023-01-25T09:52:28.748 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 5 to smithi085112025-88 2023-01-25T09:52:28.748 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 updating version 0 to 40 2023-01-25T09:52:28.748 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 version 40 is already newer than 39 2023-01-25T09:52:28.748 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 updating version 40 to 47 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 updating version 47 to 48 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 88 v 48 (ObjNum 87 snap 0 seq_num 87) dirty exists 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:88: left oid 88 (ObjNum 87 snap 0 seq_num 87) 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:87: done (15 left) 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:88: done (14 left) 2023-01-25T09:52:28.749 INFO:tasks.rados.rados.0.smithi085.stdout:103: write initial oid 103 2023-01-25T09:52:28.750 INFO:tasks.rados.rados.0.smithi085.stdout:103: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2023-01-25T09:52:28.751 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112025-103 from 514314 to 1302301 tid 1 2023-01-25T09:52:28.755 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112025-103 from 1768928 to 2174282 tid 2 2023-01-25T09:52:28.762 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112025-103 from 2768204 to 3277714 tid 3 2023-01-25T09:52:28.762 INFO:tasks.rados.rados.0.smithi085.stdout:104: write initial oid 104 2023-01-25T09:52:28.762 INFO:tasks.rados.rados.0.smithi085.stdout:104: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2023-01-25T09:52:28.767 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112025-104 from 531121 to 994357 tid 1 2023-01-25T09:52:28.774 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112025-104 from 1711057 to 2376422 tid 2 2023-01-25T09:52:28.783 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112025-104 from 3079274 to 3731121 tid 3 2023-01-25T09:52:28.784 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.784 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 2 to smithi085112025-89 2023-01-25T09:52:28.784 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 3 to smithi085112025-89 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 4 to smithi085112025-89 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 5 to smithi085112025-89 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 updating version 0 to 56 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 updating version 56 to 57 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 updating version 57 to 58 2023-01-25T09:52:28.785 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 version 58 is already newer than 53 2023-01-25T09:52:28.786 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 89 v 58 (ObjNum 88 snap 0 seq_num 88) dirty exists 2023-01-25T09:52:28.786 INFO:tasks.rados.rados.0.smithi085.stdout:89: left oid 89 (ObjNum 88 snap 0 seq_num 88) 2023-01-25T09:52:28.786 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 1 to smithi085112025-90 2023-01-25T09:52:28.786 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 2 to smithi085112025-90 2023-01-25T09:52:28.786 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 3 to smithi085112025-90 2023-01-25T09:52:28.787 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 4 to smithi085112025-90 2023-01-25T09:52:28.787 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 5 to smithi085112025-90 2023-01-25T09:52:28.787 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 updating version 0 to 43 2023-01-25T09:52:28.787 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 updating version 43 to 44 2023-01-25T09:52:28.787 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 version 44 is already newer than 41 2023-01-25T09:52:28.788 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 version 44 is already newer than 42 2023-01-25T09:52:28.788 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 90 v 44 (ObjNum 89 snap 0 seq_num 89) dirty exists 2023-01-25T09:52:28.788 INFO:tasks.rados.rados.0.smithi085.stdout:90: left oid 90 (ObjNum 89 snap 0 seq_num 89) 2023-01-25T09:52:28.788 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 1 to smithi085112025-91 2023-01-25T09:52:28.788 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 2 to smithi085112025-91 2023-01-25T09:52:28.789 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 3 to smithi085112025-91 2023-01-25T09:52:28.789 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 4 to smithi085112025-91 2023-01-25T09:52:28.789 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 5 to smithi085112025-91 2023-01-25T09:52:28.789 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 updating version 0 to 53 2023-01-25T09:52:28.789 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 53 is already newer than 51 2023-01-25T09:52:28.790 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 53 is already newer than 50 2023-01-25T09:52:28.790 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 53 is already newer than 52 2023-01-25T09:52:28.790 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 91 v 53 (ObjNum 90 snap 0 seq_num 90) dirty exists 2023-01-25T09:52:28.790 INFO:tasks.rados.rados.0.smithi085.stdout:91: left oid 91 (ObjNum 90 snap 0 seq_num 90) 2023-01-25T09:52:28.790 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 1 to smithi085112025-92 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 2 to smithi085112025-92 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:89: done (15 left) 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:90: done (14 left) 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:91: done (13 left) 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:105: write initial oid 105 2023-01-25T09:52:28.791 INFO:tasks.rados.rados.0.smithi085.stdout:105: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2023-01-25T09:52:28.792 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112025-105 from 547928 to 1086413 tid 1 2023-01-25T09:52:28.794 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112025-105 from 1769539 to 2178562 tid 2 2023-01-25T09:52:28.800 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112025-105 from 2706697 to 3238751 tid 3 2023-01-25T09:52:28.800 INFO:tasks.rados.rados.0.smithi085.stdout:106: write initial oid 106 2023-01-25T09:52:28.801 INFO:tasks.rados.rados.0.smithi085.stdout:106: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2023-01-25T09:52:28.806 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112025-106 from 564735 to 1178469 tid 1 2023-01-25T09:52:28.814 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112025-106 from 1828021 to 2497055 tid 2 2023-01-25T09:52:28.821 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112025-106 from 3134120 to 3764735 tid 3 2023-01-25T09:52:28.821 INFO:tasks.rados.rados.0.smithi085.stdout:107: write initial oid 107 2023-01-25T09:52:28.821 INFO:tasks.rados.rados.0.smithi085.stdout:107: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2023-01-25T09:52:28.828 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112025-107 from 581542 to 1270525 tid 1 2023-01-25T09:52:28.833 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112025-107 from 1886503 to 2299195 tid 2 2023-01-25T09:52:28.840 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112025-107 from 2761543 to 3432494 tid 3 2023-01-25T09:52:28.841 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.841 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 3 to smithi085112025-92 2023-01-25T09:52:28.841 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 4 to smithi085112025-92 2023-01-25T09:52:28.841 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 5 to smithi085112025-92 2023-01-25T09:52:28.841 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 updating version 0 to 55 2023-01-25T09:52:28.842 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 updating version 55 to 57 2023-01-25T09:52:28.842 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 version 57 is already newer than 54 2023-01-25T09:52:28.842 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 version 57 is already newer than 56 2023-01-25T09:52:28.842 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 92 v 57 (ObjNum 91 snap 0 seq_num 91) dirty exists 2023-01-25T09:52:28.842 INFO:tasks.rados.rados.0.smithi085.stdout:92: left oid 92 (ObjNum 91 snap 0 seq_num 91) 2023-01-25T09:52:28.843 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 1 to smithi085112025-93 2023-01-25T09:52:28.843 INFO:tasks.rados.rados.0.smithi085.stdout:92: done (15 left) 2023-01-25T09:52:28.843 INFO:tasks.rados.rados.0.smithi085.stdout:108: write initial oid 108 2023-01-25T09:52:28.843 INFO:tasks.rados.rados.0.smithi085.stdout:108: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2023-01-25T09:52:28.846 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112025-108 from 598349 to 1078934 tid 1 2023-01-25T09:52:28.852 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112025-108 from 1544985 to 2217688 tid 2 2023-01-25T09:52:28.859 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112025-108 from 2905319 to 3387542 tid 3 2023-01-25T09:52:28.859 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.859 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 2 to smithi085112025-93 2023-01-25T09:52:28.860 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 3 to smithi085112025-93 2023-01-25T09:52:28.860 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 4 to smithi085112025-93 2023-01-25T09:52:28.860 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 5 to smithi085112025-93 2023-01-25T09:52:28.860 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 updating version 0 to 60 2023-01-25T09:52:28.860 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 version 60 is already newer than 59 2023-01-25T09:52:28.861 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 updating version 60 to 61 2023-01-25T09:52:28.861 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 version 61 is already newer than 58 2023-01-25T09:52:28.861 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 93 v 61 (ObjNum 92 snap 0 seq_num 92) dirty exists 2023-01-25T09:52:28.861 INFO:tasks.rados.rados.0.smithi085.stdout:93: left oid 93 (ObjNum 92 snap 0 seq_num 92) 2023-01-25T09:52:28.861 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 1 to smithi085112025-94 2023-01-25T09:52:28.862 INFO:tasks.rados.rados.0.smithi085.stdout:93: done (15 left) 2023-01-25T09:52:28.862 INFO:tasks.rados.rados.0.smithi085.stdout:109: write initial oid 109 2023-01-25T09:52:28.862 INFO:tasks.rados.rados.0.smithi085.stdout:109: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2023-01-25T09:52:28.865 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112025-109 from 615156 to 1170990 tid 1 2023-01-25T09:52:28.869 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112025-109 from 1603467 to 2019828 tid 2 2023-01-25T09:52:28.878 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112025-109 from 2816389 to 3509884 tid 3 2023-01-25T09:52:28.879 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.879 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 2 to smithi085112025-94 2023-01-25T09:52:28.879 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 3 to smithi085112025-94 2023-01-25T09:52:28.879 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 4 to smithi085112025-94 2023-01-25T09:52:28.880 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 5 to smithi085112025-94 2023-01-25T09:52:28.880 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 updating version 0 to 65 2023-01-25T09:52:28.880 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 version 65 is already newer than 62 2023-01-25T09:52:28.880 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 version 65 is already newer than 64 2023-01-25T09:52:28.880 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 version 65 is already newer than 63 2023-01-25T09:52:28.881 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 94 v 65 (ObjNum 93 snap 0 seq_num 93) dirty exists 2023-01-25T09:52:28.881 INFO:tasks.rados.rados.0.smithi085.stdout:94: left oid 94 (ObjNum 93 snap 0 seq_num 93) 2023-01-25T09:52:28.881 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 1 to smithi085112025-95 2023-01-25T09:52:28.881 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 2 to smithi085112025-95 2023-01-25T09:52:28.881 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 3 to smithi085112025-95 2023-01-25T09:52:28.882 INFO:tasks.rados.rados.0.smithi085.stdout:94: done (15 left) 2023-01-25T09:52:28.882 INFO:tasks.rados.rados.0.smithi085.stdout:110: write initial oid 110 2023-01-25T09:52:28.882 INFO:tasks.rados.rados.0.smithi085.stdout:110: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2023-01-25T09:52:28.885 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112025-110 from 631963 to 1263046 tid 1 2023-01-25T09:52:28.892 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112025-110 from 2061949 to 2621968 tid 2 2023-01-25T09:52:28.899 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112025-110 from 3243812 to 3748579 tid 3 2023-01-25T09:52:28.899 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.899 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 4 to smithi085112025-95 2023-01-25T09:52:28.900 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 5 to smithi085112025-95 2023-01-25T09:52:28.900 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 updating version 0 to 45 2023-01-25T09:52:28.900 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 updating version 45 to 48 2023-01-25T09:52:28.900 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 version 48 is already newer than 47 2023-01-25T09:52:28.900 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 version 48 is already newer than 46 2023-01-25T09:52:28.901 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 95 v 48 (ObjNum 94 snap 0 seq_num 94) dirty exists 2023-01-25T09:52:28.901 INFO:tasks.rados.rados.0.smithi085.stdout:95: left oid 95 (ObjNum 94 snap 0 seq_num 94) 2023-01-25T09:52:28.901 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 1 to smithi085112025-96 2023-01-25T09:52:28.901 INFO:tasks.rados.rados.0.smithi085.stdout:95: done (15 left) 2023-01-25T09:52:28.901 INFO:tasks.rados.rados.0.smithi085.stdout:111: write initial oid 111 2023-01-25T09:52:28.902 INFO:tasks.rados.rados.0.smithi085.stdout:111: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2023-01-25T09:52:28.906 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112025-111 from 648770 to 1355102 tid 1 2023-01-25T09:52:28.912 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112025-111 from 2120431 to 2540461 tid 2 2023-01-25T09:52:28.920 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112025-111 from 3271235 to 3703627 tid 3 2023-01-25T09:52:28.920 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.920 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 2 to smithi085112025-96 2023-01-25T09:52:28.920 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 3 to smithi085112025-96 2023-01-25T09:52:28.921 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 4 to smithi085112025-96 2023-01-25T09:52:28.921 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 5 to smithi085112025-96 2023-01-25T09:52:28.921 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 updating version 0 to 49 2023-01-25T09:52:28.921 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 updating version 49 to 52 2023-01-25T09:52:28.921 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 version 52 is already newer than 51 2023-01-25T09:52:28.922 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 version 52 is already newer than 50 2023-01-25T09:52:28.922 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 96 v 52 (ObjNum 95 snap 0 seq_num 95) dirty exists 2023-01-25T09:52:28.922 INFO:tasks.rados.rados.0.smithi085.stdout:96: left oid 96 (ObjNum 95 snap 0 seq_num 95) 2023-01-25T09:52:28.922 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 1 to smithi085112025-97 2023-01-25T09:52:28.922 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 2 to smithi085112025-97 2023-01-25T09:52:28.923 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 3 to smithi085112025-97 2023-01-25T09:52:28.923 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 4 to smithi085112025-97 2023-01-25T09:52:28.923 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 5 to smithi085112025-97 2023-01-25T09:52:28.923 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 0 to 54 2023-01-25T09:52:28.923 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 54 to 56 2023-01-25T09:52:28.924 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 version 56 is already newer than 53 2023-01-25T09:52:28.924 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 version 56 is already newer than 55 2023-01-25T09:52:28.924 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 97 v 56 (ObjNum 96 snap 0 seq_num 96) dirty exists 2023-01-25T09:52:28.924 INFO:tasks.rados.rados.0.smithi085.stdout:97: left oid 97 (ObjNum 96 snap 0 seq_num 96) 2023-01-25T09:52:28.924 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 1 to smithi085112025-98 2023-01-25T09:52:28.925 INFO:tasks.rados.rados.0.smithi085.stdout:96: done (15 left) 2023-01-25T09:52:28.925 INFO:tasks.rados.rados.0.smithi085.stdout:97: done (14 left) 2023-01-25T09:52:28.925 INFO:tasks.rados.rados.0.smithi085.stdout:112: write initial oid 112 2023-01-25T09:52:28.925 INFO:tasks.rados.rados.0.smithi085.stdout:112: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2023-01-25T09:52:28.927 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112025-112 from 665577 to 1447158 tid 1 2023-01-25T09:52:28.933 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112025-112 from 2062560 to 2626248 tid 2 2023-01-25T09:52:28.940 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112025-112 from 3182305 to 3825969 tid 3 2023-01-25T09:52:28.941 INFO:tasks.rados.rados.0.smithi085.stdout:113: write initial oid 113 2023-01-25T09:52:28.941 INFO:tasks.rados.rados.0.smithi085.stdout:113: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2023-01-25T09:52:28.947 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112025-113 from 682384 to 1139214 tid 1 2023-01-25T09:52:28.952 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112025-113 from 1721042 to 2144741 tid 2 2023-01-25T09:52:28.958 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112025-113 from 2809728 to 3264664 tid 3 2023-01-25T09:52:28.963 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112025-113 from 3731357 to 3882384 tid 4 2023-01-25T09:52:28.963 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.963 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 2 to smithi085112025-98 2023-01-25T09:52:28.963 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 3 to smithi085112025-98 2023-01-25T09:52:28.964 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 4 to smithi085112025-98 2023-01-25T09:52:28.964 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 5 to smithi085112025-98 2023-01-25T09:52:28.964 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 updating version 0 to 58 2023-01-25T09:52:28.964 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 updating version 58 to 60 2023-01-25T09:52:28.964 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 version 60 is already newer than 59 2023-01-25T09:52:28.965 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 version 60 is already newer than 57 2023-01-25T09:52:28.965 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 98 v 60 (ObjNum 97 snap 0 seq_num 97) dirty exists 2023-01-25T09:52:28.965 INFO:tasks.rados.rados.0.smithi085.stdout:98: left oid 98 (ObjNum 97 snap 0 seq_num 97) 2023-01-25T09:52:28.965 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 1 to smithi085112025-99 2023-01-25T09:52:28.965 INFO:tasks.rados.rados.0.smithi085.stdout:98: done (15 left) 2023-01-25T09:52:28.966 INFO:tasks.rados.rados.0.smithi085.stdout:114: write initial oid 114 2023-01-25T09:52:28.966 INFO:tasks.rados.rados.0.smithi085.stdout:114: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2023-01-25T09:52:28.969 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112025-114 from 699191 to 1231270 tid 1 2023-01-25T09:52:28.975 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112025-114 from 1779524 to 2346881 tid 2 2023-01-25T09:52:28.983 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112025-114 from 2837151 to 3503359 tid 3 2023-01-25T09:52:28.983 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:28.983 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 2 to smithi085112025-99 2023-01-25T09:52:28.983 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 3 to smithi085112025-99 2023-01-25T09:52:28.984 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 4 to smithi085112025-99 2023-01-25T09:52:28.984 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 5 to smithi085112025-99 2023-01-25T09:52:28.984 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 0 to 67 2023-01-25T09:52:28.984 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 67 to 68 2023-01-25T09:52:28.984 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 version 68 is already newer than 66 2023-01-25T09:52:28.985 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 68 to 69 2023-01-25T09:52:28.985 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 99 v 69 (ObjNum 98 snap 0 seq_num 98) dirty exists 2023-01-25T09:52:28.985 INFO:tasks.rados.rados.0.smithi085.stdout:99: left oid 99 (ObjNum 98 snap 0 seq_num 98) 2023-01-25T09:52:28.985 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 1 to smithi085112025-100 2023-01-25T09:52:28.985 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 2 to smithi085112025-100 2023-01-25T09:52:28.986 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 3 to smithi085112025-100 2023-01-25T09:52:28.986 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 4 to smithi085112025-100 2023-01-25T09:52:28.986 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 5 to smithi085112025-100 2023-01-25T09:52:28.986 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 updating version 0 to 72 2023-01-25T09:52:28.986 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 version 72 is already newer than 71 2023-01-25T09:52:28.987 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 version 72 is already newer than 70 2023-01-25T09:52:28.987 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 updating version 72 to 73 2023-01-25T09:52:28.987 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 100 v 73 (ObjNum 99 snap 0 seq_num 99) dirty exists 2023-01-25T09:52:28.987 INFO:tasks.rados.rados.0.smithi085.stdout:100: left oid 100 (ObjNum 99 snap 0 seq_num 99) 2023-01-25T09:52:28.987 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 1 to smithi085112025-101 2023-01-25T09:52:28.988 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 2 to smithi085112025-101 2023-01-25T09:52:28.988 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 3 to smithi085112025-101 2023-01-25T09:52:28.988 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 4 to smithi085112025-101 2023-01-25T09:52:28.988 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 5 to smithi085112025-101 2023-01-25T09:52:28.988 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 updating version 0 to 48 2023-01-25T09:52:28.989 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 48 is already newer than 45 2023-01-25T09:52:28.989 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 48 is already newer than 47 2023-01-25T09:52:28.989 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 48 is already newer than 46 2023-01-25T09:52:28.989 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 101 v 48 (ObjNum 100 snap 0 seq_num 100) dirty exists 2023-01-25T09:52:28.989 INFO:tasks.rados.rados.0.smithi085.stdout:101: left oid 101 (ObjNum 100 snap 0 seq_num 100) 2023-01-25T09:52:28.990 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 1 to smithi085112025-102 2023-01-25T09:52:28.990 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 2 to smithi085112025-102 2023-01-25T09:52:28.990 INFO:tasks.rados.rados.0.smithi085.stdout:99: done (15 left) 2023-01-25T09:52:28.990 INFO:tasks.rados.rados.0.smithi085.stdout:100: done (14 left) 2023-01-25T09:52:28.990 INFO:tasks.rados.rados.0.smithi085.stdout:101: done (13 left) 2023-01-25T09:52:28.991 INFO:tasks.rados.rados.0.smithi085.stdout:115: write initial oid 115 2023-01-25T09:52:28.991 INFO:tasks.rados.rados.0.smithi085.stdout:115: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2023-01-25T09:52:28.991 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112025-115 from 715998 to 1323326 tid 1 2023-01-25T09:52:28.994 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112025-115 from 1838006 to 2265374 tid 2 2023-01-25T09:52:29.000 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112025-115 from 2864574 to 3342054 tid 3 2023-01-25T09:52:29.003 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112025-115 from 3863835 to 3915998 tid 4 2023-01-25T09:52:29.004 INFO:tasks.rados.rados.0.smithi085.stdout:116: write initial oid 116 2023-01-25T09:52:29.004 INFO:tasks.rados.rados.0.smithi085.stdout:116: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2023-01-25T09:52:29.012 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112025-116 from 732805 to 1531735 tid 1 2023-01-25T09:52:29.019 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112025-116 from 2296488 to 2867514 tid 2 2023-01-25T09:52:29.024 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112025-116 from 3291997 to 3697102 tid 3 2023-01-25T09:52:29.024 INFO:tasks.rados.rados.0.smithi085.stdout:117: write initial oid 117 2023-01-25T09:52:29.024 INFO:tasks.rados.rados.0.smithi085.stdout:117: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2023-01-25T09:52:29.030 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112025-117 from 749612 to 1223791 tid 1 2023-01-25T09:52:29.037 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112025-117 from 1954970 to 2386007 tid 2 2023-01-25T09:52:29.044 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112025-117 from 2919420 to 3535797 tid 3 2023-01-25T09:52:29.044 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.044 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 3 to smithi085112025-102 2023-01-25T09:52:29.044 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 4 to smithi085112025-102 2023-01-25T09:52:29.045 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 5 to smithi085112025-102 2023-01-25T09:52:29.045 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 updating version 0 to 75 2023-01-25T09:52:29.045 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 updating version 75 to 76 2023-01-25T09:52:29.045 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 updating version 76 to 77 2023-01-25T09:52:29.045 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 version 77 is already newer than 74 2023-01-25T09:52:29.046 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 102 v 77 (ObjNum 101 snap 0 seq_num 101) dirty exists 2023-01-25T09:52:29.046 INFO:tasks.rados.rados.0.smithi085.stdout:102: left oid 102 (ObjNum 101 snap 0 seq_num 101) 2023-01-25T09:52:29.046 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 1 to smithi085112025-103 2023-01-25T09:52:29.046 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 2 to smithi085112025-103 2023-01-25T09:52:29.046 INFO:tasks.rados.rados.0.smithi085.stdout:102: done (15 left) 2023-01-25T09:52:29.047 INFO:tasks.rados.rados.0.smithi085.stdout:118: write initial oid 118 2023-01-25T09:52:29.047 INFO:tasks.rados.rados.0.smithi085.stdout:118: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2023-01-25T09:52:29.050 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112025-118 from 766419 to 1315847 tid 1 2023-01-25T09:52:29.058 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112025-118 from 2013452 to 2588147 tid 2 2023-01-25T09:52:29.064 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112025-118 from 3346843 to 3774492 tid 3 2023-01-25T09:52:29.065 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.065 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 3 to smithi085112025-103 2023-01-25T09:52:29.065 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 4 to smithi085112025-103 2023-01-25T09:52:29.065 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 5 to smithi085112025-103 2023-01-25T09:52:29.066 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 updating version 0 to 64 2023-01-25T09:52:29.066 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 version 64 is already newer than 62 2023-01-25T09:52:29.066 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 version 64 is already newer than 63 2023-01-25T09:52:29.066 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 version 64 is already newer than 61 2023-01-25T09:52:29.066 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 103 v 64 (ObjNum 102 snap 0 seq_num 102) dirty exists 2023-01-25T09:52:29.067 INFO:tasks.rados.rados.0.smithi085.stdout:103: left oid 103 (ObjNum 102 snap 0 seq_num 102) 2023-01-25T09:52:29.067 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 1 to smithi085112025-104 2023-01-25T09:52:29.067 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 2 to smithi085112025-104 2023-01-25T09:52:29.067 INFO:tasks.rados.rados.0.smithi085.stdout:103: done (15 left) 2023-01-25T09:52:29.067 INFO:tasks.rados.rados.0.smithi085.stdout:119: write initial oid 119 2023-01-25T09:52:29.068 INFO:tasks.rados.rados.0.smithi085.stdout:119: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2023-01-25T09:52:29.072 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112025-119 from 783226 to 1407903 tid 1 2023-01-25T09:52:29.078 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112025-119 from 2071934 to 2506640 tid 2 2023-01-25T09:52:29.085 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112025-119 from 2974266 to 3613187 tid 3 2023-01-25T09:52:29.085 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.085 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 3 to smithi085112025-104 2023-01-25T09:52:29.085 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 4 to smithi085112025-104 2023-01-25T09:52:29.085 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 5 to smithi085112025-104 2023-01-25T09:52:29.086 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 0 to 55 2023-01-25T09:52:29.086 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 version 55 is already newer than 54 2023-01-25T09:52:29.086 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 55 to 56 2023-01-25T09:52:29.086 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 56 to 57 2023-01-25T09:52:29.086 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 104 v 57 (ObjNum 103 snap 0 seq_num 103) dirty exists 2023-01-25T09:52:29.087 INFO:tasks.rados.rados.0.smithi085.stdout:104: left oid 104 (ObjNum 103 snap 0 seq_num 103) 2023-01-25T09:52:29.087 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 1 to smithi085112025-105 2023-01-25T09:52:29.087 INFO:tasks.rados.rados.0.smithi085.stdout:104: done (15 left) 2023-01-25T09:52:29.087 INFO:tasks.rados.rados.0.smithi085.stdout:120: write initial oid 120 2023-01-25T09:52:29.087 INFO:tasks.rados.rados.0.smithi085.stdout:120: seq_num 119 ranges {400033=699926,1614063=385970} 2023-01-25T09:52:29.090 INFO:tasks.rados.rados.0.smithi085.stdout:120: writing smithi085112025-120 from 400033 to 1099959 tid 1 2023-01-25T09:52:29.096 INFO:tasks.rados.rados.0.smithi085.stdout:120: writing smithi085112025-120 from 1614063 to 2000033 tid 2 2023-01-25T09:52:29.096 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.096 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 2 to smithi085112025-105 2023-01-25T09:52:29.096 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 3 to smithi085112025-105 2023-01-25T09:52:29.097 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 4 to smithi085112025-105 2023-01-25T09:52:29.097 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 5 to smithi085112025-105 2023-01-25T09:52:29.097 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 0 to 66 2023-01-25T09:52:29.097 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 66 to 67 2023-01-25T09:52:29.097 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 67 to 68 2023-01-25T09:52:29.098 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 version 68 is already newer than 65 2023-01-25T09:52:29.098 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 105 v 68 (ObjNum 104 snap 0 seq_num 104) dirty exists 2023-01-25T09:52:29.098 INFO:tasks.rados.rados.0.smithi085.stdout:105: left oid 105 (ObjNum 104 snap 0 seq_num 104) 2023-01-25T09:52:29.098 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 1 to smithi085112025-106 2023-01-25T09:52:29.098 INFO:tasks.rados.rados.0.smithi085.stdout:105: done (15 left) 2023-01-25T09:52:29.099 INFO:tasks.rados.rados.0.smithi085.stdout:121: write initial oid 121 2023-01-25T09:52:29.099 INFO:tasks.rados.rados.0.smithi085.stdout:121: seq_num 120 ranges {416840=775175,1672545=344295} 2023-01-25T09:52:29.102 INFO:tasks.rados.rados.0.smithi085.stdout:121: writing smithi085112025-121 from 416840 to 1192015 tid 1 2023-01-25T09:52:29.107 INFO:tasks.rados.rados.0.smithi085.stdout:121: writing smithi085112025-121 from 1672545 to 2016840 tid 2 2023-01-25T09:52:29.107 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.108 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 2 to smithi085112025-106 2023-01-25T09:52:29.108 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 3 to smithi085112025-106 2023-01-25T09:52:29.108 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 4 to smithi085112025-106 2023-01-25T09:52:29.108 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 5 to smithi085112025-106 2023-01-25T09:52:29.108 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 0 to 49 2023-01-25T09:52:29.109 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 49 to 50 2023-01-25T09:52:29.109 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 50 to 52 2023-01-25T09:52:29.109 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 version 52 is already newer than 51 2023-01-25T09:52:29.109 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 106 v 52 (ObjNum 105 snap 0 seq_num 105) dirty exists 2023-01-25T09:52:29.109 INFO:tasks.rados.rados.0.smithi085.stdout:106: left oid 106 (ObjNum 105 snap 0 seq_num 105) 2023-01-25T09:52:29.110 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 1 to smithi085112025-107 2023-01-25T09:52:29.110 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 2 to smithi085112025-107 2023-01-25T09:52:29.110 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 3 to smithi085112025-107 2023-01-25T09:52:29.110 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 4 to smithi085112025-107 2023-01-25T09:52:29.110 INFO:tasks.rados.rados.0.smithi085.stdout:106: done (15 left) 2023-01-25T09:52:29.111 INFO:tasks.rados.rados.0.smithi085.stdout:122: write initial oid 122 2023-01-25T09:52:29.111 INFO:tasks.rados.rados.0.smithi085.stdout:122: seq_num 121 ranges {433647=450424,1331027=582033} 2023-01-25T09:52:29.112 INFO:tasks.rados.rados.0.smithi085.stdout:122: writing smithi085112025-122 from 433647 to 884071 tid 1 2023-01-25T09:52:29.119 INFO:tasks.rados.rados.0.smithi085.stdout:122: writing smithi085112025-122 from 1331027 to 1913060 tid 2 2023-01-25T09:52:29.119 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.119 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 5 to smithi085112025-107 2023-01-25T09:52:29.120 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 updating version 0 to 71 2023-01-25T09:52:29.120 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 version 71 is already newer than 69 2023-01-25T09:52:29.120 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 version 71 is already newer than 70 2023-01-25T09:52:29.120 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 updating version 71 to 72 2023-01-25T09:52:29.120 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 107 v 72 (ObjNum 106 snap 0 seq_num 106) dirty exists 2023-01-25T09:52:29.122 INFO:tasks.rados.rados.0.smithi085.stdout:107: left oid 107 (ObjNum 106 snap 0 seq_num 106) 2023-01-25T09:52:29.122 INFO:tasks.rados.rados.0.smithi085.stdout:107: done (15 left) 2023-01-25T09:52:29.122 INFO:tasks.rados.rados.0.smithi085.stdout:123: write initial oid 123 2023-01-25T09:52:29.122 INFO:tasks.rados.rados.0.smithi085.stdout:123: seq_num 122 ranges {450454=642026,1505862=544592} 2023-01-25T09:52:29.124 INFO:tasks.rados.rados.0.smithi085.stdout:123: writing smithi085112025-123 from 450454 to 1092480 tid 1 2023-01-25T09:52:29.130 INFO:tasks.rados.rados.0.smithi085.stdout:123: writing smithi085112025-123 from 1505862 to 2050454 tid 2 2023-01-25T09:52:29.131 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.131 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 1 to smithi085112025-108 2023-01-25T09:52:29.131 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 2 to smithi085112025-108 2023-01-25T09:52:29.131 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 3 to smithi085112025-108 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 4 to smithi085112025-108 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 5 to smithi085112025-108 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 updating version 0 to 60 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 version 60 is already newer than 59 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 updating version 60 to 61 2023-01-25T09:52:29.132 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 version 61 is already newer than 58 2023-01-25T09:52:29.133 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 108 v 61 (ObjNum 107 snap 0 seq_num 107) dirty exists 2023-01-25T09:52:29.133 INFO:tasks.rados.rados.0.smithi085.stdout:108: left oid 108 (ObjNum 107 snap 0 seq_num 107) 2023-01-25T09:52:29.133 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 1 to smithi085112025-109 2023-01-25T09:52:29.133 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 2 to smithi085112025-109 2023-01-25T09:52:29.133 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 3 to smithi085112025-109 2023-01-25T09:52:29.134 INFO:tasks.rados.rados.0.smithi085.stdout:108: done (15 left) 2023-01-25T09:52:29.134 INFO:tasks.rados.rados.0.smithi085.stdout:124: write initial oid 124 2023-01-25T09:52:29.134 INFO:tasks.rados.rados.0.smithi085.stdout:124: seq_num 123 ranges {467261=717275,1847991=219270} 2023-01-25T09:52:29.137 INFO:tasks.rados.rados.0.smithi085.stdout:124: writing smithi085112025-124 from 467261 to 1184536 tid 1 2023-01-25T09:52:29.143 INFO:tasks.rados.rados.0.smithi085.stdout:124: writing smithi085112025-124 from 1847991 to 2067261 tid 2 2023-01-25T09:52:29.143 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.143 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 4 to smithi085112025-109 2023-01-25T09:52:29.143 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 5 to smithi085112025-109 2023-01-25T09:52:29.144 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 updating version 0 to 65 2023-01-25T09:52:29.144 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 version 65 is already newer than 64 2023-01-25T09:52:29.144 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 version 65 is already newer than 62 2023-01-25T09:52:29.144 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 version 65 is already newer than 63 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 109 v 65 (ObjNum 108 snap 0 seq_num 108) dirty exists 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:109: left oid 109 (ObjNum 108 snap 0 seq_num 108) 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 1 to smithi085112025-110 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 2 to smithi085112025-110 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 3 to smithi085112025-110 2023-01-25T09:52:29.145 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 4 to smithi085112025-110 2023-01-25T09:52:29.146 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 5 to smithi085112025-110 2023-01-25T09:52:29.146 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 updating version 0 to 80 2023-01-25T09:52:29.146 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 version 80 is already newer than 79 2023-01-25T09:52:29.146 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 version 80 is already newer than 78 2023-01-25T09:52:29.146 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 updating version 80 to 81 2023-01-25T09:52:29.147 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 110 v 81 (ObjNum 109 snap 0 seq_num 109) dirty exists 2023-01-25T09:52:29.147 INFO:tasks.rados.rados.0.smithi085.stdout:110: left oid 110 (ObjNum 109 snap 0 seq_num 109) 2023-01-25T09:52:29.147 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 1 to smithi085112025-111 2023-01-25T09:52:29.147 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 2 to smithi085112025-111 2023-01-25T09:52:29.147 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 3 to smithi085112025-111 2023-01-25T09:52:29.148 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 4 to smithi085112025-111 2023-01-25T09:52:29.148 INFO:tasks.rados.rados.0.smithi085.stdout:109: done (15 left) 2023-01-25T09:52:29.148 INFO:tasks.rados.rados.0.smithi085.stdout:110: done (14 left) 2023-01-25T09:52:29.148 INFO:tasks.rados.rados.0.smithi085.stdout:125: write initial oid 125 2023-01-25T09:52:29.148 INFO:tasks.rados.rados.0.smithi085.stdout:125: seq_num 124 ranges {484068=792524,1906473=177595} 2023-01-25T09:52:29.149 INFO:tasks.rados.rados.0.smithi085.stdout:125: writing smithi085112025-125 from 484068 to 1276592 tid 1 2023-01-25T09:52:29.154 INFO:tasks.rados.rados.0.smithi085.stdout:125: writing smithi085112025-125 from 1906473 to 2084068 tid 2 2023-01-25T09:52:29.154 INFO:tasks.rados.rados.0.smithi085.stdout:126: write initial oid 126 2023-01-25T09:52:29.154 INFO:tasks.rados.rados.0.smithi085.stdout:126: seq_num 125 ranges {500875=467773,1564955=535920} 2023-01-25T09:52:29.159 INFO:tasks.rados.rados.0.smithi085.stdout:126: writing smithi085112025-126 from 500875 to 968648 tid 1 2023-01-25T09:52:29.166 INFO:tasks.rados.rados.0.smithi085.stdout:126: writing smithi085112025-126 from 1564955 to 2100875 tid 2 2023-01-25T09:52:29.166 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.166 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 5 to smithi085112025-111 2023-01-25T09:52:29.167 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 updating version 0 to 55 2023-01-25T09:52:29.167 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 updating version 55 to 56 2023-01-25T09:52:29.167 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 version 56 is already newer than 54 2023-01-25T09:52:29.167 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 version 56 is already newer than 53 2023-01-25T09:52:29.168 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 111 v 56 (ObjNum 110 snap 0 seq_num 110) dirty exists 2023-01-25T09:52:29.168 INFO:tasks.rados.rados.0.smithi085.stdout:111: left oid 111 (ObjNum 110 snap 0 seq_num 110) 2023-01-25T09:52:29.168 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 1 to smithi085112025-112 2023-01-25T09:52:29.168 INFO:tasks.rados.rados.0.smithi085.stdout:111: done (15 left) 2023-01-25T09:52:29.168 INFO:tasks.rados.rados.0.smithi085.stdout:127: write initial oid 127 2023-01-25T09:52:29.169 INFO:tasks.rados.rados.0.smithi085.stdout:127: seq_num 126 ranges {517682=543022,1623437=494245} 2023-01-25T09:52:29.171 INFO:tasks.rados.rados.0.smithi085.stdout:127: writing smithi085112025-127 from 517682 to 1060704 tid 1 2023-01-25T09:52:29.179 INFO:tasks.rados.rados.0.smithi085.stdout:127: writing smithi085112025-127 from 1623437 to 2117682 tid 2 2023-01-25T09:52:29.179 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T09:52:29.179 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 2 to smithi085112025-112 2023-01-25T09:52:29.180 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 3 to smithi085112025-112 2023-01-25T09:52:29.180 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 4 to smithi085112025-112 2023-01-25T09:52:29.180 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 5 to smithi085112025-112 2023-01-25T09:52:29.180 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 updating version 0 to 85 2023-01-25T09:52:29.180 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 version 85 is already newer than 83 2023-01-25T09:52:29.181 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 version 85 is already newer than 84 2023-01-25T09:52:29.181 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 version 85 is already newer than 82 2023-01-25T09:52:29.181 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 112 v 85 (ObjNum 111 snap 0 seq_num 111) dirty exists 2023-01-25T09:52:29.181 INFO:tasks.rados.rados.0.smithi085.stdout:112: left oid 112 (ObjNum 111 snap 0 seq_num 111) 2023-01-25T09:52:29.181 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 1 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 2 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 3 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 4 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 5 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 6 to smithi085112025-113 2023-01-25T09:52:29.182 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 0 to 86 2023-01-25T09:52:29.183 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 86 to 88 2023-01-25T09:52:29.183 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 version 88 is already newer than 87 2023-01-25T09:52:29.183 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 88 to 89 2023-01-25T09:52:29.183 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 89 to 90 2023-01-25T09:52:29.183 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 113 v 90 (ObjNum 112 snap 0 seq_num 112) dirty exists 2023-01-25T09:52:29.184 INFO:tasks.rados.rados.0.smithi085.stdout:113: left oid 113 (ObjNum 112 snap 0 seq_num 112) 2023-01-25T09:52:29.184 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 1 to smithi085112025-114 2023-01-25T09:52:29.184 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 2 to smithi085112025-114 2023-01-25T09:52:29.184 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 3 to smithi085112025-114 2023-01-25T09:52:29.184 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 4 to smithi085112025-114 2023-01-25T09:52:29.185 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 5 to smithi085112025-114 2023-01-25T09:52:29.185 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 updating version 0 to 75 2023-01-25T09:52:29.185 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 version 75 is already newer than 73 2023-01-25T09:52:29.185 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 version 75 is already newer than 74 2023-01-25T09:52:29.185 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 updating version 75 to 76 2023-01-25T09:52:29.186 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 114 v 76 (ObjNum 113 snap 0 seq_num 113) dirty exists 2023-01-25T09:52:29.186 INFO:tasks.rados.rados.0.smithi085.stdout:114: left oid 114 (ObjNum 113 snap 0 seq_num 113) 2023-01-25T09:52:29.186 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 1 to smithi085112025-115 2023-01-25T09:52:29.186 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 2 to smithi085112025-115 2023-01-25T09:52:29.186 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 3 to smithi085112025-115 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 4 to smithi085112025-115 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 5 to smithi085112025-115 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 6 to smithi085112025-115 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 updating version 0 to 61 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 61 is already newer than 58 2023-01-25T09:52:29.187 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 61 is already newer than 60 2023-01-25T09:52:29.188 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 61 is already newer than 59 2023-01-25T09:52:29.188 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 61 is already newer than 57 2023-01-25T09:52:29.188 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 115 v 61 (ObjNum 114 snap 0 seq_num 114) dirty exists 2023-01-25T09:52:29.188 INFO:tasks.rados.rados.0.smithi085.stdout:115: left oid 115 (ObjNum 114 snap 0 seq_num 114) 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 1 to smithi085112025-116 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 2 to smithi085112025-116 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 3 to smithi085112025-116 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 4 to smithi085112025-116 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 5 to smithi085112025-116 2023-01-25T09:52:29.189 INFO:tasks.rados.rados.0.smithi085.stdout:116: oid 116 updating version 0 to 93 2023-01-25T09:52:29.190 INFO:tasks.rados.rados.0.smithi085.stdout:116: oid 116 updating version 93 to 94 2023-01-25T09:52:29.190 INFO:tasks.rados.rados.0.smithi085.stdout:116: oid 116 version 94 is already newer than 91 2023-01-25T09:52:29.190 INFO:tasks.rados.rados.0.smithi085.stdout:116: oid 116 version 94 is already newer than 92 2023-01-25T09:52:29.190 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 116 v 94 (ObjNum 115 snap 0 seq_num 115) dirty exists 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:116: left oid 116 (ObjNum 115 snap 0 seq_num 115) 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:117: finishing write tid 1 to smithi085112025-117 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:117: finishing write tid 2 to smithi085112025-117 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:117: finishing write tid 3 to smithi085112025-117 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:117: finishing write tid 4 to smithi085112025-117 2023-01-25T09:52:29.191 INFO:tasks.rados.rados.0.smithi085.stdout:117: finishing write tid 5 to smithi085112025-117 2023-01-25T09:52:29.192 INFO:tasks.rados.rados.0.smithi085.stdout:117: oid 117 updating version 0 to 65 2023-01-25T09:52:29.192 INFO:tasks.rados.rados.0.smithi085.stdout:117: oid 117 version 65 is already newer than 63 2023-01-25T09:52:29.192 INFO:tasks.rados.rados.0.smithi085.stdout:117: oid 117 version 65 is already newer than 62 2023-01-25T09:52:29.192 INFO:tasks.rados.rados.0.smithi085.stdout:117: oid 117 version 65 is already newer than 64 2023-01-25T09:52:29.192 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 117 v 65 (ObjNum 116 snap 0 seq_num 116) dirty exists 2023-01-25T09:52:29.193 INFO:tasks.rados.rados.0.smithi085.stdout:117: left oid 117 (ObjNum 116 snap 0 seq_num 116) 2023-01-25T09:52:29.193 INFO:tasks.rados.rados.0.smithi085.stdout:118: finishing write tid 1 to smithi085112025-118 2023-01-25T09:52:29.193 INFO:tasks.rados.rados.0.smithi085.stdout:118: finishing write tid 2 to smithi085112025-118 2023-01-25T09:52:29.193 INFO:tasks.rados.rados.0.smithi085.stdout:118: finishing write tid 3 to smithi085112025-118 2023-01-25T09:52:29.193 INFO:tasks.rados.rados.0.smithi085.stdout:118: finishing write tid 4 to smithi085112025-118 2023-01-25T09:52:29.194 INFO:tasks.rados.rados.0.smithi085.stdout:118: finishing write tid 5 to smithi085112025-118 2023-01-25T09:52:29.194 INFO:tasks.rados.rados.0.smithi085.stdout:118: oid 118 updating version 0 to 68 2023-01-25T09:52:29.194 INFO:tasks.rados.rados.0.smithi085.stdout:118: oid 118 version 68 is already newer than 66 2023-01-25T09:52:29.194 INFO:tasks.rados.rados.0.smithi085.stdout:118: oid 118 updating version 68 to 69 2023-01-25T09:52:29.194 INFO:tasks.rados.rados.0.smithi085.stdout:118: oid 118 version 69 is already newer than 67 2023-01-25T09:52:29.195 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 118 v 69 (ObjNum 117 snap 0 seq_num 117) dirty exists 2023-01-25T09:52:29.195 INFO:tasks.rados.rados.0.smithi085.stdout:118: left oid 118 (ObjNum 117 snap 0 seq_num 117) 2023-01-25T09:52:29.195 INFO:tasks.rados.rados.0.smithi085.stdout:119: finishing write tid 1 to smithi085112025-119 2023-01-25T09:52:29.195 INFO:tasks.rados.rados.0.smithi085.stdout:119: finishing write tid 2 to smithi085112025-119 2023-01-25T09:52:29.196 INFO:tasks.rados.rados.0.smithi085.stdout:119: finishing write tid 3 to smithi085112025-119 2023-01-25T09:52:29.196 INFO:tasks.rados.rados.0.smithi085.stdout:119: finishing write tid 4 to smithi085112025-119 2023-01-25T09:52:29.196 INFO:tasks.rados.rados.0.smithi085.stdout:119: finishing write tid 5 to smithi085112025-119 2023-01-25T09:52:29.196 INFO:tasks.rados.rados.0.smithi085.stdout:119: oid 119 updating version 0 to 98 2023-01-25T09:52:29.196 INFO:tasks.rados.rados.0.smithi085.stdout:119: oid 119 version 98 is already newer than 95 2023-01-25T09:52:29.197 INFO:tasks.rados.rados.0.smithi085.stdout:119: oid 119 version 98 is already newer than 96 2023-01-25T09:52:29.197 INFO:tasks.rados.rados.