2023-01-25T06:28:44.868 INFO:root:teuthology version: 0.0.1.dev22+g8e1bba1 2023-01-25T06:28:44.869 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} --name yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929 -- /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929/orig.config.yaml 2023-01-25T06:28:44.919 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-25T06:28:45.004 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929 branch: wip-yuri2-testing-2023-01-23-0928 description: rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} email: yweinstein@radhat.com first_in_suite: false job_id: '7136929' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri2-testing-2023-01-23-0928 ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject socket failures: 5000 ms type: async osd_object_clean_region_max_num_intervals: 1000 osd_pool_default_min_size: 2 osd_pool_default_size: 2 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd backoff on peering: true osd blocked scrub grace period: 3600 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd heartbeat use min delay socket: true osd inject bad map crc probability: 0.1 osd max markdown count: 1000 osd mclock override recovery settings: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_max_pg_log_entries: 3000 osd_min_pg_log_entries: 3000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(REQUEST_STUCK\) - failed to encode map - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - must scrub before tier agent can activate sha1: 61996d73ab738798e4ee0055c86457f5c459da4a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 61996d73ab738798e4ee0055c86457f5c459da4a selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-01-23-0928 sha1: 61996d73ab738798e4ee0055c86457f5c459da4a owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: 61996d73ab738798e4ee0055c86457f5c459da4a sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri2-testing-2023-01-23-0928 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 61996d73ab738798e4ee0055c86457f5c459da4a targets: smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQYG+jkWOxYzo/cTo6u1TPYMgmVxeRUVLp59UGqJ1GeX3GNQ36ktqEgfz0Ei7G8IkYJf5dikNHs5g+9H1ZU/tO+JAj62hghS1eE9dD8ccB3jU0DeNou0B2Du3Iv1djj/U/OujF37NrRG9YEp25i7m76sy0jbsaNrvtk3sT2QKbCZ4Ho9tPLHmRWexq81KpdBlgKQB10fQJK6XVKsuSZAeW7kZcw8DzXuRzltl7AYi3R+t6SD99j6r3aYm7c5hS2A3PbHWFbOeV7vO5bHilAfO0zsy1jPDMjrmboTNCcOO0VPSVMZsby0VPcLk8+7DQ63XRmgOshBYfthvXHFaI1m5EKCeUHWQo/k5PupG+3wzO4AFroxu/THzH9Wrm1nekz/Ks2O/XnaOYhj0TwHVExeJEq2ITR6JBdT4gIYQSfJNdBfa63u5xTk/s0hVnX9jx1qB7hyqxyh4mO5Qlu+Z/3oX9cDYb26fByogJyZ8uArb6BH09c7ksgMkexDqncLHiNKU= smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgcuzWalby/PgY+gP/oNYme+4jN6FkOy6NG3K4goSpIAwtfSZmovqMG9Mn2ZjLHs4PU6wB8gU/Dh4aDrogMyhtkoflZArumqxS6BjEYiKsGBI9RJNEDsaEK26ACIK2Uy2BCeg/IQ7RD+5teQr3Z9iZVJbAfmhhbDikS85L84+EmfAesAT7J+86MM2lrPBPncQY65oOm62PJkrpjMF1ugtzWL+EfjlupF3o3UHzJRlg8AlghDSoFyD7x+ufYVmhHsWv+a4eH09F6V1NuYAgbZ7rlJ9lXRUnbb/yy8bDdtxdBpyd7jmtbXUAryOxaeNtLnWfcActdpSlSO2muFTN3JoyXgFk1lN0rm5YLMy3t94+kSyweXDnWDlq3fOs8f5PBSBYC9jpgyvrJabGIDxzL+UuH5zgGodnK2UV19j+p24CjNMX1eHs+8MAwBJ24e7XyEka0sX7iPkpZaaldHb0ZcWRwO0UE0aPB6gdxOf53eUZCAuhiU5ReEs2aT4E0VjA30= tasks: - install: null - ceph: conf: osd: debug monc: 20 - exec: mon.a: - while ! ceph balancer status ; do sleep 1 ; done - ceph balancer mode crush-compat - ceph balancer on - exec: client.0: - sudo ceph osd pool create base 4 - sudo ceph osd pool application enable base rados - sudo ceph osd pool create cache 4 - sudo ceph osd tier add base cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay base cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 3600 - sudo ceph osd pool set cache target_max_objects 250 - sudo ceph osd pool set cache min_read_recency_for_promote 2 - rados: balance_reads: true clients: - client.0 objects: 500 op_weights: cache_evict: 50 cache_flush: 50 cache_try_flush: 50 copy_from: 50 delete: 50 read: 100 rollback: 50 snap_create: 50 snap_remove: 50 write: 100 ops: 4000 pools: - base teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8e1bba12e584b7ae912e92e94afe9c075ab51fa3 timestamp: 2023-01-24_22:22:09 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.17735 2023-01-25T06:28:45.005 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa; will attempt to use it 2023-01-25T06:28:45.006 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa/tasks 2023-01-25T06:28:45.006 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-25T06:28:45.008 INFO:teuthology.task.internal:Checking packages... 2023-01-25T06:28:45.039 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '61996d73ab738798e4ee0055c86457f5c459da4a' 2023-01-25T06:28:45.039 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-25T06:28:45.040 INFO:teuthology.packaging:ref: None 2023-01-25T06:28:45.040 INFO:teuthology.packaging:tag: None 2023-01-25T06:28:45.040 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-01-23-0928 2023-01-25T06:28:45.041 INFO:teuthology.packaging:sha1: 61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:28:45.041 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri2-testing-2023-01-23-0928 2023-01-25T06:28:45.225 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-1963.g61996d73 2023-01-25T06:28:45.226 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-25T06:28:45.232 INFO:teuthology.task.internal:no buildpackages task found 2023-01-25T06:28:45.232 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-25T06:28:45.259 INFO:teuthology.task.internal:Saving configuration 2023-01-25T06:28:45.280 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-25T06:28:45.285 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-25T06:28:45.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi085.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 06:23:31.200012', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDOJMrFWwXnitTCCSXdvWvvHOKeRISFeEmckxxNdMZ7jNUov2dp/2PxDArQubQ8Ye+HQ+FbQ98uMDsRQU/jjz20='} 2023-01-25T06:28:45.331 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-25 06:23:31.198055', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN4ObZ+deUmLcq25Defs8JRxR0prTEYrGdxCiQ8PUsR+gfHogZaiWbTHhrkYR3qVhJlTSeI48oQtZrwwO245DGg='} 2023-01-25T06:28:45.331 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-25T06:28:45.342 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-25T06:28:45.342 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-25T06:28:45.342 INFO:teuthology.run_tasks:Running task console_log... 2023-01-25T06:28:45.420 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9fbccf5670>, signals=[15]) 2023-01-25T06:28:45.421 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-25T06:28:45.427 INFO:teuthology.task.internal:Opening connections... 2023-01-25T06:28:45.427 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:28:45.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:28:45.540 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:28:45.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:28:45.611 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-25T06:28:45.618 DEBUG:teuthology.orchestra.run.smithi085:> uname -m 2023-01-25T06:28:45.638 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2023-01-25T06:28:45.638 DEBUG:teuthology.orchestra.run.smithi085:> cat /etc/os-release 2023-01-25T06:28:45.696 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="CentOS Stream" 2023-01-25T06:28:45.696 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="8" 2023-01-25T06:28:45.696 INFO:teuthology.orchestra.run.smithi085.stdout:ID="centos" 2023-01-25T06:28:45.696 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE="rhel fedora" 2023-01-25T06:28:45.697 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="8" 2023-01-25T06:28:45.697 INFO:teuthology.orchestra.run.smithi085.stdout:PLATFORM_ID="platform:el8" 2023-01-25T06:28:45.697 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T06:28:45.697 INFO:teuthology.orchestra.run.smithi085.stdout:ANSI_COLOR="0;31" 2023-01-25T06:28:45.697 INFO:teuthology.orchestra.run.smithi085.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T06:28:45.698 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://centos.org/" 2023-01-25T06:28:45.698 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T06:28:45.698 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T06:28:45.698 INFO:teuthology.orchestra.run.smithi085.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T06:28:45.699 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2023-01-25T06:28:45.719 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-01-25T06:28:45.740 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-01-25T06:28:45.741 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-01-25T06:28:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-01-25T06:28:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2023-01-25T06:28:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-01-25T06:28:45.801 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-01-25T06:28:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2023-01-25T06:28:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-01-25T06:28:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-25T06:28:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-01-25T06:28:45.802 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-25T06:28:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-01-25T06:28:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-25T06:28:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-25T06:28:45.803 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-25T06:28:45.804 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-01-25T06:28:45.826 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-25T06:28:45.836 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-25T06:28:45.859 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-25T06:28:45.860 DEBUG:teuthology.orchestra.run.smithi085:> test '!' -e /home/ubuntu/cephtest 2023-01-25T06:28:45.863 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2023-01-25T06:28:45.882 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-25T06:28:45.888 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-25T06:28:45.889 DEBUG:teuthology.orchestra.run.smithi085:> test -z $(ls -A /var/lib/ceph) 2023-01-25T06:28:45.920 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2023-01-25T06:28:45.944 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-25T06:28:45.997 INFO:teuthology.run_tasks:Running task kernel... 2023-01-25T06:28:46.012 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-25T06:28:46.013 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-25T06:28:46.014 DEBUG:teuthology.orchestra.run.smithi085:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T06:28:46.014 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-25T06:28:46.032 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:28:46.032 DEBUG:teuthology.orchestra.run.smithi085:> uname -r 2023-01-25T06:28:46.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:28:46.034 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-01-25T06:28:46.091 INFO:teuthology.orchestra.run.smithi085.stdout:4.18.0-408.el8.x86_64 2023-01-25T06:28:46.092 INFO:teuthology.task.kernel:Running kernel on smithi085: 4.18.0-408.el8.x86_64 2023-01-25T06:28:46.092 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum install -y kernel 2023-01-25T06:28:46.094 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-408.el8.x86_64 2023-01-25T06:28:46.094 INFO:teuthology.task.kernel:Running kernel on smithi173: 4.18.0-408.el8.x86_64 2023-01-25T06:28:46.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2023-01-25T06:28:49.715 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - AppStream 33 MB/s | 27 MB 00:00 2023-01-25T06:28:49.797 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - AppStream 33 MB/s | 27 MB 00:00 2023-01-25T06:28:55.424 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - BaseOS 39 MB/s | 27 MB 00:00 2023-01-25T06:28:55.522 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - BaseOS 38 MB/s | 27 MB 00:00 2023-01-25T06:28:59.690 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - Extras 141 kB/s | 18 kB 00:00 2023-01-25T06:28:59.854 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Extras 151 kB/s | 18 kB 00:00 2023-01-25T06:29:00.083 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - PowerTools 21 MB/s | 5.6 MB 00:00 2023-01-25T06:29:00.273 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - PowerTools 19 MB/s | 5.6 MB 00:00 2023-01-25T06:29:01.316 INFO:teuthology.orchestra.run.smithi085.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-01-25T06:29:01.489 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-01-25T06:29:04.772 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 4.2 MB/s | 13 MB 00:03 2023-01-25T06:29:06.266 INFO:teuthology.orchestra.run.smithi085.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 13 MB 00:04 2023-01-25T06:29:08.040 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-01-25T06:29:09.574 INFO:teuthology.orchestra.run.smithi085.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-01-25T06:29:11.155 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T06:29:11.156 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T06:29:11.308 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:29:11.308 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:29:11.308 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:29:11.309 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:29:11.309 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:29:11.309 INFO:teuthology.orchestra.run.smithi173.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T06:29:11.309 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T06:29:11.310 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T06:29:11.310 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:11.310 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:29:11.310 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:29:11.310 INFO:teuthology.orchestra.run.smithi173.stdout:Install 3 Packages 2023-01-25T06:29:11.311 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:11.311 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 85 M 2023-01-25T06:29:11.311 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 94 M 2023-01-25T06:29:11.312 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:29:11.608 INFO:teuthology.orchestra.run.smithi173.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 31 MB/s | 9.2 MB 00:00 2023-01-25T06:29:12.558 INFO:teuthology.orchestra.run.smithi173.stdout:(2/3): kernel-core-4.18.0-448.el8.x86_64.rpm 33 MB/s | 41 MB 00:01 2023-01-25T06:29:12.655 INFO:teuthology.orchestra.run.smithi085.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-25T06:29:12.656 INFO:teuthology.orchestra.run.smithi085.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-25T06:29:12.828 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:29:12.828 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:29:12.828 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:29:12.829 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:29:12.829 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:29:12.829 INFO:teuthology.orchestra.run.smithi085.stdout: kernel x86_64 4.18.0-448.el8 CentOS-BaseOS 9.2 M 2023-01-25T06:29:12.829 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-core x86_64 4.18.0-448.el8 CentOS-BaseOS 41 M 2023-01-25T06:29:12.829 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-modules x86_64 4.18.0-448.el8 CentOS-BaseOS 34 M 2023-01-25T06:29:12.830 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:12.830 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:29:12.830 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:29:12.830 INFO:teuthology.orchestra.run.smithi085.stdout:Install 3 Packages 2023-01-25T06:29:12.831 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:12.831 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 85 M 2023-01-25T06:29:12.831 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 94 M 2023-01-25T06:29:12.832 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:29:12.909 INFO:teuthology.orchestra.run.smithi173.stdout:(3/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 21 MB/s | 34 MB 00:01 2023-01-25T06:29:12.912 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:29:12.912 INFO:teuthology.orchestra.run.smithi173.stdout:Total 53 MB/s | 85 MB 00:01 2023-01-25T06:29:13.067 INFO:teuthology.orchestra.run.smithi085.stdout:(1/3): kernel-4.18.0-448.el8.x86_64.rpm 39 MB/s | 9.2 MB 00:00 2023-01-25T06:29:13.552 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:29:13.942 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:29:13.942 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:29:14.042 INFO:teuthology.orchestra.run.smithi085.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm 28 MB/s | 34 MB 00:01 2023-01-25T06:29:14.450 INFO:teuthology.orchestra.run.smithi085.stdout:(3/3): kernel-core-4.18.0-448.el8.x86_64.rpm 25 MB/s | 41 MB 00:01 2023-01-25T06:29:14.453 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:29:14.454 INFO:teuthology.orchestra.run.smithi085.stdout:Total 52 MB/s | 85 MB 00:01 2023-01-25T06:29:15.087 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:29:15.479 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:29:15.479 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:29:15.994 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:29:16.018 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:29:17.526 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:29:17.568 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:29:18.741 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:29:19.305 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:20.267 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:29:20.814 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:23.082 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:23.538 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:24.666 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:25.088 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:26.852 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:27.102 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:28.401 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:28.638 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:48.930 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:48.957 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:49.370 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:49.370 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:49.370 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:50.147 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:50.148 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:50.148 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:29:50.148 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T06:29:50.149 INFO:teuthology.orchestra.run.smithi173.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T06:29:50.149 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:50.149 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:29:50.280 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-core-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:50.305 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:50.350 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel --last | head -n 1 2023-01-25T06:29:50.543 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 06:29:26 AM UTC 2023-01-25T06:29:50.545 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T06:29:50.546 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T06:29:50.546 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T06:29:50.547 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T06:29:50.547 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-01-25T06:29:50.547 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T06:29:50.548 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel --last | head -n 1 2023-01-25T06:29:50.726 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: kernel-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:50.727 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-4.18.0-448.el8.x86_64 1/3 2023-01-25T06:29:50.727 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-core-4.18.0-448.el8.x86_64 2/3 2023-01-25T06:29:50.737 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 06:29:26 AM UTC 2023-01-25T06:29:50.739 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T06:29:50.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2023-01-25T06:29:50.771 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2023-01-25T06:29:50.772 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2023-01-25T06:29:50.772 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.02 2023-01-25T06:29:50.772 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 129.el8 2023-01-25T06:29:50.772 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2023-01-25T06:29:50.772 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T06:29:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Group : System Environment/Base 2023-01-25T06:29:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 9265586 2023-01-25T06:29:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2023-01-25T06:29:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T06:29:50.773 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T06:29:50.774 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T06:29:50.774 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T06:29:50.774 INFO:teuthology.orchestra.run.smithi173.stdout:Relocations : (not relocatable) 2023-01-25T06:29:50.774 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : CentOS BuildSystem 2023-01-25T06:29:50.774 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2023-01-25T06:29:50.775 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T06:29:50.775 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2023-01-25T06:29:50.775 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2023-01-25T06:29:50.775 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:50.776 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T06:29:50.776 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T06:29:50.776 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T06:29:50.776 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2023-01-25T06:29:50.777 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:29:50.777 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T06:29:50.778 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T06:29:50.778 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 4.18.0-448.el8.x86_64 2023-01-25T06:29:50.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T06:29:51.325 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : kernel-modules-4.18.0-448.el8.x86_64 3/3 2023-01-25T06:29:51.326 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:51.326 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:29:51.326 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-4.18.0-448.el8.x86_64 kernel-core-4.18.0-448.el8.x86_64 2023-01-25T06:29:51.326 INFO:teuthology.orchestra.run.smithi085.stdout: kernel-modules-4.18.0-448.el8.x86_64 2023-01-25T06:29:51.327 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:51.327 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:29:51.439 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q kernel --last | head -n 1 2023-01-25T06:29:51.634 INFO:teuthology.orchestra.run.smithi085.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 06:29:28 AM UTC 2023-01-25T06:29:51.636 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T06:29:51.636 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-408.el8.x86_64 Expected: 4.18.0-448.el8.x86_64 2023-01-25T06:29:51.636 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-01-25T06:29:51.637 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-01-25T06:29:51.637 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-01-25T06:29:51.637 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi085.front.sepia.ceph.com, path=None, version=distro) 2023-01-25T06:29:51.637 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q kernel --last | head -n 1 2023-01-25T06:29:51.824 INFO:teuthology.orchestra.run.smithi085.stdout:kernel-4.18.0-448.el8.x86_64 Wed 25 Jan 2023 06:29:28 AM UTC 2023-01-25T06:29:51.826 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-448.el8.x86_64 2023-01-25T06:29:51.827 DEBUG:teuthology.orchestra.run.smithi085:> sudo rpm -qi grub2-tools 2023-01-25T06:29:51.861 INFO:teuthology.orchestra.run.smithi085.stdout:Name : grub2-tools 2023-01-25T06:29:51.862 INFO:teuthology.orchestra.run.smithi085.stdout:Epoch : 1 2023-01-25T06:29:51.862 INFO:teuthology.orchestra.run.smithi085.stdout:Version : 2.02 2023-01-25T06:29:51.862 INFO:teuthology.orchestra.run.smithi085.stdout:Release : 129.el8 2023-01-25T06:29:51.862 INFO:teuthology.orchestra.run.smithi085.stdout:Architecture: x86_64 2023-01-25T06:29:51.862 INFO:teuthology.orchestra.run.smithi085.stdout:Install Date: Sun 28 Aug 2022 01:03:50 PM UTC 2023-01-25T06:29:51.863 INFO:teuthology.orchestra.run.smithi085.stdout:Group : System Environment/Base 2023-01-25T06:29:51.863 INFO:teuthology.orchestra.run.smithi085.stdout:Size : 9265586 2023-01-25T06:29:51.863 INFO:teuthology.orchestra.run.smithi085.stdout:License : GPLv3+ 2023-01-25T06:29:51.863 INFO:teuthology.orchestra.run.smithi085.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-01-25T06:29:51.864 INFO:teuthology.orchestra.run.smithi085.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-01-25T06:29:51.864 INFO:teuthology.orchestra.run.smithi085.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-01-25T06:29:51.864 INFO:teuthology.orchestra.run.smithi085.stdout:Build Host : kbuilder.bsys.centos.org 2023-01-25T06:29:51.864 INFO:teuthology.orchestra.run.smithi085.stdout:Relocations : (not relocatable) 2023-01-25T06:29:51.865 INFO:teuthology.orchestra.run.smithi085.stdout:Packager : CentOS BuildSystem 2023-01-25T06:29:51.865 INFO:teuthology.orchestra.run.smithi085.stdout:Vendor : CentOS 2023-01-25T06:29:51.865 INFO:teuthology.orchestra.run.smithi085.stdout:URL : http://www.gnu.org/software/grub/ 2023-01-25T06:29:51.865 INFO:teuthology.orchestra.run.smithi085.stdout:Summary : Support tools for GRUB. 2023-01-25T06:29:51.865 INFO:teuthology.orchestra.run.smithi085.stdout:Description : 2023-01-25T06:29:51.866 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:51.866 INFO:teuthology.orchestra.run.smithi085.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-01-25T06:29:51.866 INFO:teuthology.orchestra.run.smithi085.stdout:customizable bootloader with modular architecture. It supports a rich 2023-01-25T06:29:51.866 INFO:teuthology.orchestra.run.smithi085.stdout:variety of kernel formats, file systems, computer architectures and 2023-01-25T06:29:51.866 INFO:teuthology.orchestra.run.smithi085.stdout:hardware devices. 2023-01-25T06:29:51.867 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:29:51.867 INFO:teuthology.orchestra.run.smithi085.stdout:This subpackage provides tools for support of all platforms. 2023-01-25T06:29:51.868 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-01-25T06:29:51.868 INFO:teuthology.task.kernel:Updating grub on smithi085 to boot 4.18.0-448.el8.x86_64 2023-01-25T06:29:51.868 DEBUG:teuthology.orchestra.run.smithi085:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-01-25T06:29:52.166 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2023-01-25T06:29:53.631 INFO:teuthology.orchestra.run.smithi085.stderr:Generating grub configuration file ... 2023-01-25T06:29:54.308 INFO:teuthology.orchestra.run.smithi173.stderr:done 2023-01-25T06:29:54.310 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-01-25T06:29:54.340 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.4dglj77eFd 2023-01-25T06:29:54.341 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4dglj77eFd 2023-01-25T06:29:54.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.4dglj77eFd 2023-01-25T06:29:54.567 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.4dglj77eFd is 6KB 2023-01-25T06:29:54.615 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.4dglj77eFd 2023-01-25T06:29:54.632 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T06:29:54.702 INFO:teuthology.orchestra.run.smithi173.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T06:29:54.702 INFO:teuthology.orchestra.run.smithi173.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T06:29:54.702 INFO:teuthology.orchestra.run.smithi173.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T06:29:54.702 INFO:teuthology.orchestra.run.smithi173.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T06:29:54.703 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T06:29:54.852 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2023-01-25T06:29:55.823 INFO:teuthology.orchestra.run.smithi085.stderr:done 2023-01-25T06:29:55.825 DEBUG:teuthology.orchestra.run.smithi085:> mktemp 2023-01-25T06:29:55.894 INFO:teuthology.orchestra.run.smithi085.stdout:/tmp/tmp.jhZb2E4pCA 2023-01-25T06:29:55.895 DEBUG:teuthology.orchestra.run.smithi085:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jhZb2E4pCA 2023-01-25T06:29:55.938 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0666 /tmp/tmp.jhZb2E4pCA 2023-01-25T06:29:56.084 DEBUG:teuthology.orchestra.remote:smithi085:/tmp/tmp.jhZb2E4pCA is 6KB 2023-01-25T06:29:56.132 DEBUG:teuthology.orchestra.run.smithi085:> rm -fr /tmp/tmp.jhZb2E4pCA 2023-01-25T06:29:56.149 DEBUG:teuthology.orchestra.run.smithi085:> sudo /bin/ls /boot/loader/entries || true 2023-01-25T06:29:56.221 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-0-rescue.conf 2023-01-25T06:29:56.222 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-305.3.1.el8.x86_64.conf 2023-01-25T06:29:56.222 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-408.el8.x86_64.conf 2023-01-25T06:29:56.223 INFO:teuthology.orchestra.run.smithi085.stdout:2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64.conf 2023-01-25T06:29:56.224 DEBUG:teuthology.orchestra.run.smithi085:> sudo grub2-set-default 2ff282740cf84d4fa02ff60ed95fbbff-4.18.0-448.el8.x86_64 2023-01-25T06:29:56.404 DEBUG:teuthology.orchestra.run.smithi085:> sudo shutdown -r now 2023-01-25T06:30:24.880 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-01-25T06:30:24.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-01-25T06:30:24.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:30:26.408 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-01-25T06:30:26.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T06:30:26.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:30:59.432 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-01-25T06:31:26.436 DEBUG:teuthology.orchestra.remote:timed out 2023-01-25T06:31:29.436 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-01-25T06:31:29.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:31:36.818 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-01-25T06:31:37.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-01-25T06:31:37.294 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-448.el8.x86_64"... 2023-01-25T06:31:37.294 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-01-25T06:31:37.311 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-448.el8.x86_64 2023-01-25T06:31:37.311 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T06:31:37.312 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T06:31:37.312 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T06:31:38.313 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-25T06:31:38.314 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T06:31:38.397 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2023-01-25T06:31:38.423 DEBUG:teuthology.parallel:result is None 2023-01-25T06:31:56.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T06:31:56.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:31:56.818 DEBUG:teuthology.orchestra.run.smithi085:> true 2023-01-25T06:31:57.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T06:31:57.074 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-448.el8.x86_64"... 2023-01-25T06:31:57.074 DEBUG:teuthology.orchestra.run.smithi085:> uname -r 2023-01-25T06:31:57.134 INFO:teuthology.orchestra.run.smithi085.stdout:4.18.0-448.el8.x86_64 2023-01-25T06:31:57.135 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-448.el8.x86_64 vs 4.18.0-448.el8.x86_64 2023-01-25T06:31:57.135 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-01-25T06:31:57.135 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-01-25T06:31:58.136 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-25T06:31:58.137 DEBUG:teuthology.orchestra.run.smithi085:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-25T06:31:58.246 INFO:teuthology.orchestra.run.smithi085.stdout:ttyS1 2023-01-25T06:31:58.263 DEBUG:teuthology.parallel:result is None 2023-01-25T06:31:58.264 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-25T06:31:58.271 INFO:teuthology.task.internal:Creating test directory... 2023-01-25T06:31:58.272 DEBUG:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T06:31:58.274 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-25T06:31:58.295 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-25T06:31:58.302 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-25T06:31:58.350 INFO:teuthology.task.internal:Creating archive directory... 2023-01-25T06:31:58.350 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T06:31:58.353 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-25T06:31:58.387 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-25T06:31:58.397 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-25T06:31:58.397 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T06:31:58.423 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-25T06:31:58.457 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:31:58.465 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:31:58.467 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:31:58.476 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-25T06:31:58.477 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-25T06:31:58.484 INFO:teuthology.task.internal:Configuring sudo... 2023-01-25T06:31:58.485 DEBUG:teuthology.orchestra.run.smithi085:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T06:31:58.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-25T06:31:58.548 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-25T06:31:58.557 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-25T06:31:58.558 DEBUG:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T06:31:58.580 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-25T06:31:58.607 DEBUG:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:31:58.679 DEBUG:teuthology.orchestra.run.smithi085:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:31:58.731 DEBUG:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:31:58.814 DEBUG:teuthology.orchestra.run.smithi085:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:31:58.859 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:31:58.859 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T06:31:58.926 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:31:58.967 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-25T06:31:59.021 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:31:59.103 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-25T06:31:59.149 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:31:59.149 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-25T06:31:59.217 DEBUG:teuthology.orchestra.run.smithi085:> sudo service rsyslog restart 2023-01-25T06:31:59.219 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2023-01-25T06:31:59.266 INFO:teuthology.orchestra.run.smithi085.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T06:31:59.338 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-25T06:31:59.737 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-25T06:31:59.750 INFO:teuthology.task.internal:Starting timer... 2023-01-25T06:31:59.750 INFO:teuthology.run_tasks:Running task pcp... 2023-01-25T06:31:59.777 INFO:teuthology.run_tasks:Running task selinux... 2023-01-25T06:31:59.850 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-25T06:31:59.851 DEBUG:teuthology.orchestra.run.smithi085:> sudo service auditd rotate 2023-01-25T06:31:59.898 INFO:teuthology.orchestra.run.smithi085.stdout:Rotating logs: 2023-01-25T06:31:59.899 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2023-01-25T06:31:59.949 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2023-01-25T06:31:59.951 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-25T06:31:59.951 DEBUG:teuthology.orchestra.run.smithi085:> /usr/sbin/getenforce 2023-01-25T06:31:59.977 INFO:teuthology.orchestra.run.smithi085.stdout:Permissive 2023-01-25T06:31:59.977 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2023-01-25T06:32:00.002 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2023-01-25T06:32:00.002 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi085.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2023-01-25T06:32:00.003 DEBUG:teuthology.orchestra.run.smithi085:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T06:32:00.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:32:00.046 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-25T06:32:00.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-25T06:32:00.074 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-25T06:32:00.075 DEBUG:teuthology.orchestra.run.smithi085:> sudo /usr/sbin/setenforce permissive 2023-01-25T06:32:00.122 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2023-01-25T06:32:00.156 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-25T06:32:00.166 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-01-25T06:32:00.166 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-25T06:32:00.184 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-25T06:32:00.185 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi085.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-25T06:38:23.307 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi085.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2023-01-25T06:38:23.309 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi085.front.sepia.ceph.com' 2023-01-25T06:38:23.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:38:23.380 DEBUG:teuthology.orchestra.run.smithi085:> true 2023-01-25T06:38:23.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-01-25T06:38:23.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-25T06:38:23.517 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-01-25T06:38:23.586 INFO:teuthology.run_tasks:Running task clock... 2023-01-25T06:38:23.596 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-25T06:38:23.597 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T06:38:23.598 DEBUG:teuthology.orchestra.run.smithi085:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T06:38:23.600 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-25T06:38:23.600 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-25T06:38:23.630 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T06:38:23.644 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T06:38:23.657 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-25T06:38:23.671 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-25T06:38:23.710 INFO:teuthology.orchestra.run.smithi085.stderr:sudo: ntpd: command not found 2023-01-25T06:38:23.721 INFO:teuthology.orchestra.run.smithi085.stdout:506 Cannot talk to daemon 2023-01-25T06:38:23.735 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T06:38:23.745 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2023-01-25T06:38:23.749 INFO:teuthology.orchestra.run.smithi085.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T06:38:23.756 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2023-01-25T06:38:23.770 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-25T06:38:23.784 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-25T06:38:23.822 INFO:teuthology.orchestra.run.smithi085.stderr:bash: ntpq: command not found 2023-01-25T06:38:23.825 INFO:teuthology.orchestra.run.smithi085.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T06:38:23.826 INFO:teuthology.orchestra.run.smithi085.stdout:=============================================================================== 2023-01-25T06:38:23.826 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.826 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.826 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.827 INFO:teuthology.orchestra.run.smithi085.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.855 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-01-25T06:38:23.858 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-25T06:38:23.858 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-01-25T06:38:23.859 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.859 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.859 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.859 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-25T06:38:23.860 INFO:teuthology.run_tasks:Running task install... 2023-01-25T06:38:23.870 DEBUG:teuthology.task.install:project ceph 2023-01-25T06:38:23.871 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}} 2023-01-25T06:38:23.871 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'} 2023-01-25T06:38:23.871 INFO:teuthology.task.install:Using flavor: default 2023-01-25T06:38:23.877 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-25T06:38:23.878 INFO:teuthology.task.install:extra packages: [] 2023-01-25T06:38:23.878 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T06:38:23.915 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T06:38:23.917 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:38:23.917 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2023-01-25T06:38:23.918 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T06:38:23.918 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T06:38:23.955 INFO:teuthology.orchestra.run.smithi173.stdout:CentOSStream 2023-01-25T06:38:23.957 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:38:23.957 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'tag': None, 'wait_for_package': False} 2023-01-25T06:38:23.958 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2023-01-25T06:38:23.993 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T06:38:23.994 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:38:23.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:38:24.033 INFO:teuthology.orchestra.run.smithi173.stdout:CentOSStream 2023-01-25T06:38:24.034 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:38:24.035 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:38:24.258 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T06:38:24.259 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T06:38:24.290 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/ 2023-01-25T06:38:24.290 INFO:teuthology.task.install.rpm:Package version is 18.0.0-1963.g61996d73 2023-01-25T06:38:24.434 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T06:38:24.435 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:38:24.435 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T06:38:24.463 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T06:38:24.464 DEBUG:teuthology.orchestra.run.smithi085:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T06:38:24.470 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-01-23-0928/61996d73ab738798e4ee0055c86457f5c459da4a/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-25T06:38:24.470 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:38:24.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-25T06:38:24.498 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-25T06:38:24.499 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/61996d73ab738798e4ee0055c86457f5c459da4a/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-25T06:38:24.532 DEBUG:teuthology.orchestra.run.smithi085:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T06:38:24.569 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-25T06:38:24.610 DEBUG:teuthology.orchestra.run.smithi085:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T06:38:24.648 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-25T06:38:24.677 INFO:teuthology.orchestra.run.smithi085.stdout:check_obsoletes = 1 2023-01-25T06:38:24.678 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum clean all 2023-01-25T06:38:24.715 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2023-01-25T06:38:24.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2023-01-25T06:38:24.932 INFO:teuthology.orchestra.run.smithi085.stdout:61 files removed 2023-01-25T06:38:24.959 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-radosgw 2023-01-25T06:38:24.967 INFO:teuthology.orchestra.run.smithi173.stdout:61 files removed 2023-01-25T06:38:24.996 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw 2023-01-25T06:38:25.987 INFO:teuthology.orchestra.run.smithi085.stdout:ceph packages for x86_64 129 kB/s | 80 kB 00:00 2023-01-25T06:38:26.009 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 132 kB/s | 80 kB 00:00 2023-01-25T06:38:26.354 INFO:teuthology.orchestra.run.smithi085.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-01-25T06:38:26.373 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-01-25T06:38:26.705 INFO:teuthology.orchestra.run.smithi085.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-01-25T06:38:26.718 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-01-25T06:38:28.024 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - AppStream 21 MB/s | 27 MB 00:01 2023-01-25T06:38:28.088 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - AppStream 20 MB/s | 27 MB 00:01 2023-01-25T06:38:33.624 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - BaseOS 41 MB/s | 27 MB 00:00 2023-01-25T06:38:33.861 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - BaseOS 36 MB/s | 27 MB 00:00 2023-01-25T06:38:37.873 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - Extras 156 kB/s | 18 kB 00:00 2023-01-25T06:38:38.137 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - Extras 158 kB/s | 18 kB 00:00 2023-01-25T06:38:38.292 INFO:teuthology.orchestra.run.smithi085.stdout:CentOS-8 - PowerTools 20 MB/s | 5.6 MB 00:00 2023-01-25T06:38:38.598 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-8 - PowerTools 17 MB/s | 5.6 MB 00:00 2023-01-25T06:38:39.525 INFO:teuthology.orchestra.run.smithi085.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-01-25T06:38:39.822 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-01-25T06:38:40.859 INFO:teuthology.orchestra.run.smithi085.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T06:38:41.197 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-25T06:38:44.126 INFO:teuthology.orchestra.run.smithi085.stdout:lab-extras 426 kB/s | 24 kB 00:00 2023-01-25T06:38:44.539 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-01-25T06:38:47.549 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:38:47.552 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:38:47.552 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:38:47.552 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:38:47.553 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:38:47.553 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T06:38:47.553 INFO:teuthology.orchestra.run.smithi085.stdout:Upgrading: 2023-01-25T06:38:47.553 INFO:teuthology.orchestra.run.smithi085.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:38:47.554 INFO:teuthology.orchestra.run.smithi085.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:38:47.554 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:38:47.554 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T06:38:47.554 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T06:38:47.555 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T06:38:47.555 INFO:teuthology.orchestra.run.smithi085.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T06:38:47.555 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T06:38:47.555 INFO:teuthology.orchestra.run.smithi085.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T06:38:47.556 INFO:teuthology.orchestra.run.smithi085.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T06:38:47.556 INFO:teuthology.orchestra.run.smithi085.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T06:38:47.556 INFO:teuthology.orchestra.run.smithi085.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T06:38:47.557 INFO:teuthology.orchestra.run.smithi085.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T06:38:47.557 INFO:teuthology.orchestra.run.smithi085.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T06:38:47.557 INFO:teuthology.orchestra.run.smithi085.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T06:38:47.558 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-argparse 2023-01-25T06:38:47.558 INFO:teuthology.orchestra.run.smithi085.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T06:38:47.558 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T06:38:47.558 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T06:38:47.559 INFO:teuthology.orchestra.run.smithi085.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T06:38:47.559 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T06:38:47.559 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T06:38:47.559 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T06:38:47.560 INFO:teuthology.orchestra.run.smithi085.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T06:38:47.560 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:38:47.560 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:38:47.560 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:38:47.561 INFO:teuthology.orchestra.run.smithi085.stdout:Install 21 Packages 2023-01-25T06:38:47.561 INFO:teuthology.orchestra.run.smithi085.stdout:Upgrade 2 Packages 2023-01-25T06:38:47.561 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:38:47.562 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 62 M 2023-01-25T06:38:47.562 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:38:48.013 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:38:48.015 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:38:48.016 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:38:48.016 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:38:48.016 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:38:48.016 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 13 M 2023-01-25T06:38:48.017 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2023-01-25T06:38:48.017 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:38:48.017 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.6 M 2023-01-25T06:38:48.017 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:38:48.017 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:18.0.0-1963.g61996d73.el8 ceph 5.2 M 2023-01-25T06:38:48.018 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 M 2023-01-25T06:38:48.018 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:18.0.0-1963.g61996d73.el8 ceph 24 k 2023-01-25T06:38:48.018 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-25T06:38:48.018 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 767 k 2023-01-25T06:38:48.018 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-25T06:38:48.019 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-25T06:38:48.019 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 474 k 2023-01-25T06:38:48.019 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-25T06:38:48.019 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.5 M 2023-01-25T06:38:48.019 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-25T06:38:48.020 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-25T06:38:48.020 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse 2023-01-25T06:38:48.020 INFO:teuthology.orchestra.run.smithi173.stdout: x86_64 2:18.0.0-1963.g61996d73.el8 ceph 45 k 2023-01-25T06:38:48.020 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:18.0.0-1963.g61996d73.el8 ceph 115 k 2023-01-25T06:38:48.020 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:18.0.0-1963.g61996d73.el8 ceph 190 k 2023-01-25T06:38:48.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-25T06:38:48.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:18.0.0-1963.g61996d73.el8 ceph 371 k 2023-01-25T06:38:48.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 365 k 2023-01-25T06:38:48.021 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:18.0.0-1963.g61996d73.el8 ceph 107 k 2023-01-25T06:38:48.021 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-01-25T06:38:48.022 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:38:48.022 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:38:48.022 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:38:48.022 INFO:teuthology.orchestra.run.smithi173.stdout:Install 21 Packages 2023-01-25T06:38:48.022 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 2 Packages 2023-01-25T06:38:48.023 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:38:48.023 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 62 M 2023-01-25T06:38:48.023 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:38:48.044 INFO:teuthology.orchestra.run.smithi085.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 11 MB/s | 5.2 MB 00:00 2023-01-25T06:38:48.094 INFO:teuthology.orchestra.run.smithi085.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 488 kB/s | 24 kB 00:00 2023-01-25T06:38:48.178 INFO:teuthology.orchestra.run.smithi085.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 9.0 MB/s | 767 kB 00:00 2023-01-25T06:38:48.253 INFO:teuthology.orchestra.run.smithi085.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 6.2 MB/s | 474 kB 00:00 2023-01-25T06:38:48.754 INFO:teuthology.orchestra.run.smithi085.stdout:(5/23): librgw2-18.0.0-1963.g61996d73.el8.x86_6 13 MB/s | 6.5 MB 00:00 2023-01-25T06:38:48.812 INFO:teuthology.orchestra.run.smithi085.stdout:(6/23): python3-ceph-argparse-18.0.0-1963.g6199 766 kB/s | 45 kB 00:00 2023-01-25T06:38:48.871 INFO:teuthology.orchestra.run.smithi085.stdout:(7/23): python3-ceph-common-18.0.0-1963.g61996d 1.9 MB/s | 115 kB 00:00 2023-01-25T06:38:48.930 INFO:teuthology.orchestra.run.smithi085.stdout:(8/23): python3-cephfs-18.0.0-1963.g61996d73.el 3.2 MB/s | 190 kB 00:00 2023-01-25T06:38:49.005 INFO:teuthology.orchestra.run.smithi085.stdout:(9/23): python3-rados-18.0.0-1963.g61996d73.el8 4.8 MB/s | 371 kB 00:00 2023-01-25T06:38:49.080 INFO:teuthology.orchestra.run.smithi085.stdout:(10/23): python3-rbd-18.0.0-1963.g61996d73.el8. 4.7 MB/s | 365 kB 00:00 2023-01-25T06:38:49.156 INFO:teuthology.orchestra.run.smithi085.stdout:(11/23): python3-rgw-18.0.0-1963.g61996d73.el8. 1.4 MB/s | 107 kB 00:00 2023-01-25T06:38:49.190 INFO:teuthology.orchestra.run.smithi173.stdout:(1/23): ceph-base-18.0.0-1963.g61996d73.el8.x86 4.4 MB/s | 5.2 MB 00:01 2023-01-25T06:38:49.214 INFO:teuthology.orchestra.run.smithi085.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-01-25T06:38:49.240 INFO:teuthology.orchestra.run.smithi085.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2023-01-25T06:38:49.240 INFO:teuthology.orchestra.run.smithi173.stdout:(2/23): ceph-selinux-18.0.0-1963.g61996d73.el8. 488 kB/s | 24 kB 00:00 2023-01-25T06:38:49.265 INFO:teuthology.orchestra.run.smithi085.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-25T06:38:49.290 INFO:teuthology.orchestra.run.smithi085.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-01-25T06:38:49.357 INFO:teuthology.orchestra.run.smithi173.stdout:(3/23): libcephfs2-18.0.0-1963.g61996d73.el8.x8 6.4 MB/s | 767 kB 00:00 2023-01-25T06:38:49.457 INFO:teuthology.orchestra.run.smithi173.stdout:(4/23): libradosstriper1-18.0.0-1963.g61996d73. 4.6 MB/s | 474 kB 00:00 2023-01-25T06:38:49.532 INFO:teuthology.orchestra.run.smithi085.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-01-25T06:38:49.591 INFO:teuthology.orchestra.run.smithi085.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-01-25T06:38:49.649 INFO:teuthology.orchestra.run.smithi085.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-01-25T06:38:49.892 INFO:teuthology.orchestra.run.smithi085.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2023-01-25T06:38:50.275 INFO:teuthology.orchestra.run.smithi085.stdout:(20/23): librados2-18.0.0-1963.g61996d73.el8.x8 9.5 MB/s | 3.6 MB 00:00 2023-01-25T06:38:50.307 INFO:teuthology.orchestra.run.smithi173.stdout:(5/23): librgw2-18.0.0-1963.g61996d73.el8.x86_6 7.6 MB/s | 6.5 MB 00:00 2023-01-25T06:38:50.416 INFO:teuthology.orchestra.run.smithi173.stdout:(6/23): python3-ceph-argparse-18.0.0-1963.g6199 410 kB/s | 45 kB 00:00 2023-01-25T06:38:50.525 INFO:teuthology.orchestra.run.smithi173.stdout:(7/23): python3-ceph-common-18.0.0-1963.g61996d 1.0 MB/s | 115 kB 00:00 2023-01-25T06:38:50.542 INFO:teuthology.orchestra.run.smithi085.stdout:(21/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 13 MB/s | 3.6 MB 00:00 2023-01-25T06:38:50.592 INFO:teuthology.orchestra.run.smithi173.stdout:(8/23): python3-cephfs-18.0.0-1963.g61996d73.el 2.8 MB/s | 190 kB 00:00 2023-01-25T06:38:50.659 INFO:teuthology.orchestra.run.smithi173.stdout:(9/23): python3-rados-18.0.0-1963.g61996d73.el8 5.4 MB/s | 371 kB 00:00 2023-01-25T06:38:50.717 INFO:teuthology.orchestra.run.smithi173.stdout:(10/23): python3-rbd-18.0.0-1963.g61996d73.el8. 6.1 MB/s | 365 kB 00:00 2023-01-25T06:38:50.768 INFO:teuthology.orchestra.run.smithi173.stdout:(11/23): python3-rgw-18.0.0-1963.g61996d73.el8. 2.1 MB/s | 107 kB 00:00 2023-01-25T06:38:50.826 INFO:teuthology.orchestra.run.smithi173.stdout:(12/23): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-01-25T06:38:50.851 INFO:teuthology.orchestra.run.smithi173.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2023-01-25T06:38:50.877 INFO:teuthology.orchestra.run.smithi173.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-25T06:38:50.902 INFO:teuthology.orchestra.run.smithi173.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-01-25T06:38:51.009 INFO:teuthology.orchestra.run.smithi085.stdout:(22/23): ceph-common-18.0.0-1963.g61996d73.el8. 7.1 MB/s | 24 MB 00:03 2023-01-25T06:38:51.127 INFO:teuthology.orchestra.run.smithi173.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-01-25T06:38:51.168 INFO:teuthology.orchestra.run.smithi085.stdout:(23/23): ceph-radosgw-18.0.0-1963.g61996d73.el8 3.6 MB/s | 13 MB 00:03 2023-01-25T06:38:51.171 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:38:51.172 INFO:teuthology.orchestra.run.smithi085.stdout:Total 17 MB/s | 62 MB 00:03 2023-01-25T06:38:51.186 INFO:teuthology.orchestra.run.smithi173.stdout:(17/23): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-01-25T06:38:51.212 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:38:51.244 INFO:teuthology.orchestra.run.smithi173.stdout:(18/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-01-25T06:38:51.257 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:38:51.258 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:38:51.487 INFO:teuthology.orchestra.run.smithi173.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 7.2 MB/s | 1.7 MB 00:00 2023-01-25T06:38:51.778 INFO:teuthology.orchestra.run.smithi173.stdout:(20/23): librados2-18.0.0-1963.g61996d73.el8.x8 12 MB/s | 3.6 MB 00:00 2023-01-25T06:38:51.860 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:38:51.864 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:38:52.020 INFO:teuthology.orchestra.run.smithi173.stdout:(21/23): ceph-radosgw-18.0.0-1963.g61996d73.el8 3.3 MB/s | 13 MB 00:04 2023-01-25T06:38:52.087 INFO:teuthology.orchestra.run.smithi173.stdout:(22/23): librbd1-18.0.0-1963.g61996d73.el8.x86_ 12 MB/s | 3.6 MB 00:00 2023-01-25T06:38:53.106 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:38:53.299 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T06:38:53.564 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T06:38:53.776 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T06:38:54.179 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T06:38:54.387 INFO:teuthology.orchestra.run.smithi085.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:38:54.491 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:38:54.733 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:38:54.918 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:38:55.318 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:38:55.459 INFO:teuthology.orchestra.run.smithi085.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:38:55.524 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:38:55.671 INFO:teuthology.orchestra.run.smithi173.stdout:(23/23): ceph-common-18.0.0-1963.g61996d73.el8. 3.2 MB/s | 24 MB 00:07 2023-01-25T06:38:55.674 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:38:55.674 INFO:teuthology.orchestra.run.smithi173.stdout:Total 8.0 MB/s | 62 MB 00:07 2023-01-25T06:38:55.674 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T06:38:55.712 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:38:55.757 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:38:55.757 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:38:55.859 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:38:55.927 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:38:56.053 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T06:38:56.278 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:38:56.386 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:38:56.390 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:38:56.543 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:38:56.692 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:38:56.750 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:38:56.960 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T06:38:57.588 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:38:57.786 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T06:38:57.791 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-01-25T06:38:58.018 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T06:38:58.032 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/25 2023-01-25T06:38:58.093 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T06:38:58.219 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T06:38:58.275 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:38:58.450 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T06:38:58.602 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/25 2023-01-25T06:38:58.670 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T06:38:58.802 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:38:58.928 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:38:59.183 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:38:59.369 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:38:59.763 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 6/25 2023-01-25T06:38:59.935 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:39:00.001 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:39:00.175 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-01-25T06:39:00.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:39:00.404 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-01-25T06:39:00.576 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 10/25 2023-01-25T06:39:00.888 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:39:01.153 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:39:01.301 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:39:01.400 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 13/25 2023-01-25T06:39:01.603 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 14/25 2023-01-25T06:39:02.388 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 15/25 2023-01-25T06:39:02.394 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:02.568 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T06:39:02.640 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 16/25 2023-01-25T06:39:02.684 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:02.826 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 17/25 2023-01-25T06:39:03.026 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-25T06:39:03.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 19/25 2023-01-25T06:39:03.280 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:03.613 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:39:03.694 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:39:03.925 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:06.997 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:07.251 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:07.844 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 20/25 2023-01-25T06:39:08.206 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:39:08.280 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 21/25 2023-01-25T06:39:08.467 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:23.318 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:23.319 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /sys 2023-01-25T06:39:23.319 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /proc 2023-01-25T06:39:23.319 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /dev 2023-01-25T06:39:23.319 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /run 2023-01-25T06:39:23.320 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /mnt 2023-01-25T06:39:23.320 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /var/tmp 2023-01-25T06:39:23.320 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /home 2023-01-25T06:39:23.320 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /tmp 2023-01-25T06:39:23.321 INFO:teuthology.orchestra.run.smithi085.stdout:skipping the directory /dev 2023-01-25T06:39:23.321 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:24.777 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:39:24.797 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:39:24.798 INFO:teuthology.orchestra.run.smithi085.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:39:24.991 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:39:24.991 INFO:teuthology.orchestra.run.smithi085.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:25.663 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:25.666 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T06:39:25.666 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T06:39:25.666 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:39:25.667 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:39:25.667 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:39:25.667 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T06:39:25.667 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:39:25.667 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T06:39:25.668 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T06:39:25.668 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T06:39:25.668 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:39:25.668 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:39:25.669 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T06:39:25.669 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T06:39:25.669 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T06:39:25.669 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T06:39:25.669 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T06:39:25.670 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T06:39:25.670 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T06:39:25.670 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T06:39:25.670 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T06:39:25.670 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:25.671 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T06:39:25.671 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T06:39:26.518 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:26.518 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:26.518 INFO:teuthology.orchestra.run.smithi085.stdout:Upgraded: 2023-01-25T06:39:26.518 INFO:teuthology.orchestra.run.smithi085.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.518 INFO:teuthology.orchestra.run.smithi085.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.519 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:39:26.519 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.519 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.519 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.519 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.520 INFO:teuthology.orchestra.run.smithi085.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T06:39:26.520 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.520 INFO:teuthology.orchestra.run.smithi085.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T06:39:26.520 INFO:teuthology.orchestra.run.smithi085.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T06:39:26.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T06:39:26.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.523 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.523 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:26.523 INFO:teuthology.orchestra.run.smithi085.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T06:39:26.523 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:26.523 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:39:26.815 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-test 2023-01-25T06:39:27.541 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:00:43 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:27.651 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:27.651 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2023-01-25T06:39:27.651 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2023-01-25T06:39:27.652 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-01-25T06:39:27.652 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /run 2023-01-25T06:39:27.652 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2023-01-25T06:39:27.652 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2023-01-25T06:39:27.652 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2023-01-25T06:39:27.653 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2023-01-25T06:39:27.653 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-01-25T06:39:27.653 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:28.688 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:39:28.689 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:39:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:39:28.689 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:39:28.690 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:39:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T06:39:28.690 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:39:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T06:39:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T06:39:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T06:39:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T06:39:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T06:39:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:28.691 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:39:28.692 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:39:28.692 INFO:teuthology.orchestra.run.smithi085.stdout:Install 6 Packages 2023-01-25T06:39:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:28.693 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 48 M 2023-01-25T06:39:28.693 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 218 M 2023-01-25T06:39:28.693 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:39:28.779 INFO:teuthology.orchestra.run.smithi085.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.3 MB/s | 202 kB 00:00 2023-01-25T06:39:28.804 INFO:teuthology.orchestra.run.smithi085.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-01-25T06:39:28.838 INFO:teuthology.orchestra.run.smithi085.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.4 MB/s | 323 kB 00:00 2023-01-25T06:39:28.871 INFO:teuthology.orchestra.run.smithi085.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.1 MB/s | 71 kB 00:00 2023-01-25T06:39:28.988 INFO:teuthology.orchestra.run.smithi085.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 463 kB/s | 137 kB 00:00 2023-01-25T06:39:29.086 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:39:29.107 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 23/25 2023-01-25T06:39:29.107 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:39:29.333 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-25T06:39:29.334 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:30.050 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:30.050 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 1/25 2023-01-25T06:39:30.050 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2/25 2023-01-25T06:39:30.050 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 3/25 2023-01-25T06:39:30.051 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 4/25 2023-01-25T06:39:30.051 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 5/25 2023-01-25T06:39:30.051 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_6 6/25 2023-01-25T06:39:30.051 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 7/25 2023-01-25T06:39:30.051 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8. 8/25 2023-01-25T06:39:30.052 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x8 9/25 2023-01-25T06:39:30.052 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 10/25 2023-01-25T06:39:30.052 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 11/25 2023-01-25T06:39:30.052 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 12/25 2023-01-25T06:39:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 13/25 2023-01-25T06:39:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-25T06:39:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-25T06:39:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-25T06:39:30.053 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-25T06:39:30.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-25T06:39:30.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 19/25 2023-01-25T06:39:30.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 20/25 2023-01-25T06:39:30.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 21/25 2023-01-25T06:39:30.054 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:18.0.0-1963.g61996d73.el8.x86_64 22/25 2023-01-25T06:39:30.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-25T06:39:30.055 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 24/25 2023-01-25T06:39:30.887 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-25T06:39:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:30.888 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2023-01-25T06:39:30.888 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.889 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:39:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.889 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.890 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-25T06:39:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-25T06:39:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-25T06:39:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.891 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-25T06:39:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-25T06:39:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-25T06:39:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.892 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-25T06:39:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.893 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.13.0-2.el8.x86_64 2023-01-25T06:39:30.894 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:30.894 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:39:31.203 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-test 2023-01-25T06:39:31.430 INFO:teuthology.orchestra.run.smithi085.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 17 MB/s | 47 MB 00:02 2023-01-25T06:39:31.433 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:39:31.433 INFO:teuthology.orchestra.run.smithi085.stdout:Total 18 MB/s | 48 MB 00:02 2023-01-25T06:39:31.478 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:39:31.499 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:39:31.499 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:39:31.800 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:39:31.806 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:39:31.930 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:47 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:32.272 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:39:32.486 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T06:39:32.698 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T06:39:32.862 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T06:39:32.943 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T06:39:33.066 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:39:33.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:39:33.067 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:39:33.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:39:33.067 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:39:33.068 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:18.0.0-1963.g61996d73.el8 ceph 47 M 2023-01-25T06:39:33.068 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:39:33.068 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-25T06:39:33.068 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:18.0.0-1963.g61996d73.el8 ceph 137 k 2023-01-25T06:39:33.069 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-25T06:39:33.069 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-25T06:39:33.069 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-25T06:39:33.069 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:33.070 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:39:33.070 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:39:33.070 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2023-01-25T06:39:33.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:33.071 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 48 M 2023-01-25T06:39:33.071 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 218 M 2023-01-25T06:39:33.071 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:39:33.144 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.7 MB/s | 202 kB 00:00 2023-01-25T06:39:33.168 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.6 MB/s | 187 kB 00:00 2023-01-25T06:39:33.180 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T06:39:33.201 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.5 MB/s | 323 kB 00:00 2023-01-25T06:39:33.218 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.2 MB/s | 71 kB 00:00 2023-01-25T06:39:33.285 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): libcephsqlite-18.0.0-1963.g61996d73.el8. 636 kB/s | 137 kB 00:00 2023-01-25T06:39:33.370 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:39:35.377 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-test-18.0.0-1963.g61996d73.el8.x86_ 21 MB/s | 47 MB 00:02 2023-01-25T06:39:35.379 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:39:35.380 INFO:teuthology.orchestra.run.smithi173.stdout:Total 21 MB/s | 48 MB 00:02 2023-01-25T06:39:35.420 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:39:35.441 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:39:35.441 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:39:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:39:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:39:36.208 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:39:36.430 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-25T06:39:36.624 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-25T06:39:36.796 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T06:39:36.873 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-25T06:39:37.065 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-25T06:39:37.229 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:39:38.000 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:39:38.308 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:39:38.599 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:39:38.599 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T06:39:38.600 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T06:39:38.600 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T06:39:38.600 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T06:39:38.600 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T06:39:39.100 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T06:39:39.101 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:39.101 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:39:39.101 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:39.101 INFO:teuthology.orchestra.run.smithi085.stdout: jq-1.6-6.el8.x86_64 2023-01-25T06:39:39.101 INFO:teuthology.orchestra.run.smithi085.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:39.102 INFO:teuthology.orchestra.run.smithi085.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T06:39:39.102 INFO:teuthology.orchestra.run.smithi085.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T06:39:39.102 INFO:teuthology.orchestra.run.smithi085.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T06:39:39.102 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:39.102 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:39:39.331 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph 2023-01-25T06:39:40.057 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:00:56 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:41.216 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:39:41.219 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T06:39:41.219 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:39:41.219 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T06:39:41.220 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:39:41.220 INFO:teuthology.orchestra.run.smithi085.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T06:39:41.220 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:39:41.220 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T06:39:41.221 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T06:39:41.221 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T06:39:41.221 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T06:39:41.221 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T06:39:41.221 INFO:teuthology.orchestra.run.smithi085.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T06:39:41.222 INFO:teuthology.orchestra.run.smithi085.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T06:39:41.222 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T06:39:41.222 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T06:39:41.222 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T06:39:41.223 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T06:39:41.223 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T06:39:41.223 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T06:39:41.223 INFO:teuthology.orchestra.run.smithi085.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T06:39:41.223 INFO:teuthology.orchestra.run.smithi085.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T06:39:41.224 INFO:teuthology.orchestra.run.smithi085.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T06:39:41.224 INFO:teuthology.orchestra.run.smithi085.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T06:39:41.224 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T06:39:41.224 INFO:teuthology.orchestra.run.smithi085.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T06:39:41.225 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T06:39:41.225 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T06:39:41.225 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T06:39:41.225 INFO:teuthology.orchestra.run.smithi085.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T06:39:41.225 INFO:teuthology.orchestra.run.smithi085.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T06:39:41.226 INFO:teuthology.orchestra.run.smithi085.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T06:39:41.226 INFO:teuthology.orchestra.run.smithi085.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T06:39:41.226 INFO:teuthology.orchestra.run.smithi085.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T06:39:41.227 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T06:39:41.227 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T06:39:41.227 INFO:teuthology.orchestra.run.smithi085.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T06:39:41.227 INFO:teuthology.orchestra.run.smithi085.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T06:39:41.227 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:41.228 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:39:41.228 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================= 2023-01-25T06:39:41.228 INFO:teuthology.orchestra.run.smithi085.stdout:Install 32 Packages 2023-01-25T06:39:41.228 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:41.229 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 28 M 2023-01-25T06:39:41.229 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 110 M 2023-01-25T06:39:41.230 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:39:41.350 INFO:teuthology.orchestra.run.smithi085.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 51 kB/s | 6.4 kB 00:00 2023-01-25T06:39:41.575 INFO:teuthology.orchestra.run.smithi085.stdout:(2/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 6.5 MB/s | 2.3 MB 00:00 2023-01-25T06:39:41.625 INFO:teuthology.orchestra.run.smithi085.stdout:(3/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 3.8 MB/s | 1.5 MB 00:00 2023-01-25T06:39:41.701 INFO:teuthology.orchestra.run.smithi085.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 3.1 MB/s | 236 kB 00:00 2023-01-25T06:39:41.760 INFO:teuthology.orchestra.run.smithi085.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T06:39:41.776 INFO:teuthology.orchestra.run.smithi085.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 2.3 MB/s | 39 kB 00:00 2023-01-25T06:39:41.810 INFO:teuthology.orchestra.run.smithi085.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 3.0 MB/s | 103 kB 00:00 2023-01-25T06:39:41.835 INFO:teuthology.orchestra.run.smithi085.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-25T06:39:41.855 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 5/6 2023-01-25T06:39:41.877 INFO:teuthology.orchestra.run.smithi085.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 11 MB/s | 457 kB 00:00 2023-01-25T06:39:41.903 INFO:teuthology.orchestra.run.smithi085.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.2 MB/s | 237 kB 00:00 2023-01-25T06:39:41.953 INFO:teuthology.orchestra.run.smithi085.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 11 MB/s | 559 kB 00:00 2023-01-25T06:39:41.978 INFO:teuthology.orchestra.run.smithi085.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.2 MB/s | 109 kB 00:00 2023-01-25T06:39:42.134 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:39:42.154 INFO:teuthology.orchestra.run.smithi085.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 249 kB/s | 44 kB 00:00 2023-01-25T06:39:42.220 INFO:teuthology.orchestra.run.smithi085.stdout:(14/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 4.5 MB/s | 3.9 MB 00:00 2023-01-25T06:39:42.279 INFO:teuthology.orchestra.run.smithi085.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2023-01-25T06:39:42.429 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 6/6 2023-01-25T06:39:42.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 1/6 2023-01-25T06:39:42.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2/6 2023-01-25T06:39:42.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-25T06:39:42.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-25T06:39:42.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-25T06:39:42.463 INFO:teuthology.orchestra.run.smithi085.stdout:(16/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 19 MB/s | 17 MB 00:00 2023-01-25T06:39:42.488 INFO:teuthology.orchestra.run.smithi085.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 646 kB/s | 173 kB 00:00 2023-01-25T06:39:42.522 INFO:teuthology.orchestra.run.smithi085.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.6 MB/s | 384 kB 00:00 2023-01-25T06:39:42.547 INFO:teuthology.orchestra.run.smithi085.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 299 kB/s | 18 kB 00:00 2023-01-25T06:39:42.581 INFO:teuthology.orchestra.run.smithi085.stdout:(20/32): python3-jaraco-6.2-6.el8.noarch.rpm 94 kB/s | 11 kB 00:00 2023-01-25T06:39:42.606 INFO:teuthology.orchestra.run.smithi085.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 578 kB/s | 49 kB 00:00 2023-01-25T06:39:42.656 INFO:teuthology.orchestra.run.smithi085.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 538 kB/s | 59 kB 00:00 2023-01-25T06:39:42.682 INFO:teuthology.orchestra.run.smithi085.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-01-25T06:39:42.715 INFO:teuthology.orchestra.run.smithi085.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 320 kB/s | 19 kB 00:00 2023-01-25T06:39:42.749 INFO:teuthology.orchestra.run.smithi085.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 358 kB/s | 24 kB 00:00 2023-01-25T06:39:42.774 INFO:teuthology.orchestra.run.smithi085.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-01-25T06:39:42.799 INFO:teuthology.orchestra.run.smithi085.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 348 kB/s | 29 kB 00:00 2023-01-25T06:39:42.825 INFO:teuthology.orchestra.run.smithi085.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-01-25T06:39:42.858 INFO:teuthology.orchestra.run.smithi085.stdout:(29/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2023-01-25T06:39:42.884 INFO:teuthology.orchestra.run.smithi085.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.4 MB/s | 85 kB 00:00 2023-01-25T06:39:42.918 INFO:teuthology.orchestra.run.smithi085.stdout:(31/32): python3-waitress-1.2.1-2.el8.1.noarch. 2.0 MB/s | 241 kB 00:00 2023-01-25T06:39:42.943 INFO:teuthology.orchestra.run.smithi085.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 273 kB/s | 23 kB 00:00 2023-01-25T06:39:42.945 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:39:42.946 INFO:teuthology.orchestra.run.smithi085.stdout:Total 16 MB/s | 28 MB 00:01 2023-01-25T06:39:42.978 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-25T06:39:42.978 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:42.978 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:39:42.979 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:42.979 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-6.el8.x86_64 2023-01-25T06:39:42.979 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:42.980 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-25T06:39:42.980 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-25T06:39:42.980 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-25T06:39:42.980 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:42.980 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:39:43.020 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:39:43.056 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:39:43.056 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:39:43.210 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph 2023-01-25T06:39:43.458 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:39:43.462 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:39:43.944 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:59 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:44.678 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:39:44.924 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T06:39:45.075 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:39:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2023-01-25T06:39:45.078 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:39:45.078 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2023-01-25T06:39:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:39:45.079 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:18.0.0-1963.g61996d73.el8 ceph 6.4 k 2023-01-25T06:39:45.079 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:39:45.080 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:18.0.0-1963.g61996d73.el8 ceph 2.3 M 2023-01-25T06:39:45.080 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:18.0.0-1963.g61996d73.el8 ceph 1.5 M 2023-01-25T06:39:45.080 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 236 k 2023-01-25T06:39:45.080 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.9 M 2023-01-25T06:39:45.081 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 17 M 2023-01-25T06:39:45.081 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-25T06:39:45.081 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-25T06:39:45.081 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-25T06:39:45.081 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-25T06:39:45.082 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-25T06:39:45.082 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-25T06:39:45.082 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-25T06:39:45.082 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-25T06:39:45.083 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-25T06:39:45.083 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-25T06:39:45.083 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-25T06:39:45.083 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-25T06:39:45.084 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-25T06:39:45.084 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-25T06:39:45.084 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-25T06:39:45.084 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-25T06:39:45.085 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-25T06:39:45.085 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-25T06:39:45.085 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-25T06:39:45.085 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-25T06:39:45.085 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-25T06:39:45.086 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-25T06:39:45.086 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-25T06:39:45.086 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-25T06:39:45.086 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-25T06:39:45.087 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-25T06:39:45.087 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:39:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================= 2023-01-25T06:39:45.087 INFO:teuthology.orchestra.run.smithi173.stdout:Install 32 Packages 2023-01-25T06:39:45.088 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:45.088 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 28 M 2023-01-25T06:39:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 110 M 2023-01-25T06:39:45.089 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:39:45.143 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T06:39:45.213 INFO:teuthology.orchestra.run.smithi173.stdout:(1/32): ceph-18.0.0-1963.g61996d73.el8.x86_64.r 50 kB/s | 6.4 kB 00:00 2023-01-25T06:39:45.381 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T06:39:45.446 INFO:teuthology.orchestra.run.smithi173.stdout:(2/32): ceph-mds-18.0.0-1963.g61996d73.el8.x86_ 6.3 MB/s | 2.3 MB 00:00 2023-01-25T06:39:45.479 INFO:teuthology.orchestra.run.smithi173.stdout:(3/32): ceph-mgr-18.0.0-1963.g61996d73.el8.x86_ 3.9 MB/s | 1.5 MB 00:00 2023-01-25T06:39:45.563 INFO:teuthology.orchestra.run.smithi173.stdout:(4/32): ceph-mgr-modules-core-18.0.0-1963.g6199 2.8 MB/s | 236 kB 00:00 2023-01-25T06:39:45.622 INFO:teuthology.orchestra.run.smithi173.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-25T06:39:45.647 INFO:teuthology.orchestra.run.smithi173.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-25T06:39:45.650 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T06:39:45.672 INFO:teuthology.orchestra.run.smithi173.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-25T06:39:45.698 INFO:teuthology.orchestra.run.smithi173.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-25T06:39:45.731 INFO:teuthology.orchestra.run.smithi173.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-25T06:39:45.757 INFO:teuthology.orchestra.run.smithi173.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2023-01-25T06:39:45.799 INFO:teuthology.orchestra.run.smithi173.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 13 MB/s | 559 kB 00:00 2023-01-25T06:39:45.824 INFO:teuthology.orchestra.run.smithi173.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-25T06:39:45.839 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T06:39:45.982 INFO:teuthology.orchestra.run.smithi173.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 275 kB/s | 44 kB 00:00 2023-01-25T06:39:46.010 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T06:39:46.108 INFO:teuthology.orchestra.run.smithi173.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.4 MB/s | 185 kB 00:00 2023-01-25T06:39:46.167 INFO:teuthology.orchestra.run.smithi173.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.9 MB/s | 173 kB 00:00 2023-01-25T06:39:46.237 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T06:39:46.333 INFO:teuthology.orchestra.run.smithi173.stdout:(16/32): ceph-osd-18.0.0-1963.g61996d73.el8.x86 19 MB/s | 17 MB 00:00 2023-01-25T06:39:46.358 INFO:teuthology.orchestra.run.smithi173.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 2.0 MB/s | 384 kB 00:00 2023-01-25T06:39:46.424 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T06:39:46.436 INFO:teuthology.orchestra.run.smithi173.stdout:(18/32): ceph-mon-18.0.0-1963.g61996d73.el8.x86 3.2 MB/s | 3.9 MB 00:01 2023-01-25T06:39:46.459 INFO:teuthology.orchestra.run.smithi173.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 175 kB/s | 18 kB 00:00 2023-01-25T06:39:46.485 INFO:teuthology.orchestra.run.smithi173.stdout:(20/32): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-01-25T06:39:46.510 INFO:teuthology.orchestra.run.smithi173.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-01-25T06:39:46.560 INFO:teuthology.orchestra.run.smithi173.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-01-25T06:39:46.594 INFO:teuthology.orchestra.run.smithi173.stdout:(23/32): python3-logutils-0.3.5-11.el8.noarch.r 309 kB/s | 49 kB 00:00 2023-01-25T06:39:46.619 INFO:teuthology.orchestra.run.smithi173.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 317 kB/s | 19 kB 00:00 2023-01-25T06:39:46.653 INFO:teuthology.orchestra.run.smithi173.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 409 kB/s | 24 kB 00:00 2023-01-25T06:39:46.655 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T06:39:46.678 INFO:teuthology.orchestra.run.smithi173.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 499 kB/s | 29 kB 00:00 2023-01-25T06:39:46.704 INFO:teuthology.orchestra.run.smithi173.stdout:(27/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-01-25T06:39:46.728 INFO:teuthology.orchestra.run.smithi173.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2023-01-25T06:39:46.754 INFO:teuthology.orchestra.run.smithi173.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 3.1 MB/s | 241 kB 00:00 2023-01-25T06:39:46.795 INFO:teuthology.orchestra.run.smithi173.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.7 MB/s | 251 kB 00:00 2023-01-25T06:39:46.821 INFO:teuthology.orchestra.run.smithi173.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 928 kB/s | 85 kB 00:00 2023-01-25T06:39:46.846 INFO:teuthology.orchestra.run.smithi173.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 249 kB/s | 23 kB 00:00 2023-01-25T06:39:46.849 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:39:46.849 INFO:teuthology.orchestra.run.smithi173.stdout:Total 16 MB/s | 28 MB 00:01 2023-01-25T06:39:46.926 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T06:39:46.927 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:39:46.963 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:39:46.963 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:39:47.164 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T06:39:47.335 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:39:47.338 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:39:47.412 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T06:39:47.807 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T06:39:48.096 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T06:39:48.309 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T06:39:48.574 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T06:39:48.592 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:39:48.844 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T06:39:48.859 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-25T06:39:49.127 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-25T06:39:49.151 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T06:39:49.364 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-25T06:39:49.382 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T06:39:49.609 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-25T06:39:49.620 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T06:39:49.806 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T06:39:49.823 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-25T06:39:49.995 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-25T06:39:50.047 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T06:39:50.180 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-25T06:39:50.280 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T06:39:50.358 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-25T06:39:50.519 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T06:39:50.566 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-25T06:39:50.820 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-25T06:39:50.913 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T06:39:51.041 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-25T06:39:51.255 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T06:39:51.264 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-25T06:39:51.633 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T06:39:51.677 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-25T06:39:51.828 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:39:51.905 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-25T06:39:52.102 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-25T06:39:52.359 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-25T06:39:52.595 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T06:39:52.885 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-25T06:39:53.124 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-25T06:39:53.320 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-25T06:39:53.324 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:39:53.507 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-25T06:39:53.731 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-25T06:39:53.790 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:39:53.989 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-25T06:39:54.186 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:39:54.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-25T06:39:54.543 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:39:54.547 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-25T06:39:54.756 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:39:54.880 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-25T06:39:54.942 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:39:54.960 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:39:55.100 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:39:55.234 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 27/32 2023-01-25T06:39:55.438 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:39:55.533 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:39:55.534 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T06:39:55.534 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T06:39:55.534 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T06:39:55.534 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T06:39:55.535 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T06:39:55.535 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T06:39:55.535 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T06:39:55.535 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T06:39:55.535 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T06:39:55.536 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T06:39:55.536 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T06:39:55.536 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T06:39:55.536 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T06:39:55.536 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T06:39:55.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T06:39:55.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T06:39:55.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T06:39:55.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T06:39:55.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T06:39:55.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T06:39:55.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T06:39:55.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T06:39:55.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T06:39:55.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T06:39:55.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T06:39:55.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T06:39:55.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T06:39:55.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T06:39:55.540 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T06:39:55.540 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T06:39:55.540 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T06:39:56.516 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T06:39:56.516 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:56.516 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:39:56.517 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:56.517 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:56.517 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:56.517 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:39:56.517 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:56.518 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:56.518 INFO:teuthology.orchestra.run.smithi085.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T06:39:56.518 INFO:teuthology.orchestra.run.smithi085.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T06:39:56.518 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T06:39:56.518 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T06:39:56.519 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T06:39:56.519 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T06:39:56.519 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T06:39:56.519 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T06:39:56.519 INFO:teuthology.orchestra.run.smithi085.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T06:39:56.520 INFO:teuthology.orchestra.run.smithi085.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T06:39:56.520 INFO:teuthology.orchestra.run.smithi085.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T06:39:56.520 INFO:teuthology.orchestra.run.smithi085.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T06:39:56.520 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T06:39:56.520 INFO:teuthology.orchestra.run.smithi085.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T06:39:56.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T06:39:56.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T06:39:56.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T06:39:56.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T06:39:56.521 INFO:teuthology.orchestra.run.smithi085.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T06:39:56.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T06:39:56.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T06:39:56.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T06:39:56.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T06:39:56.522 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T06:39:56.523 INFO:teuthology.orchestra.run.smithi085.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T06:39:56.523 INFO:teuthology.orchestra.run.smithi085.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T06:39:56.523 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:39:56.523 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:39:56.717 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-base 2023-01-25T06:39:56.944 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 28/32 2023-01-25T06:39:57.146 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:39:57.437 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:13 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:57.531 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 29/32 2023-01-25T06:39:57.702 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:39:57.916 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 30/32 2023-01-25T06:39:58.118 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:39:58.136 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 31/32 2023-01-25T06:39:58.249 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:39:58.471 INFO:teuthology.orchestra.run.smithi085.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:39:58.569 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:39:58.570 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:39:58.570 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:39:58.657 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install cephadm 2023-01-25T06:39:58.696 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 32/32 2023-01-25T06:39:58.697 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:18.0.0-1963.g61996d73.el8.x86_64 1/32 2023-01-25T06:39:58.697 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2/32 2023-01-25T06:39:58.697 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 3/32 2023-01-25T06:39:58.697 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 4/32 2023-01-25T06:39:58.698 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 5/32 2023-01-25T06:39:58.698 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8. 6/32 2023-01-25T06:39:58.698 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-25T06:39:58.698 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-25T06:39:58.699 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-25T06:39:58.699 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-25T06:39:58.699 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-25T06:39:58.699 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-25T06:39:58.699 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-25T06:39:58.700 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-25T06:39:58.700 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-25T06:39:58.700 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-25T06:39:58.700 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-25T06:39:58.700 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-25T06:39:58.701 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-25T06:39:58.701 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-25T06:39:58.701 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-25T06:39:58.701 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-25T06:39:58.701 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-25T06:39:58.702 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-25T06:39:58.702 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-25T06:39:58.702 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-25T06:39:58.702 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-25T06:39:58.702 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-25T06:39:58.703 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-25T06:39:58.703 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-25T06:39:58.703 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-25T06:39:59.373 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:15 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:39:59.607 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-25T06:39:59.607 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:59.607 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:39:59.607 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:59.608 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:59.608 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:59.608 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:39:59.608 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:59.608 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:39:59.609 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-25T06:39:59.609 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-25T06:39:59.609 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-25T06:39:59.609 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-25T06:39:59.609 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-25T06:39:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-25T06:39:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-25T06:39:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-25T06:39:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-25T06:39:59.610 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-25T06:39:59.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-25T06:39:59.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-25T06:39:59.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-25T06:39:59.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-2.6-1.el8.noarch 2023-01-25T06:39:59.611 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-25T06:39:59.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-25T06:39:59.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-25T06:39:59.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-25T06:39:59.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-25T06:39:59.612 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-25T06:39:59.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-25T06:39:59.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-25T06:39:59.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-25T06:39:59.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-25T06:39:59.613 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-25T06:39:59.614 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-25T06:39:59.614 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:39:59.614 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:39:59.803 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-base 2023-01-25T06:40:00.516 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:00.517 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:00.517 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:00.517 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:00.518 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:00.518 INFO:teuthology.orchestra.run.smithi085.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T06:40:00.518 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:00.518 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:00.519 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:00.519 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:40:00.519 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:00.519 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 82 k 2023-01-25T06:40:00.519 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 374 k 2023-01-25T06:40:00.520 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:00.520 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:16 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:00.702 INFO:teuthology.orchestra.run.smithi085.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 447 kB/s | 82 kB 00:00 2023-01-25T06:40:00.703 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:00.703 INFO:teuthology.orchestra.run.smithi085.stdout:Total 444 kB/s | 82 kB 00:00 2023-01-25T06:40:00.703 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:00.710 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:00.711 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:00.712 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:00.716 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:00.773 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:01.557 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-base-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:01.656 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:01.657 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:40:01.658 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:01.746 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install cephadm 2023-01-25T06:40:02.310 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:02.454 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:02.463 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:18 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:02.690 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:03.175 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:03.175 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:03.176 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:03.176 INFO:teuthology.orchestra.run.smithi085.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:03.176 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:03.176 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:03.417 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T06:40:03.600 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:03.601 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:03.602 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:03.602 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:03.602 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:03.602 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 82 k 2023-01-25T06:40:03.602 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:03.603 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:03.603 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:03.603 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:40:03.603 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:03.604 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 82 k 2023-01-25T06:40:03.604 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 374 k 2023-01-25T06:40:03.604 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:03.785 INFO:teuthology.orchestra.run.smithi173.stdout:cephadm-18.0.0-1963.g61996d73.el8.noarch.rpm 450 kB/s | 82 kB 00:00 2023-01-25T06:40:03.786 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:03.786 INFO:teuthology.orchestra.run.smithi173.stdout:Total 447 kB/s | 82 kB 00:00 2023-01-25T06:40:03.786 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:03.794 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:03.794 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:03.796 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:03.799 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:03.846 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:04.145 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:20 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:05.296 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:05.297 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:05.298 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T06:40:05.298 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:05.298 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:05.298 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T06:40:05.298 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:05.299 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:05.299 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:05.299 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:40:05.299 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:05.300 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 165 k 2023-01-25T06:40:05.300 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 503 k 2023-01-25T06:40:05.300 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:05.419 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:05.570 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:05.675 INFO:teuthology.orchestra.run.smithi085.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 439 kB/s | 165 kB 00:00 2023-01-25T06:40:05.676 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:05.676 INFO:teuthology.orchestra.run.smithi085.stdout:Total 437 kB/s | 165 kB 00:00 2023-01-25T06:40:05.677 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:05.687 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:05.687 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:05.736 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:05.740 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:05.808 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:05.854 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:06.024 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:06.287 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:06.287 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:06.287 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:06.288 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:06.288 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:06.288 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:06.446 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:06.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-immutable-object-cache 2023-01-25T06:40:06.901 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:06.902 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:06.902 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:06.902 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:40:06.902 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:06.902 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:07.111 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr 2023-01-25T06:40:07.255 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:23 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:07.839 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:23 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:08.409 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:08.410 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:08.411 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2023-01-25T06:40:08.411 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:08.411 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:08.411 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-1963.g61996d73.el8 ceph 165 k 2023-01-25T06:40:08.411 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:08.412 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:08.412 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:08.412 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:40:08.412 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:08.413 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 165 k 2023-01-25T06:40:08.413 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 503 k 2023-01-25T06:40:08.413 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:08.615 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-immutable-object-cache-18.0.0-1963.g61996d 813 kB/s | 165 kB 00:00 2023-01-25T06:40:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:Total 808 kB/s | 165 kB 00:00 2023-01-25T06:40:08.616 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:08.627 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:08.627 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:08.676 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:08.680 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:08.803 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:08.873 INFO:teuthology.orchestra.run.smithi085.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:08.972 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:08.973 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:40:08.974 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:08.983 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:09.047 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T06:40:09.420 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:09.764 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:25 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:09.933 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-1963.g61996d73. 1/1 2023-01-25T06:40:09.934 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:09.934 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:09.934 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:40:09.934 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:09.934 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:10.115 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr 2023-01-25T06:40:10.846 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:26 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:10.914 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:10.915 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:10.915 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:10.915 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:10.915 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:10.916 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T06:40:10.916 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:40:10.916 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T06:40:10.916 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T06:40:10.916 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T06:40:10.917 INFO:teuthology.orchestra.run.smithi085.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T06:40:10.917 INFO:teuthology.orchestra.run.smithi085.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T06:40:10.917 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:10.917 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:10.917 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:10.918 INFO:teuthology.orchestra.run.smithi085.stdout:Install 6 Packages 2023-01-25T06:40:10.918 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:10.919 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 2.0 M 2023-01-25T06:40:10.919 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 8.2 M 2023-01-25T06:40:10.919 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:11.338 INFO:teuthology.orchestra.run.smithi085.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 55 kB/s | 23 kB 00:00 2023-01-25T06:40:11.363 INFO:teuthology.orchestra.run.smithi085.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 33 kB/s | 15 kB 00:00 2023-01-25T06:40:11.422 INFO:teuthology.orchestra.run.smithi085.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 511 kB/s | 43 kB 00:00 2023-01-25T06:40:11.497 INFO:teuthology.orchestra.run.smithi085.stdout:(4/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 3.0 MB/s | 1.7 MB 00:00 2023-01-25T06:40:11.522 INFO:teuthology.orchestra.run.smithi085.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 212 kB/s | 34 kB 00:00 2023-01-25T06:40:11.631 INFO:teuthology.orchestra.run.smithi085.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 941 kB/s | 196 kB 00:00 2023-01-25T06:40:11.633 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:11.634 INFO:teuthology.orchestra.run.smithi085.stdout:Total 2.8 MB/s | 2.0 MB 00:00 2023-01-25T06:40:11.645 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:11.655 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:11.655 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:11.744 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:11.748 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:11.889 INFO:teuthology.orchestra.run.smithi173.stdout:Package ceph-mgr-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:11.989 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:11.990 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:40:11.991 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:12.068 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:12.079 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-dashboard 2023-01-25T06:40:12.287 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T06:40:12.515 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T06:40:12.708 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T06:40:12.812 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T06:40:12.818 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:28 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:13.186 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T06:40:13.420 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:40:13.721 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:40:13.722 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T06:40:13.722 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T06:40:13.722 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T06:40:13.722 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T06:40:13.723 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T06:40:13.962 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:13.963 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:13.963 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:13.963 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:13.963 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:13.963 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 1.7 M 2023-01-25T06:40:13.964 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:40:13.964 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 23 k 2023-01-25T06:40:13.964 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 15 k 2023-01-25T06:40:13.964 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:13.965 INFO:teuthology.orchestra.run.smithi173.stdout:Install 6 Packages 2023-01-25T06:40:13.966 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:13.966 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 2.0 M 2023-01-25T06:40:13.967 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 8.2 M 2023-01-25T06:40:13.967 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:14.201 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T06:40:14.202 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:14.202 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:14.202 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:14.202 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:14.202 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:14.203 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T06:40:14.203 INFO:teuthology.orchestra.run.smithi085.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T06:40:14.203 INFO:teuthology.orchestra.run.smithi085.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T06:40:14.203 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:14.203 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:14.301 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T06:40:14.926 INFO:teuthology.orchestra.run.smithi173.stdout:(1/6): ceph-grafana-dashboards-18.0.0-1963.g619 24 kB/s | 23 kB 00:00 2023-01-25T06:40:15.021 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:31 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:15.043 INFO:teuthology.orchestra.run.smithi173.stdout:(2/6): ceph-prometheus-alerts-18.0.0-1963.g6199 13 kB/s | 15 kB 00:01 2023-01-25T06:40:15.102 INFO:teuthology.orchestra.run.smithi173.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 244 kB/s | 43 kB 00:00 2023-01-25T06:40:15.202 INFO:teuthology.orchestra.run.smithi173.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 212 kB/s | 34 kB 00:00 2023-01-25T06:40:15.302 INFO:teuthology.orchestra.run.smithi173.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 981 kB/s | 196 kB 00:00 2023-01-25T06:40:16.069 INFO:teuthology.orchestra.run.smithi173.stdout:(6/6): ceph-mgr-dashboard-18.0.0-1963.g61996d73 837 kB/s | 1.7 MB 00:02 2023-01-25T06:40:16.072 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:16.072 INFO:teuthology.orchestra.run.smithi173.stdout:Total 983 kB/s | 2.0 MB 00:02 2023-01-25T06:40:16.084 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:16.093 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:16.094 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:16.165 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:16.166 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T06:40:16.166 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:16.166 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T06:40:16.167 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:16.167 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T06:40:16.167 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:40:16.167 INFO:teuthology.orchestra.run.smithi085.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T06:40:16.167 INFO:teuthology.orchestra.run.smithi085.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T06:40:16.168 INFO:teuthology.orchestra.run.smithi085.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T06:40:16.168 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T06:40:16.168 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T06:40:16.168 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T06:40:16.168 INFO:teuthology.orchestra.run.smithi085.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T06:40:16.169 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:16.169 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:16.169 INFO:teuthology.orchestra.run.smithi085.stdout:===================================================================================================== 2023-01-25T06:40:16.169 INFO:teuthology.orchestra.run.smithi085.stdout:Install 8 Packages 2023-01-25T06:40:16.170 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:16.170 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 35 M 2023-01-25T06:40:16.170 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 210 M 2023-01-25T06:40:16.171 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:16.182 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:16.186 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:16.394 INFO:teuthology.orchestra.run.smithi085.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-01-25T06:40:16.456 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:16.486 INFO:teuthology.orchestra.run.smithi085.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2023-01-25T06:40:16.520 INFO:teuthology.orchestra.run.smithi085.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T06:40:16.687 INFO:teuthology.orchestra.run.smithi085.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 13 MB/s | 3.7 MB 00:00 2023-01-25T06:40:16.695 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-25T06:40:16.737 INFO:teuthology.orchestra.run.smithi085.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-01-25T06:40:16.771 INFO:teuthology.orchestra.run.smithi085.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2023-01-25T06:40:16.891 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-25T06:40:16.996 INFO:teuthology.orchestra.run.smithi085.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 29 MB/s | 14 MB 00:00 2023-01-25T06:40:17.043 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-25T06:40:17.155 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 4/6 2023-01-25T06:40:17.504 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 5/6 2023-01-25T06:40:17.696 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:40:17.721 INFO:teuthology.orchestra.run.smithi085.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-196 4.8 MB/s | 7.4 MB 00:01 2023-01-25T06:40:17.724 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:17.724 INFO:teuthology.orchestra.run.smithi085.stdout:Total 23 MB/s | 35 MB 00:01 2023-01-25T06:40:17.955 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:17.973 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:17.974 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:18.000 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 6/6 2023-01-25T06:40:18.000 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8. 1/6 2023-01-25T06:40:18.000 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarc 2/6 2023-01-25T06:40:18.001 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.n 3/6 2023-01-25T06:40:18.001 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-25T06:40:18.001 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-25T06:40:18.364 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:18.368 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:18.512 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-25T06:40:18.512 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:18.512 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:18.512 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:18.513 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:18.513 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:18.513 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-25T06:40:18.513 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-25T06:40:18.514 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-25T06:40:18.514 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:18.514 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:18.619 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-25T06:40:18.961 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:19.105 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T06:40:19.232 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T06:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:35 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:19.396 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T06:40:20.001 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T06:40:20.188 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:20.475 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:20.476 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2023-01-25T06:40:20.476 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:20.477 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2023-01-25T06:40:20.477 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:20.477 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 7.4 M 2023-01-25T06:40:20.477 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:40:20.478 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 8.5.0-18.el8 CentOS-BaseOS 645 k 2023-01-25T06:40:20.478 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 8.5.0-18.el8 CentOS-BaseOS 172 k 2023-01-25T06:40:20.478 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-25T06:40:20.478 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-25T06:40:20.478 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-25T06:40:20.479 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-25T06:40:20.479 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-25T06:40:20.479 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:20.479 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:20.479 INFO:teuthology.orchestra.run.smithi173.stdout:===================================================================================================== 2023-01-25T06:40:20.480 INFO:teuthology.orchestra.run.smithi173.stdout:Install 8 Packages 2023-01-25T06:40:20.480 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:20.480 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 35 M 2023-01-25T06:40:20.481 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 210 M 2023-01-25T06:40:20.481 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:20.727 INFO:teuthology.orchestra.run.smithi173.stdout:(1/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2023-01-25T06:40:20.812 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:20.836 INFO:teuthology.orchestra.run.smithi173.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-01-25T06:40:20.869 INFO:teuthology.orchestra.run.smithi173.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-25T06:40:20.945 INFO:teuthology.orchestra.run.smithi173.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 17 MB/s | 3.7 MB 00:00 2023-01-25T06:40:20.987 INFO:teuthology.orchestra.run.smithi173.stdout:(5/8): libgfortran-8.5.0-18.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-01-25T06:40:20.988 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T06:40:21.020 INFO:teuthology.orchestra.run.smithi173.stdout:(6/8): libquadmath-8.5.0-18.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2023-01-25T06:40:21.254 INFO:teuthology.orchestra.run.smithi173.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 36 MB/s | 14 MB 00:00 2023-01-25T06:40:21.371 INFO:teuthology.orchestra.run.smithi173.stdout:(8/8): ceph-mgr-diskprediction-local-18.0.0-196 8.3 MB/s | 7.4 MB 00:00 2023-01-25T06:40:21.373 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:21.373 INFO:teuthology.orchestra.run.smithi173.stdout:Total 40 MB/s | 35 MB 00:00 2023-01-25T06:40:21.604 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:21.623 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:21.623 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:21.672 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T06:40:22.011 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:22.015 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:22.335 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:40:22.546 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:40:22.579 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:22.714 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T06:40:22.847 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libquadmath-8.5.0-18.el8.x86_64 1/8 2023-01-25T06:40:22.980 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T06:40:23.585 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libgfortran-8.5.0-18.el8.x86_64 2/8 2023-01-25T06:40:23.747 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:24.317 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:40:24.382 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:24.547 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T06:40:25.249 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-25T06:40:25.645 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T06:40:25.792 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:40:25.862 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:40:26.005 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:40:26.207 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:40:26.207 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T06:40:26.208 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T06:40:26.208 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:26.208 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T06:40:26.208 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:40:26.209 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T06:40:26.209 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T06:40:26.705 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T06:40:26.705 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:26.706 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:26.706 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:26.706 INFO:teuthology.orchestra.run.smithi085.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T06:40:26.706 INFO:teuthology.orchestra.run.smithi085.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T06:40:26.706 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:26.707 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:26.809 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-rook 2023-01-25T06:40:27.538 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:43 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:27.765 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-25T06:40:28.696 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:28.697 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T06:40:28.698 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:28.698 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T06:40:28.698 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:28.698 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T06:40:28.698 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:40:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T06:40:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T06:40:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T06:40:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T06:40:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T06:40:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T06:40:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T06:40:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T06:40:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T06:40:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T06:40:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T06:40:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T06:40:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:28.702 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:28.703 INFO:teuthology.orchestra.run.smithi085.stdout:======================================================================================== 2023-01-25T06:40:28.703 INFO:teuthology.orchestra.run.smithi085.stdout:Install 13 Packages 2023-01-25T06:40:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:28.704 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 1.9 M 2023-01-25T06:40:28.704 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 25 M 2023-01-25T06:40:28.704 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:28.761 INFO:teuthology.orchestra.run.smithi085.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 448 kB/s | 27 kB 00:00 2023-01-25T06:40:28.786 INFO:teuthology.orchestra.run.smithi085.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.1 MB/s | 126 kB 00:00 2023-01-25T06:40:28.811 INFO:teuthology.orchestra.run.smithi085.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 182 kB/s | 20 kB 00:00 2023-01-25T06:40:28.836 INFO:teuthology.orchestra.run.smithi085.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.2 MB/s | 110 kB 00:00 2023-01-25T06:40:28.862 INFO:teuthology.orchestra.run.smithi085.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.7 MB/s | 43 kB 00:00 2023-01-25T06:40:28.887 INFO:teuthology.orchestra.run.smithi085.stdout:(6/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 255 kB/s | 47 kB 00:00 2023-01-25T06:40:28.920 INFO:teuthology.orchestra.run.smithi085.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.4 MB/s | 155 kB 00:00 2023-01-25T06:40:29.007 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-25T06:40:29.013 INFO:teuthology.orchestra.run.smithi085.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 219 kB/s | 33 kB 00:00 2023-01-25T06:40:29.038 INFO:teuthology.orchestra.run.smithi085.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 108 kB/s | 16 kB 00:00 2023-01-25T06:40:29.080 INFO:teuthology.orchestra.run.smithi085.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 511 kB/s | 81 kB 00:00 2023-01-25T06:40:29.130 INFO:teuthology.orchestra.run.smithi085.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 668 kB/s | 61 kB 00:00 2023-01-25T06:40:29.155 INFO:teuthology.orchestra.run.smithi085.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 814 kB/s | 61 kB 00:00 2023-01-25T06:40:29.221 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:40:29.272 INFO:teuthology.orchestra.run.smithi085.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.5 MB/s | 1.2 MB 00:00 2023-01-25T06:40:29.274 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:29.274 INFO:teuthology.orchestra.run.smithi085.stdout:Total 3.4 MB/s | 1.9 MB 00:00 2023-01-25T06:40:29.325 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:29.340 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:29.341 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:29.437 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:29.441 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:29.554 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 8/8 2023-01-25T06:40:29.554 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d7 1/8 2023-01-25T06:40:29.554 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-25T06:40:29.555 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-25T06:40:29.555 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-25T06:40:29.555 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-25T06:40:29.555 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-25T06:40:29.555 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-8.5.0-18.el8.x86_64 7/8 2023-01-25T06:40:29.933 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:30.070 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-8.5.0-18.el8.x86_64 8/8 2023-01-25T06:40:30.070 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:30.070 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:30.070 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:30.071 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-8.5.0-18.el8.x86_64 2023-01-25T06:40:30.071 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-8.5.0-18.el8.x86_64 2023-01-25T06:40:30.071 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-25T06:40:30.071 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-25T06:40:30.071 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-25T06:40:30.072 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-25T06:40:30.072 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-25T06:40:30.072 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:30.072 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:30.171 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-rook 2023-01-25T06:40:30.214 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T06:40:30.412 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T06:40:30.697 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T06:40:30.902 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:46 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:30.918 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T06:40:31.092 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T06:40:31.348 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T06:40:31.623 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T06:40:31.840 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T06:40:32.041 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:32.042 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2023-01-25T06:40:32.043 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:32.043 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2023-01-25T06:40:32.043 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:32.043 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 47 k 2023-01-25T06:40:32.043 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:40:32.044 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-25T06:40:32.044 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-25T06:40:32.044 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-25T06:40:32.044 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-25T06:40:32.045 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-25T06:40:32.045 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-25T06:40:32.045 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-25T06:40:32.045 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-25T06:40:32.045 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:32.046 INFO:teuthology.orchestra.run.smithi173.stdout:======================================================================================== 2023-01-25T06:40:32.047 INFO:teuthology.orchestra.run.smithi173.stdout:Install 13 Packages 2023-01-25T06:40:32.047 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:32.048 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 1.9 M 2023-01-25T06:40:32.048 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 25 M 2023-01-25T06:40:32.048 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:32.116 INFO:teuthology.orchestra.run.smithi173.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 384 kB/s | 27 kB 00:00 2023-01-25T06:40:32.141 INFO:teuthology.orchestra.run.smithi173.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.0 MB/s | 126 kB 00:00 2023-01-25T06:40:32.166 INFO:teuthology.orchestra.run.smithi173.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 167 kB/s | 20 kB 00:00 2023-01-25T06:40:32.191 INFO:teuthology.orchestra.run.smithi173.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-25T06:40:32.217 INFO:teuthology.orchestra.run.smithi173.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 1.7 MB/s | 43 kB 00:00 2023-01-25T06:40:32.242 INFO:teuthology.orchestra.run.smithi173.stdout:(6/13): ceph-mgr-rook-18.0.0-1963.g61996d73.el8 241 kB/s | 47 kB 00:00 2023-01-25T06:40:32.268 INFO:teuthology.orchestra.run.smithi173.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.5 MB/s | 155 kB 00:00 2023-01-25T06:40:32.368 INFO:teuthology.orchestra.run.smithi173.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 130 kB/s | 16 kB 00:00 2023-01-25T06:40:32.394 INFO:teuthology.orchestra.run.smithi173.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 187 kB/s | 33 kB 00:00 2023-01-25T06:40:32.449 INFO:teuthology.orchestra.run.smithi173.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 448 kB/s | 81 kB 00:00 2023-01-25T06:40:32.486 INFO:teuthology.orchestra.run.smithi173.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 667 kB/s | 61 kB 00:00 2023-01-25T06:40:32.511 INFO:teuthology.orchestra.run.smithi173.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 993 kB/s | 61 kB 00:00 2023-01-25T06:40:32.653 INFO:teuthology.orchestra.run.smithi173.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.1 MB/s | 1.2 MB 00:00 2023-01-25T06:40:32.655 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:32.655 INFO:teuthology.orchestra.run.smithi173.stdout:Total 3.2 MB/s | 1.9 MB 00:00 2023-01-25T06:40:32.709 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:32.724 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:32.724 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:32.822 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:32.826 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:32.939 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T06:40:33.218 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T06:40:33.322 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:33.598 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-25T06:40:33.605 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T06:40:33.791 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-25T06:40:33.997 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-25T06:40:34.021 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T06:40:34.210 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-25T06:40:34.219 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:40:34.385 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-25T06:40:34.537 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:40:34.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T06:40:34.537 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T06:40:34.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T06:40:34.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T06:40:34.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T06:40:34.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T06:40:34.538 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T06:40:34.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T06:40:34.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T06:40:34.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T06:40:34.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T06:40:34.539 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T06:40:34.624 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-25T06:40:34.916 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-25T06:40:35.100 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T06:40:35.101 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:35.101 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:35.101 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:35.101 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T06:40:35.101 INFO:teuthology.orchestra.run.smithi085.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T06:40:35.102 INFO:teuthology.orchestra.run.smithi085.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T06:40:35.102 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T06:40:35.102 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T06:40:35.102 INFO:teuthology.orchestra.run.smithi085.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T06:40:35.102 INFO:teuthology.orchestra.run.smithi085.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T06:40:35.103 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T06:40:35.103 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T06:40:35.103 INFO:teuthology.orchestra.run.smithi085.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T06:40:35.103 INFO:teuthology.orchestra.run.smithi085.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T06:40:35.104 INFO:teuthology.orchestra.run.smithi085.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T06:40:35.104 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:35.104 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:35.192 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-25T06:40:35.210 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T06:40:35.940 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:51 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:36.245 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-25T06:40:36.510 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-25T06:40:36.727 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-25T06:40:36.904 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-25T06:40:37.087 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:37.088 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:37.088 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:37.089 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:37.089 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:37.089 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T06:40:37.089 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:40:37.089 INFO:teuthology.orchestra.run.smithi085.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T06:40:37.090 INFO:teuthology.orchestra.run.smithi085.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T06:40:37.090 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T06:40:37.090 INFO:teuthology.orchestra.run.smithi085.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T06:40:37.090 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:37.090 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:37.091 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:37.091 INFO:teuthology.orchestra.run.smithi085.stdout:Install 5 Packages 2023-01-25T06:40:37.091 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:37.092 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 6.0 M 2023-01-25T06:40:37.092 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 26 M 2023-01-25T06:40:37.092 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:37.188 INFO:teuthology.orchestra.run.smithi085.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.5 MB/s | 538 kB 00:00 2023-01-25T06:40:37.287 INFO:teuthology.orchestra.run.smithi085.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-01-25T06:40:37.313 INFO:teuthology.orchestra.run.smithi085.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 542 kB/s | 120 kB 00:00 2023-01-25T06:40:37.446 INFO:teuthology.orchestra.run.smithi085.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 380 kB/s | 60 kB 00:00 2023-01-25T06:40:37.498 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:40:37.513 INFO:teuthology.orchestra.run.smithi085.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.4 MB/s | 476 kB 00:00 2023-01-25T06:40:37.515 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:37.515 INFO:teuthology.orchestra.run.smithi085.stdout:Total 14 MB/s | 6.0 MB 00:00 2023-01-25T06:40:37.566 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:37.577 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:37.578 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:37.704 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:37.708 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:37.808 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 13/13 2023-01-25T06:40:37.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 1/13 2023-01-25T06:40:37.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-25T06:40:37.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-25T06:40:37.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-25T06:40:37.809 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-25T06:40:37.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-25T06:40:37.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-25T06:40:37.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-25T06:40:37.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-25T06:40:37.810 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-25T06:40:37.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-25T06:40:37.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-25T06:40:37.985 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:38.323 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T06:40:38.359 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-25T06:40:38.360 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:38.360 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:38.360 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:38.360 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-25T06:40:38.361 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-25T06:40:38.361 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-25T06:40:38.361 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-25T06:40:38.362 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-25T06:40:38.362 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-25T06:40:38.362 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-25T06:40:38.362 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-25T06:40:38.363 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-25T06:40:38.363 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-25T06:40:38.363 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-25T06:40:38.363 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-25T06:40:38.364 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:38.364 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:38.478 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-mgr-cephadm 2023-01-25T06:40:39.204 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:55 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:39.252 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T06:40:39.671 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T06:40:39.930 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T06:40:40.119 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:40:40.335 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:40.336 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:40.336 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:40.337 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:40.337 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:40.337 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 120 k 2023-01-25T06:40:40.337 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:40:40.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-01-25T06:40:40.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-25T06:40:40.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-25T06:40:40.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-01-25T06:40:40.338 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:40.338 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:40.339 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:40.339 INFO:teuthology.orchestra.run.smithi173.stdout:Install 5 Packages 2023-01-25T06:40:40.339 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:40.340 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 6.0 M 2023-01-25T06:40:40.340 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 26 M 2023-01-25T06:40:40.340 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:40.413 INFO:teuthology.orchestra.run.smithi173.stdout:(1/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 7.1 MB/s | 538 kB 00:00 2023-01-25T06:40:40.433 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:40:40.434 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T06:40:40.434 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T06:40:40.434 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T06:40:40.434 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T06:40:40.538 INFO:teuthology.orchestra.run.smithi173.stdout:(2/5): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-01-25T06:40:40.588 INFO:teuthology.orchestra.run.smithi173.stdout:(3/5): ceph-mgr-cephadm-18.0.0-1963.g61996d73.e 481 kB/s | 120 kB 00:00 2023-01-25T06:40:40.680 INFO:teuthology.orchestra.run.smithi173.stdout:(4/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.7 MB/s | 476 kB 00:00 2023-01-25T06:40:40.714 INFO:teuthology.orchestra.run.smithi173.stdout:(5/5): python3-natsort-7.1.1-2.el8.noarch.rpm 343 kB/s | 60 kB 00:00 2023-01-25T06:40:40.715 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:40.716 INFO:teuthology.orchestra.run.smithi173.stdout:Total 16 MB/s | 6.0 MB 00:00 2023-01-25T06:40:40.766 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:40.777 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:40.777 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:40.918 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:40.922 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:40.924 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T06:40:40.924 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:40.924 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:40.924 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:40.925 INFO:teuthology.orchestra.run.smithi085.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T06:40:40.925 INFO:teuthology.orchestra.run.smithi085.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T06:40:40.925 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T06:40:40.925 INFO:teuthology.orchestra.run.smithi085.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T06:40:40.925 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:40.926 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:41.025 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-fuse 2023-01-25T06:40:41.196 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:41.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 1/5 2023-01-25T06:40:41.750 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:01:57 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:42.467 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-01-25T06:40:42.898 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 3/5 2023-01-25T06:40:42.905 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:42.906 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:42.906 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:42.906 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:42.906 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:42.907 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T06:40:42.907 INFO:teuthology.orchestra.run.smithi085.stdout:Installing dependencies: 2023-01-25T06:40:42.907 INFO:teuthology.orchestra.run.smithi085.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T06:40:42.907 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:42.907 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:42.908 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:42.908 INFO:teuthology.orchestra.run.smithi085.stdout:Install 2 Packages 2023-01-25T06:40:42.908 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:42.909 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 928 k 2023-01-25T06:40:42.909 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 2.9 M 2023-01-25T06:40:42.909 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:42.970 INFO:teuthology.orchestra.run.smithi085.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.3 MB/s | 83 kB 00:00 2023-01-25T06:40:43.172 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-01-25T06:40:43.187 INFO:teuthology.orchestra.run.smithi085.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 3.0 MB/s | 845 kB 00:00 2023-01-25T06:40:43.188 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:43.189 INFO:teuthology.orchestra.run.smithi085.stdout:Total 3.2 MB/s | 928 kB 00:00 2023-01-25T06:40:43.198 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:43.220 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:43.220 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:43.312 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:43.316 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:43.394 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:40:43.530 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:43.684 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 5/5 2023-01-25T06:40:43.684 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 1/5 2023-01-25T06:40:43.684 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/5 2023-01-25T06:40:43.685 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/5 2023-01-25T06:40:43.685 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-01-25T06:40:43.784 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T06:40:43.986 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:40:44.189 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 5/5 2023-01-25T06:40:44.189 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:44.189 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:44.189 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:44.189 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-01-25T06:40:44.190 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-25T06:40:44.190 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-25T06:40:44.190 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-01-25T06:40:44.190 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:44.190 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:44.294 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-fuse 2023-01-25T06:40:44.377 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:40:44.377 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T06:40:44.891 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T06:40:44.892 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:44.892 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:44.892 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T06:40:44.892 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:44.892 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:45.022 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:01 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:45.093 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install ceph-volume 2023-01-25T06:40:45.827 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:01 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:46.160 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:46.160 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:46.161 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:46.161 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:46.161 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:46.161 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 845 k 2023-01-25T06:40:46.161 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-01-25T06:40:46.162 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-25T06:40:46.162 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:46.162 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:46.162 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:46.163 INFO:teuthology.orchestra.run.smithi173.stdout:Install 2 Packages 2023-01-25T06:40:46.163 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:46.164 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 928 k 2023-01-25T06:40:46.164 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 2.9 M 2023-01-25T06:40:46.164 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:46.222 INFO:teuthology.orchestra.run.smithi173.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2023-01-25T06:40:46.652 INFO:teuthology.orchestra.run.smithi173.stdout:(2/2): ceph-fuse-18.0.0-1963.g61996d73.el8.x86_ 1.7 MB/s | 845 kB 00:00 2023-01-25T06:40:46.653 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:46.654 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.8 MB/s | 928 kB 00:00 2023-01-25T06:40:46.664 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:46.685 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:46.686 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:46.778 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:46.782 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:46.968 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:46.969 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:46.969 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repository Size 2023-01-25T06:40:46.970 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:46.970 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:46.970 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T06:40:46.970 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:46.971 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:46.971 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:46.971 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:40:46.972 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:46.972 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 263 k 2023-01-25T06:40:46.972 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 1.3 M 2023-01-25T06:40:46.973 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:46.973 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:47.207 INFO:teuthology.orchestra.run.smithi085.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 1.1 MB/s | 263 kB 00:00 2023-01-25T06:40:47.208 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:47.208 INFO:teuthology.orchestra.run.smithi085.stdout:Total 1.1 MB/s | 263 kB 00:00 2023-01-25T06:40:47.208 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:47.218 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-25T06:40:47.218 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:47.218 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:47.315 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:47.319 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:47.406 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:40:47.506 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:47.743 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:47.799 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2/2 2023-01-25T06:40:47.800 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/2 2023-01-25T06:40:48.190 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:48.441 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-25T06:40:48.441 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:48.441 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:48.441 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-25T06:40:48.442 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:48.442 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:48.635 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-volume 2023-01-25T06:40:48.683 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:48.683 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:48.684 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:48.684 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:48.685 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:48.685 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:48.850 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librados-devel 2023-01-25T06:40:49.373 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:05 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:49.577 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:05 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:50.514 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:50.515 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:50.515 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-01-25T06:40:50.516 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:50.516 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:50.516 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:18.0.0-1963.g61996d73.el8 ceph-noarch 263 k 2023-01-25T06:40:50.516 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:50.517 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:50.517 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:50.517 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:40:50.518 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:50.518 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 263 k 2023-01-25T06:40:50.518 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 1.3 M 2023-01-25T06:40:50.518 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:50.722 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:50.722 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:50.723 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T06:40:50.723 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:50.723 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:50.723 INFO:teuthology.orchestra.run.smithi085.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T06:40:50.723 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:50.724 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:50.724 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:50.724 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:40:50.724 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:50.725 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 139 k 2023-01-25T06:40:50.725 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 512 k 2023-01-25T06:40:50.726 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:50.728 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-volume-18.0.0-1963.g61996d73.el8.noarch.rp 1.2 MB/s | 263 kB 00:00 2023-01-25T06:40:50.729 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:50.729 INFO:teuthology.orchestra.run.smithi173.stdout:Total 1.2 MB/s | 263 kB 00:00 2023-01-25T06:40:50.729 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:50.739 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:50.739 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:50.830 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:50.833 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:50.919 INFO:teuthology.orchestra.run.smithi085.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 713 kB/s | 139 kB 00:00 2023-01-25T06:40:50.920 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:50.921 INFO:teuthology.orchestra.run.smithi085.stdout:Total 708 kB/s | 139 kB 00:00 2023-01-25T06:40:50.921 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:50.925 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:50.926 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:50.979 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:50.982 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:51.039 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:51.089 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:51.264 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:51.293 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:51.562 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:51.735 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:52.067 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:52.067 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:52.068 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:52.068 INFO:teuthology.orchestra.run.smithi085.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:40:52.068 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:52.068 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:52.237 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 1/1 2023-01-25T06:40:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:52.238 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:18.0.0-1963.g61996d73.el8.noarch 2023-01-25T06:40:52.238 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:52.239 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:52.288 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install libcephfs2 2023-01-25T06:40:52.426 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados-devel 2023-01-25T06:40:53.016 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:09 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:53.160 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:09 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:54.056 INFO:teuthology.orchestra.run.smithi085.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:54.155 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:54.156 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:40:54.156 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:54.239 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install libcephfs-devel 2023-01-25T06:40:54.303 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:54.304 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:54.304 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2023-01-25T06:40:54.305 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:54.305 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:40:54.305 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 139 k 2023-01-25T06:40:54.305 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:54.305 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:40:54.306 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:40:54.306 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:40:54.306 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:54.306 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 139 k 2023-01-25T06:40:54.306 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 512 k 2023-01-25T06:40:54.307 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:40:54.851 INFO:teuthology.orchestra.run.smithi173.stdout:librados-devel-18.0.0-1963.g61996d73.el8.x86_64 254 kB/s | 139 kB 00:00 2023-01-25T06:40:54.852 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:54.852 INFO:teuthology.orchestra.run.smithi173.stdout:Total 254 kB/s | 139 kB 00:00 2023-01-25T06:40:54.852 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:40:54.857 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:40:54.857 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:40:54.909 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:40:54.913 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:40:54.968 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:10 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:55.056 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:40:55.231 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:55.543 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:56.027 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:56.028 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:56.028 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:40:56.028 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:40:56.028 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:40:56.029 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:56.100 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:56.101 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:56.101 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T06:40:56.101 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:56.102 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:40:56.102 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T06:40:56.102 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:56.102 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:40:56.103 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:40:56.103 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:40:56.103 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:56.104 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 30 k 2023-01-25T06:40:56.104 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 137 k 2023-01-25T06:40:56.104 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:40:56.226 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs2 2023-01-25T06:40:56.900 INFO:teuthology.orchestra.run.smithi085.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 38 kB/s | 30 kB 00:00 2023-01-25T06:40:56.901 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:40:56.901 INFO:teuthology.orchestra.run.smithi085.stdout:Total 38 kB/s | 30 kB 00:00 2023-01-25T06:40:56.902 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:40:56.906 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:40:56.906 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:40:56.939 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:40:56.943 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:40:56.956 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:12 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:57.003 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:40:57.171 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:57.431 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:57.881 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:40:57.881 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:57.881 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:40:57.882 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:40:57.882 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:40:57.882 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:57.995 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librados2 2023-01-25T06:40:57.997 INFO:teuthology.orchestra.run.smithi173.stdout:Package libcephfs2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:58.097 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:40:58.099 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:40:58.099 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:40:58.187 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install libcephfs-devel 2023-01-25T06:40:58.724 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:14 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:58.915 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:14 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:40:59.766 INFO:teuthology.orchestra.run.smithi085.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:40:59.868 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:40:59.869 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:40:59.869 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:40:59.947 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install librbd1 2023-01-25T06:41:00.065 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:00.066 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:00.066 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2023-01-25T06:41:00.066 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:00.066 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:18.0.0-1963.g61996d73.el8 ceph 30 k 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:41:00.067 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:00.068 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 30 k 2023-01-25T06:41:00.068 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 137 k 2023-01-25T06:41:00.069 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:41:00.534 INFO:teuthology.orchestra.run.smithi173.stdout:libcephfs-devel-18.0.0-1963.g61996d73.el8.x86_6 65 kB/s | 30 kB 00:00 2023-01-25T06:41:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:Total 65 kB/s | 30 kB 00:00 2023-01-25T06:41:00.535 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:41:00.538 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:41:00.539 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:41:00.561 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:41:00.564 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:41:00.630 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:41:00.689 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:16 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:00.847 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:01.130 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:01.590 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:01.590 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:01.590 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:41:01.591 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:01.591 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:01.591 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:01.714 INFO:teuthology.orchestra.run.smithi085.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:01.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librados2 2023-01-25T06:41:01.815 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:01.816 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:41:01.817 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:02.091 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rados 2023-01-25T06:41:02.446 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:02.818 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:18 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:03.475 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:03.574 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:03.575 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:03.576 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:03.661 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install librbd1 2023-01-25T06:41:03.868 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:03.970 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:03.971 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:41:03.971 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:04.059 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rgw 2023-01-25T06:41:04.390 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:04.774 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:20 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:05.430 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:05.533 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:05.534 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:05.534 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:05.627 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rados 2023-01-25T06:41:05.804 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:05.905 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:05.906 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:41:05.906 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:05.993 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-cephfs 2023-01-25T06:41:06.360 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:06.714 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:22 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:07.405 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rados-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:07.506 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:07.507 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:07.507 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:07.589 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rgw 2023-01-25T06:41:07.757 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:07.857 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:07.859 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:41:07.859 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:07.940 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install python3-rbd 2023-01-25T06:41:08.318 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:08.659 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:24 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:09.350 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rgw-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:09.450 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:09.451 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:09.451 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:09.539 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-cephfs 2023-01-25T06:41:09.690 INFO:teuthology.orchestra.run.smithi085.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:09.790 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:09.791 INFO:teuthology.orchestra.run.smithi085.stdout:Nothing to do. 2023-01-25T06:41:09.791 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:09.881 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-fuse 2023-01-25T06:41:10.263 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:10.604 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:26 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:11.314 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-cephfs-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:11.414 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:11.415 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:11.416 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:11.498 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install python3-rbd 2023-01-25T06:41:11.743 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:11.743 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:11.744 INFO:teuthology.orchestra.run.smithi085.stdout: Package Architecture Version Repository Size 2023-01-25T06:41:11.744 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:11.744 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:41:11.744 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T06:41:11.745 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:11.745 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:41:11.745 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:11.745 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:41:11.745 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:11.746 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 94 k 2023-01-25T06:41:11.746 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 280 k 2023-01-25T06:41:11.746 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:41:12.036 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 323 kB/s | 94 kB 00:00 2023-01-25T06:41:12.037 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:12.037 INFO:teuthology.orchestra.run.smithi085.stdout:Total 322 kB/s | 94 kB 00:00 2023-01-25T06:41:12.038 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:41:12.048 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:41:12.048 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:41:12.100 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:41:12.104 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:41:12.214 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:41:12.219 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:28 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:12.703 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:12.993 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:13.259 INFO:teuthology.orchestra.run.smithi173.stdout:Package python3-rbd-2:18.0.0-1963.g61996d73.el8.x86_64 is already installed. 2023-01-25T06:41:13.358 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:13.359 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-01-25T06:41:13.359 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:13.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-fuse 2023-01-25T06:41:13.500 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:13.501 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:13.502 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:41:13.502 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:13.502 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:13.502 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:13.672 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-mirror 2023-01-25T06:41:14.182 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:14.400 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:30 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:15.320 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:15.321 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:15.321 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2023-01-25T06:41:15.322 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:15.322 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:41:15.322 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:18.0.0-1963.g61996d73.el8 ceph 94 k 2023-01-25T06:41:15.322 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:15.322 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:41:15.323 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:15.323 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:41:15.323 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:15.324 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 94 k 2023-01-25T06:41:15.324 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 280 k 2023-01-25T06:41:15.324 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:41:15.535 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:15.536 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:15.536 INFO:teuthology.orchestra.run.smithi085.stdout: Package Arch Version Repo Size 2023-01-25T06:41:15.536 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:15.536 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:41:15.536 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T06:41:15.537 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:15.537 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:41:15.537 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:15.537 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:41:15.537 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:15.538 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 3.4 M 2023-01-25T06:41:15.538 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 16 M 2023-01-25T06:41:15.539 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:41:15.957 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-fuse-18.0.0-1963.g61996d73.el8.x86_64.rpm 149 kB/s | 94 kB 00:00 2023-01-25T06:41:15.958 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:15.958 INFO:teuthology.orchestra.run.smithi173.stdout:Total 148 kB/s | 94 kB 00:00 2023-01-25T06:41:15.959 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:41:15.969 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:41:15.969 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:41:16.022 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:41:16.026 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:41:16.257 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:41:16.453 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:16.743 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:16.998 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 2.4 MB/s | 3.4 MB 00:01 2023-01-25T06:41:17.000 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:17.000 INFO:teuthology.orchestra.run.smithi085.stdout:Total 2.4 MB/s | 3.4 MB 00:01 2023-01-25T06:41:17.000 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:41:17.012 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:41:17.013 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:41:17.077 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:41:17.080 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:41:17.213 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:17.214 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:17.214 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:41:17.214 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:17.215 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:17.215 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:17.401 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-mirror 2023-01-25T06:41:17.527 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:41:17.705 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:18.131 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:34 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:18.144 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:18.617 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:18.617 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:18.617 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:41:18.618 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:18.618 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:18.618 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:18.815 DEBUG:teuthology.orchestra.run.smithi085:> sudo yum -y install rbd-nbd 2023-01-25T06:41:19.275 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:19.276 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:19.276 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repo Size 2023-01-25T06:41:19.276 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:18.0.0-1963.g61996d73.el8 ceph 3.4 M 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:19.277 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:41:19.278 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:19.278 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 3.4 M 2023-01-25T06:41:19.278 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 16 M 2023-01-25T06:41:19.278 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:41:19.555 INFO:teuthology.orchestra.run.smithi085.stdout:Last metadata expiration check: 0:02:35 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:20.054 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-mirror-18.0.0-1963.g61996d73.el8.x86_64.rpm 4.4 MB/s | 3.4 MB 00:00 2023-01-25T06:41:20.055 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:20.055 INFO:teuthology.orchestra.run.smithi173.stdout:Total 4.4 MB/s | 3.4 MB 00:00 2023-01-25T06:41:20.055 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:41:20.067 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:41:20.067 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:41:20.130 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:41:20.133 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:41:20.579 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:41:20.684 INFO:teuthology.orchestra.run.smithi085.stdout:Dependencies resolved. 2023-01-25T06:41:20.685 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:20.685 INFO:teuthology.orchestra.run.smithi085.stdout: Package Architecture Version Repository Size 2023-01-25T06:41:20.686 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:20.686 INFO:teuthology.orchestra.run.smithi085.stdout:Installing: 2023-01-25T06:41:20.686 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T06:41:20.686 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:20.686 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction Summary 2023-01-25T06:41:20.687 INFO:teuthology.orchestra.run.smithi085.stdout:================================================================================ 2023-01-25T06:41:20.687 INFO:teuthology.orchestra.run.smithi085.stdout:Install 1 Package 2023-01-25T06:41:20.687 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:20.687 INFO:teuthology.orchestra.run.smithi085.stdout:Total download size: 179 k 2023-01-25T06:41:20.687 INFO:teuthology.orchestra.run.smithi085.stdout:Installed size: 568 k 2023-01-25T06:41:20.688 INFO:teuthology.orchestra.run.smithi085.stdout:Downloading Packages: 2023-01-25T06:41:20.814 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:20.900 INFO:teuthology.orchestra.run.smithi085.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 838 kB/s | 179 kB 00:00 2023-01-25T06:41:20.901 INFO:teuthology.orchestra.run.smithi085.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:20.901 INFO:teuthology.orchestra.run.smithi085.stdout:Total 833 kB/s | 179 kB 00:00 2023-01-25T06:41:20.901 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction check 2023-01-25T06:41:20.912 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction check succeeded. 2023-01-25T06:41:20.912 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction test 2023-01-25T06:41:20.963 INFO:teuthology.orchestra.run.smithi085.stdout:Transaction test succeeded. 2023-01-25T06:41:20.967 INFO:teuthology.orchestra.run.smithi085.stdout:Running transaction 2023-01-25T06:41:21.087 INFO:teuthology.orchestra.run.smithi085.stdout: Preparing : 1/1 2023-01-25T06:41:21.259 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:21.276 INFO:teuthology.orchestra.run.smithi085.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:21.616 INFO:teuthology.orchestra.run.smithi085.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:21.859 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:21.859 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:21.860 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:41:21.860 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:21.860 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:21.860 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:22.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install rbd-nbd 2023-01-25T06:41:22.095 INFO:teuthology.orchestra.run.smithi085.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:22.095 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:22.096 INFO:teuthology.orchestra.run.smithi085.stdout:Installed: 2023-01-25T06:41:22.096 INFO:teuthology.orchestra.run.smithi085.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:22.096 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:22.096 INFO:teuthology.orchestra.run.smithi085.stdout:Complete! 2023-01-25T06:41:22.282 DEBUG:teuthology.parallel:result is None 2023-01-25T06:41:22.791 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:02:38 ago on Wed 25 Jan 2023 06:38:44 AM UTC. 2023-01-25T06:41:23.928 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-01-25T06:41:23.929 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:23.929 INFO:teuthology.orchestra.run.smithi173.stdout: Package Architecture Version Repository Size 2023-01-25T06:41:23.930 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:23.930 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-01-25T06:41:23.930 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:18.0.0-1963.g61996d73.el8 ceph 179 k 2023-01-25T06:41:23.930 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:23.930 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-01-25T06:41:23.931 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2023-01-25T06:41:23.931 INFO:teuthology.orchestra.run.smithi173.stdout:Install 1 Package 2023-01-25T06:41:23.931 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:23.931 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 179 k 2023-01-25T06:41:23.931 INFO:teuthology.orchestra.run.smithi173.stdout:Installed size: 568 k 2023-01-25T06:41:23.932 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-01-25T06:41:24.134 INFO:teuthology.orchestra.run.smithi173.stdout:rbd-nbd-18.0.0-1963.g61996d73.el8.x86_64.rpm 882 kB/s | 179 kB 00:00 2023-01-25T06:41:24.134 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-01-25T06:41:24.135 INFO:teuthology.orchestra.run.smithi173.stdout:Total 876 kB/s | 179 kB 00:00 2023-01-25T06:41:24.135 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-01-25T06:41:24.146 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-01-25T06:41:24.147 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-01-25T06:41:24.198 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-01-25T06:41:24.201 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-01-25T06:41:24.331 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-01-25T06:41:24.485 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:24.777 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 1/1 2023-01-25T06:41:25.274 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:25.275 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-01-25T06:41:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:18.0.0-1963.g61996d73.el8.x86_64 2023-01-25T06:41:25.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:25.275 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-01-25T06:41:25.475 DEBUG:teuthology.parallel:result is None 2023-01-25T06:41:25.475 DEBUG:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2023-01-25T06:41:25.519 INFO:teuthology.orchestra.run.smithi085.stdout:CentOSStream 2023-01-25T06:41:25.520 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:41:25.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:41:25.667 DEBUG:teuthology.orchestra.run.smithi085:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T06:41:25.691 INFO:teuthology.orchestra.run.smithi085.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T06:41:25.692 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T06:41:25.693 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T06:41:25.693 DEBUG:teuthology.orchestra.run.smithi173:> sudo lsb_release -is 2023-01-25T06:41:25.729 INFO:teuthology.orchestra.run.smithi173.stdout:CentOSStream 2023-01-25T06:41:25.731 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-25T06:41:25.731 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=61996d73ab738798e4ee0055c86457f5c459da4a 2023-01-25T06:41:25.879 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-25T06:41:25.901 INFO:teuthology.orchestra.run.smithi173.stdout:18.0.0-1963.g61996d73.el8 2023-01-25T06:41:25.901 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-1963.g61996d73.el8 2023-01-25T06:41:25.902 INFO:teuthology.task.install:The correct ceph version 18.0.0-1963.g61996d73 is installed. 2023-01-25T06:41:25.902 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-25T06:41:25.902 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:25.903 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T06:41:25.933 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:25.934 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-25T06:41:25.968 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-25T06:41:25.969 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:25.969 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T06:41:26.003 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T06:41:26.071 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:26.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2023-01-25T06:41:26.098 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-25T06:41:26.165 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-25T06:41:26.166 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:26.166 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T06:41:26.194 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T06:41:26.262 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:26.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-25T06:41:26.290 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-25T06:41:26.357 INFO:teuthology.run_tasks:Running task ceph... 2023-01-25T06:41:26.433 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-25T06:41:26.434 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 777 /var/log/ceph 2023-01-25T06:41:26.437 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2023-01-25T06:41:26.464 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-25T06:41:26.464 DEBUG:teuthology.orchestra.run.smithi085:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T06:41:26.504 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-25T06:41:26.531 INFO:tasks.ceph:Creating extra log directories... 2023-01-25T06:41:26.532 DEBUG:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T06:41:26.572 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-25T06:41:26.611 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-25T06:41:26.612 INFO:tasks.ceph:config {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-25T06:41:26.612 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi/7136929', 'branch': 'wip-yuri2-testing-2023-01-23-0928', 'description': 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced}', 'email': 'yweinstein@radhat.com', 'first_in_suite': False, 'job_id': '7136929', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-24_22:22:09-rados-wip-yuri2-testing-2023-01-23-0928-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-01-23-0928'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2023-01-23-0928', 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri2-testing-2023-01-23-0928', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_61996d73ab738798e4ee0055c86457f5c459da4a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'targets': {'smithi085.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQYG+jkWOxYzo/cTo6u1TPYMgmVxeRUVLp59UGqJ1GeX3GNQ36ktqEgfz0Ei7G8IkYJf5dikNHs5g+9H1ZU/tO+JAj62hghS1eE9dD8ccB3jU0DeNou0B2Du3Iv1djj/U/OujF37NrRG9YEp25i7m76sy0jbsaNrvtk3sT2QKbCZ4Ho9tPLHmRWexq81KpdBlgKQB10fQJK6XVKsuSZAeW7kZcw8DzXuRzltl7AYi3R+t6SD99j6r3aYm7c5hS2A3PbHWFbOeV7vO5bHilAfO0zsy1jPDMjrmboTNCcOO0VPSVMZsby0VPcLk8+7DQ63XRmgOshBYfthvXHFaI1m5EKCeUHWQo/k5PupG+3wzO4AFroxu/THzH9Wrm1nekz/Ks2O/XnaOYhj0TwHVExeJEq2ITR6JBdT4gIYQSfJNdBfa63u5xTk/s0hVnX9jx1qB7hyqxyh4mO5Qlu+Z/3oX9cDYb26fByogJyZ8uArb6BH09c7ksgMkexDqncLHiNKU=', 'smithi173.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzgcuzWalby/PgY+gP/oNYme+4jN6FkOy6NG3K4goSpIAwtfSZmovqMG9Mn2ZjLHs4PU6wB8gU/Dh4aDrogMyhtkoflZArumqxS6BjEYiKsGBI9RJNEDsaEK26ACIK2Uy2BCeg/IQ7RD+5teQr3Z9iZVJbAfmhhbDikS85L84+EmfAesAT7J+86MM2lrPBPncQY65oOm62PJkrpjMF1ugtzWL+EfjlupF3o3UHzJRlg8AlghDSoFyD7x+ufYVmhHsWv+a4eH09F6V1NuYAgbZ7rlJ9lXRUnbb/yy8bDdtxdBpyd7jmtbXUAryOxaeNtLnWfcActdpSlSO2muFTN3JoyXgFk1lN0rm5YLMy3t94+kSyweXDnWDlq3fOs8f5PBSBYC9jpgyvrJabGIDxzL+UuH5zgGodnK2UV19j+p24CjNMX1eHs+8MAwBJ24e7XyEka0sX7iPkpZaaldHb0ZcWRwO0UE0aPB6gdxOf53eUZCAuhiU5ReEs2aT4E0VjA30='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'osd': {'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(REQUEST_STUCK\\)', 'failed to encode map', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'must scrub before tier agent can activate'], 'sha1': '61996d73ab738798e4ee0055c86457f5c459da4a', 'cluster': 'ceph'}}, {'exec': {'mon.a': ['while ! ceph balancer status ; do sleep 1 ; done', 'ceph balancer mode crush-compat', 'ceph balancer on']}}, {'exec': {'client.0': ['sudo ceph osd pool create base 4', 'sudo ceph osd pool application enable base rados', 'sudo ceph osd pool create cache 4', 'sudo ceph osd tier add base cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay base cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 3600', 'sudo ceph osd pool set cache target_max_objects 250', 'sudo ceph osd pool set cache min_read_recency_for_promote 2']}}, {'rados': {'balance_reads': True, 'clients': ['client.0'], 'objects': 500, 'op_weights': {'cache_evict': 50, 'cache_flush': 50, 'cache_try_flush': 50, 'copy_from': 50, 'delete': 50, 'read': 100, 'rollback': 50, 'snap_create': 50, 'snap_remove': 50, 'write': 100}, 'ops': 4000, 'pools': ['base']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8e1bba12e584b7ae912e92e94afe9c075ab51fa3', 'timestamp': '2023-01-24_22:22:09', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.17735'} 2023-01-25T06:41:26.613 DEBUG:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T06:41:26.641 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-25T06:41:26.659 DEBUG:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T06:41:26.701 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2023-01-25T06:41:26.729 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:26.730 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T06:41:26.785 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T06:41:26.786 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_1 2023-01-25T06:41:26.844 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T06:41:26.844 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:26.844 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 371132 Links: 1 2023-01-25T06:41:26.844 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:26.845 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:26.845 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 06:41:17.883815356 +0000 2023-01-25T06:41:26.845 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 06:37:55.634132682 +0000 2023-01-25T06:41:26.845 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 06:37:55.634132682 +0000 2023-01-25T06:41:26.845 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T06:41:26.846 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T06:41:26.910 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T06:41:26.910 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T06:41:26.910 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000216038 s, 2.4 MB/s 2023-01-25T06:41:26.911 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T06:41:26.971 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_2 2023-01-25T06:41:27.029 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T06:41:27.029 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.029 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 361448 Links: 1 2023-01-25T06:41:27.030 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.030 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.030 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 06:41:17.883815356 +0000 2023-01-25T06:41:27.030 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 06:37:56.134124117 +0000 2023-01-25T06:41:27.030 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 06:37:56.134124117 +0000 2023-01-25T06:41:27.031 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T06:41:27.031 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T06:41:27.096 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T06:41:27.097 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T06:41:27.097 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000215491 s, 2.4 MB/s 2023-01-25T06:41:27.098 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T06:41:27.155 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_3 2023-01-25T06:41:27.214 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T06:41:27.214 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.214 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 372618 Links: 1 2023-01-25T06:41:27.214 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.215 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.215 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 06:41:17.883815356 +0000 2023-01-25T06:41:27.215 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 06:37:56.626115689 +0000 2023-01-25T06:41:27.216 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 06:37:56.626115689 +0000 2023-01-25T06:41:27.216 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T06:41:27.216 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T06:41:27.280 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T06:41:27.280 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T06:41:27.280 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.00021154 s, 2.4 MB/s 2023-01-25T06:41:27.281 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T06:41:27.341 DEBUG:teuthology.orchestra.run.smithi085:> stat /dev/vg_nvme/lv_4 2023-01-25T06:41:27.399 INFO:teuthology.orchestra.run.smithi085.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T06:41:27.399 INFO:teuthology.orchestra.run.smithi085.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.399 INFO:teuthology.orchestra.run.smithi085.stdout:Device: 6h/6d Inode: 376059 Links: 1 2023-01-25T06:41:27.400 INFO:teuthology.orchestra.run.smithi085.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.400 INFO:teuthology.orchestra.run.smithi085.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.400 INFO:teuthology.orchestra.run.smithi085.stdout:Access: 2023-01-25 06:41:17.883815356 +0000 2023-01-25T06:41:27.400 INFO:teuthology.orchestra.run.smithi085.stdout:Modify: 2023-01-25 06:37:57.128107090 +0000 2023-01-25T06:41:27.401 INFO:teuthology.orchestra.run.smithi085.stdout:Change: 2023-01-25 06:37:57.128107090 +0000 2023-01-25T06:41:27.401 INFO:teuthology.orchestra.run.smithi085.stdout: Birth: - 2023-01-25T06:41:27.401 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T06:41:27.464 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records in 2023-01-25T06:41:27.465 INFO:teuthology.orchestra.run.smithi085.stderr:1+0 records out 2023-01-25T06:41:27.465 INFO:teuthology.orchestra.run.smithi085.stderr:512 bytes copied, 0.000179462 s, 2.9 MB/s 2023-01-25T06:41:27.466 DEBUG:teuthology.orchestra.run.smithi085:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T06:41:27.525 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:27.525 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:27.525 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2023-01-25T06:41:27.544 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-25T06:41:27.545 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2023-01-25T06:41:27.603 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-25T06:41:27.603 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.604 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 366235 Links: 1 2023-01-25T06:41:27.604 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.604 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.604 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-01-25 06:41:20.993287066 +0000 2023-01-25T06:41:27.604 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-01-25 06:37:55.651327834 +0000 2023-01-25T06:41:27.605 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-01-25 06:37:55.651327834 +0000 2023-01-25T06:41:27.605 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-01-25T06:41:27.605 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-25T06:41:27.670 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-01-25T06:41:27.671 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-01-25T06:41:27.671 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000235528 s, 2.2 MB/s 2023-01-25T06:41:27.672 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-25T06:41:27.731 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2023-01-25T06:41:27.790 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-25T06:41:27.790 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.790 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 370184 Links: 1 2023-01-25T06:41:27.790 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.791 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.791 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-01-25 06:41:20.993287066 +0000 2023-01-25T06:41:27.791 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-01-25 06:37:56.156317104 +0000 2023-01-25T06:41:27.791 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-01-25 06:37:56.156317104 +0000 2023-01-25T06:41:27.791 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-01-25T06:41:27.792 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-25T06:41:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-01-25T06:41:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-01-25T06:41:27.856 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000222017 s, 2.3 MB/s 2023-01-25T06:41:27.857 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-25T06:41:27.917 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2023-01-25T06:41:27.975 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-25T06:41:27.975 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 375069 Links: 1 2023-01-25T06:41:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-01-25 06:41:20.993287066 +0000 2023-01-25T06:41:27.976 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-01-25 06:37:56.655306501 +0000 2023-01-25T06:41:27.977 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-01-25 06:37:56.655306501 +0000 2023-01-25T06:41:27.977 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-01-25T06:41:27.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-25T06:41:28.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-01-25T06:41:28.040 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-01-25T06:41:28.041 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000248741 s, 2.1 MB/s 2023-01-25T06:41:28.042 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-25T06:41:28.100 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2023-01-25T06:41:28.158 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-25T06:41:28.159 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-25T06:41:28.159 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 370335 Links: 1 2023-01-25T06:41:28.159 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-25T06:41:28.159 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-01-25T06:41:28.160 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-01-25 06:41:20.993287066 +0000 2023-01-25T06:41:28.160 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-01-25 06:37:57.154295899 +0000 2023-01-25T06:41:28.160 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-01-25 06:37:57.154295899 +0000 2023-01-25T06:41:28.160 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-01-25T06:41:28.161 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-25T06:41:28.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-01-25T06:41:28.226 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-01-25T06:41:28.226 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.00018621 s, 2.7 MB/s 2023-01-25T06:41:28.227 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-25T06:41:28.286 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:28.287 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi085.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T06:41:28.287 INFO:tasks.ceph:Generating config... 2023-01-25T06:41:28.288 INFO:tasks.ceph:[osd] debug monc = 20 2023-01-25T06:41:28.289 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-25T06:41:28.289 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2023-01-25T06:41:28.289 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-01-25T06:41:28.290 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-25T06:41:28.290 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-01-25T06:41:28.290 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-01-25T06:41:28.290 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-01-25T06:41:28.291 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-25T06:41:28.291 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-25T06:41:28.291 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-01-25T06:41:28.292 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-25T06:41:28.292 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-25T06:41:28.292 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-25T06:41:28.293 INFO:tasks.ceph:[osd] osd backoff on peering = True 2023-01-25T06:41:28.293 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-01-25T06:41:28.293 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-01-25T06:41:28.294 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-01-25T06:41:28.294 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-25T06:41:28.294 INFO:tasks.ceph:[osd] osd heartbeat use min delay socket = True 2023-01-25T06:41:28.294 INFO:tasks.ceph:[osd] osd inject bad map crc probability = 0.1 2023-01-25T06:41:28.295 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-25T06:41:28.295 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-01-25T06:41:28.295 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-25T06:41:28.295 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-01-25T06:41:28.296 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-01-25T06:41:28.296 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-25T06:41:28.296 INFO:tasks.ceph:[osd] osd_max_pg_log_entries = 3000 2023-01-25T06:41:28.297 INFO:tasks.ceph:[osd] osd_min_pg_log_entries = 3000 2023-01-25T06:41:28.297 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-25T06:41:28.297 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-01-25T06:41:28.297 INFO:tasks.ceph:[global] ms bind msgr1 = False 2023-01-25T06:41:28.298 INFO:tasks.ceph:[global] ms bind msgr2 = True 2023-01-25T06:41:28.298 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-01-25T06:41:28.298 INFO:tasks.ceph:[global] ms type = async 2023-01-25T06:41:28.299 INFO:tasks.ceph:[global] osd_object_clean_region_max_num_intervals = 1000 2023-01-25T06:41:28.299 INFO:tasks.ceph:[global] osd_pool_default_min_size = 2 2023-01-25T06:41:28.299 INFO:tasks.ceph:[global] osd_pool_default_size = 2 2023-01-25T06:41:28.299 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-25T06:41:28.300 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-25T06:41:28.300 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-25T06:41:28.300 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-25T06:41:28.300 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-25T06:41:28.301 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-01-25T06:41:28.301 INFO:tasks.ceph:Setting up mon.a... 2023-01-25T06:41:28.301 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-25T06:41:28.354 INFO:teuthology.orchestra.run.smithi085.stdout:creating /etc/ceph/ceph.keyring 2023-01-25T06:41:28.357 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-25T06:41:28.404 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:41:28.430 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.85'), ('mon.c', '[v2:172.21.15.85:3301,v1:172.21.15.85:6790]'), ('mon.b', '172.21.15.173')] 2023-01-25T06:41:28.431 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.173', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd_object_clean_region_max_num_intervals': 1000, 'osd_pool_default_min_size': 2, 'osd_pool_default_size': 2}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd backoff on peering': True, 'osd blocked scrub grace period': 3600, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd heartbeat use min delay socket': True, 'osd inject bad map crc probability': 0.1, 'osd max markdown count': 1000, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_max_pg_log_entries': 3000, 'osd_min_pg_log_entries': 3000}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-25T06:41:28.432 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:28.433 DEBUG:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T06:41:28.489 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.85 --addv c '[v2:172.21.15.85:3301,v1:172.21.15.85:6790]' --add b 172.21.15.173 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:28.579 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:28.579 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: generated fsid 1518175e-b72c-46a1-999a-d7e56798bccb 2023-01-25T06:41:28.579 INFO:teuthology.orchestra.run.smithi085.stdout:setting min_mon_release = pacific 2023-01-25T06:41:28.579 INFO:teuthology.orchestra.run.smithi085.stdout:epoch 0 2023-01-25T06:41:28.580 INFO:teuthology.orchestra.run.smithi085.stdout:fsid 1518175e-b72c-46a1-999a-d7e56798bccb 2023-01-25T06:41:28.580 INFO:teuthology.orchestra.run.smithi085.stdout:last_changed 2023-01-25T06:41:28.579137+0000 2023-01-25T06:41:28.580 INFO:teuthology.orchestra.run.smithi085.stdout:created 2023-01-25T06:41:28.579137+0000 2023-01-25T06:41:28.580 INFO:teuthology.orchestra.run.smithi085.stdout:min_mon_release 16 (pacific) 2023-01-25T06:41:28.580 INFO:teuthology.orchestra.run.smithi085.stdout:election_strategy: 1 2023-01-25T06:41:28.581 INFO:teuthology.orchestra.run.smithi085.stdout:0: [v2:172.21.15.85:3300/0,v1:172.21.15.85:6789/0] mon.a 2023-01-25T06:41:28.581 INFO:teuthology.orchestra.run.smithi085.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2023-01-25T06:41:28.581 INFO:teuthology.orchestra.run.smithi085.stdout:2: [v2:172.21.15.85:3301/0,v1:172.21.15.85:6790/0] mon.c 2023-01-25T06:41:28.581 INFO:teuthology.orchestra.run.smithi085.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-25T06:41:28.583 DEBUG:teuthology.orchestra.run.smithi085:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-25T06:41:28.600 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1518175e-b72c-46a1-999a-d7e56798bccb... 2023-01-25T06:41:28.601 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T06:41:28.643 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-25T06:41:28.686 INFO:teuthology.orchestra.run.smithi085.stdout:[global] 2023-01-25T06:41:28.687 INFO:teuthology.orchestra.run.smithi085.stdout: chdir = "" 2023-01-25T06:41:28.687 INFO:teuthology.orchestra.run.smithi085.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T06:41:28.687 INFO:teuthology.orchestra.run.smithi085.stdout: auth supported = cephx 2023-01-25T06:41:28.687 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.687 INFO:teuthology.orchestra.run.smithi085.stdout: filestore xattr use omap = true 2023-01-25T06:41:28.688 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.688 INFO:teuthology.orchestra.run.smithi085.stdout: mon clock drift allowed = 1.000 2023-01-25T06:41:28.688 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: osd crush chooseleaf type = 0 2023-01-25T06:41:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: auth debug = true 2023-01-25T06:41:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on old message = true 2023-01-25T06:41:28.689 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on bug = true 2023-01-25T06:41:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T06:41:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: mon pg warn max object skew = 0 2023-01-25T06:41:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.690 INFO:teuthology.orchestra.run.smithi085.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default size = 2 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow primary affinity = true 2023-01-25T06:41:28.691 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow pg remap = true 2023-01-25T06:41:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on legacy crush tunables = false 2023-01-25T06:41:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on crush straw calc version zero = false 2023-01-25T06:41:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on no sortbitwise = false 2023-01-25T06:41:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on osd down out interval zero = false 2023-01-25T06:41:28.692 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on too few osds = false 2023-01-25T06:41:28.693 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T06:41:28.693 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T06:41:28.693 INFO:teuthology.orchestra.run.smithi085.stdout: mon_allow_pool_size_one = true 2023-01-25T06:41:28.693 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.693 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T06:41:28.694 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.694 INFO:teuthology.orchestra.run.smithi085.stdout: osd default data pool replay window = 5 2023-01-25T06:41:28.694 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.694 INFO:teuthology.orchestra.run.smithi085.stdout: mon allow pool delete = true 2023-01-25T06:41:28.694 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.695 INFO:teuthology.orchestra.run.smithi085.stdout: mon cluster log file level = debug 2023-01-25T06:41:28.695 INFO:teuthology.orchestra.run.smithi085.stdout: debug asserts on shutdown = true 2023-01-25T06:41:28.695 INFO:teuthology.orchestra.run.smithi085.stdout: mon health detail to clog = false 2023-01-25T06:41:28.695 INFO:teuthology.orchestra.run.smithi085.stdout: mon host = "172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.173" 2023-01-25T06:41:28.696 INFO:teuthology.orchestra.run.smithi085.stdout: mon client directed command retry = 5 2023-01-25T06:41:28.697 INFO:teuthology.orchestra.run.smithi085.stdout: mon election default strategy = 1 2023-01-25T06:41:28.697 INFO:teuthology.orchestra.run.smithi085.stdout: ms bind msgr1 = False 2023-01-25T06:41:28.697 INFO:teuthology.orchestra.run.smithi085.stdout: ms bind msgr2 = True 2023-01-25T06:41:28.697 INFO:teuthology.orchestra.run.smithi085.stdout: ms inject socket failures = 5000 2023-01-25T06:41:28.698 INFO:teuthology.orchestra.run.smithi085.stdout: ms type = async 2023-01-25T06:41:28.698 INFO:teuthology.orchestra.run.smithi085.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T06:41:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_min_size = 2 2023-01-25T06:41:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_size = 2 2023-01-25T06:41:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: fsid = 1518175e-b72c-46a1-999a-d7e56798bccb 2023-01-25T06:41:28.699 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.700 INFO:teuthology.orchestra.run.smithi085.stdout:[osd] 2023-01-25T06:41:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: osd journal size = 100 2023-01-25T06:41:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.700 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub load threshold = 5.0 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub max interval = 600 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: osd recover clone overlap = true 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: osd recovery max chunk = 1048576 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.701 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug shutdown = true 2023-01-25T06:41:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug op order = true 2023-01-25T06:41:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify stray on activate = true 2023-01-25T06:41:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.702 INFO:teuthology.orchestra.run.smithi085.stdout: osd open classes on start = true 2023-01-25T06:41:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug pg log writeout = true 2023-01-25T06:41:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: osd deep scrub update digest min age = 30 2023-01-25T06:41:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.703 INFO:teuthology.orchestra.run.smithi085.stdout: osd map max advance = 10 2023-01-25T06:41:28.704 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.704 INFO:teuthology.orchestra.run.smithi085.stdout: journal zero on create = true 2023-01-25T06:41:28.704 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.704 INFO:teuthology.orchestra.run.smithi085.stdout: filestore ondisk finisher threads = 3 2023-01-25T06:41:28.704 INFO:teuthology.orchestra.run.smithi085.stdout: filestore apply finisher threads = 3 2023-01-25T06:41:28.705 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.705 INFO:teuthology.orchestra.run.smithi085.stdout: bdev debug aio = true 2023-01-25T06:41:28.705 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug misdirected ops = true 2023-01-25T06:41:28.705 INFO:teuthology.orchestra.run.smithi085.stdout: debug monc = 20 2023-01-25T06:41:28.705 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore block size = 96636764160 2023-01-25T06:41:28.706 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore compression algorithm = lz4 2023-01-25T06:41:28.706 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore compression mode = aggressive 2023-01-25T06:41:28.707 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore fsck on mount = True 2023-01-25T06:41:28.707 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore zero block detection = True 2023-01-25T06:41:28.707 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluefs = 20 2023-01-25T06:41:28.708 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluestore = 20 2023-01-25T06:41:28.709 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T06:41:28.709 INFO:teuthology.orchestra.run.smithi085.stdout: debug osd = 20 2023-01-25T06:41:28.709 INFO:teuthology.orchestra.run.smithi085.stdout: debug rocksdb = 10 2023-01-25T06:41:28.709 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T06:41:28.709 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd full ratio = 0.9 2023-01-25T06:41:28.710 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd nearfull ratio = 0.8 2023-01-25T06:41:28.710 INFO:teuthology.orchestra.run.smithi085.stdout: osd backoff on peering = True 2023-01-25T06:41:28.710 INFO:teuthology.orchestra.run.smithi085.stdout: osd blocked scrub grace period = 3600 2023-01-25T06:41:28.710 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify cached snaps = True 2023-01-25T06:41:28.710 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify missing on start = True 2023-01-25T06:41:28.711 INFO:teuthology.orchestra.run.smithi085.stdout: osd failsafe full ratio = 0.95 2023-01-25T06:41:28.711 INFO:teuthology.orchestra.run.smithi085.stdout: osd heartbeat use min delay socket = True 2023-01-25T06:41:28.711 INFO:teuthology.orchestra.run.smithi085.stdout: osd inject bad map crc probability = 0.1 2023-01-25T06:41:28.712 INFO:teuthology.orchestra.run.smithi085.stdout: osd max markdown count = 1000 2023-01-25T06:41:28.712 INFO:teuthology.orchestra.run.smithi085.stdout: osd mclock override recovery settings = True 2023-01-25T06:41:28.712 INFO:teuthology.orchestra.run.smithi085.stdout: osd objectstore = bluestore 2023-01-25T06:41:28.712 INFO:teuthology.orchestra.run.smithi085.stdout: osd op queue = debug_random 2023-01-25T06:41:28.712 INFO:teuthology.orchestra.run.smithi085.stdout: osd op queue cut off = debug_random 2023-01-25T06:41:28.713 INFO:teuthology.orchestra.run.smithi085.stdout: osd shutdown pgref assert = True 2023-01-25T06:41:28.713 INFO:teuthology.orchestra.run.smithi085.stdout: osd_max_pg_log_entries = 3000 2023-01-25T06:41:28.713 INFO:teuthology.orchestra.run.smithi085.stdout: osd_min_pg_log_entries = 3000 2023-01-25T06:41:28.713 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.713 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr] 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: debug mgr = 20 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:41:28.714 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:41:28.715 INFO:teuthology.orchestra.run.smithi085.stdout: mgr/telemetry/nag = false 2023-01-25T06:41:28.715 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.715 INFO:teuthology.orchestra.run.smithi085.stdout:[mon] 2023-01-25T06:41:28.715 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2023-01-25T06:41:28.715 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2023-01-25T06:41:28.716 INFO:teuthology.orchestra.run.smithi085.stdout: debug paxos = 20 2023-01-25T06:41:28.716 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2023-01-25T06:41:28.716 INFO:teuthology.orchestra.run.smithi085.stdout: mon data avail warn = 5 2023-01-25T06:41:28.716 INFO:teuthology.orchestra.run.smithi085.stdout: mon mgr mkfs grace = 240 2023-01-25T06:41:28.716 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd reporter subtree level = osd 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd prime pg temp = true 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T06:41:28.717 INFO:teuthology.orchestra.run.smithi085.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T06:41:28.718 INFO:teuthology.orchestra.run.smithi085.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T06:41:28.718 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.718 INFO:teuthology.orchestra.run.smithi085.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T06:41:28.718 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T06:41:28.718 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T06:41:28.719 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.719 INFO:teuthology.orchestra.run.smithi085.stdout: # 1m isn't quite enough 2023-01-25T06:41:28.719 INFO:teuthology.orchestra.run.smithi085.stdout: mon_down_mkfs_grace = 2m 2023-01-25T06:41:28.719 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.719 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_filestore_osds = false 2023-01-25T06:41:28.720 INFO:teuthology.orchestra.run.smithi085.stdout: mon scrub interval = 300 2023-01-25T06:41:28.720 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:41:28.720 INFO:teuthology.orchestra.run.smithi085.stdout:[client] 2023-01-25T06:41:28.720 INFO:teuthology.orchestra.run.smithi085.stdout: rgw cache enabled = true 2023-01-25T06:41:28.720 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable ops log = true 2023-01-25T06:41:28.721 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable usage log = true 2023-01-25T06:41:28.721 INFO:teuthology.orchestra.run.smithi085.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T06:41:28.721 INFO:teuthology.orchestra.run.smithi085.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T06:41:28.721 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.a] 2023-01-25T06:41:28.721 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.c] 2023-01-25T06:41:28.722 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.b] 2023-01-25T06:41:28.723 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-01-25T06:41:28.723 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-01-25T06:41:28.724 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-25T06:41:28.724 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-01-25T06:41:28.724 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.724 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-01-25T06:41:28.724 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.725 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-01-25T06:41:28.725 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.725 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-01-25T06:41:28.725 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-01-25T06:41:28.725 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.726 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-01-25T06:41:28.726 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-01-25T06:41:28.726 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.726 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-25T06:41:28.726 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-01-25T06:41:28.727 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.727 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-01-25T06:41:28.727 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-25T06:41:28.727 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.727 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-01-25T06:41:28.728 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.728 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-01-25T06:41:28.728 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-01-25T06:41:28.728 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-01-25T06:41:28.729 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-01-25T06:41:28.729 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-01-25T06:41:28.729 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-01-25T06:41:28.729 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-01-25T06:41:28.730 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-25T06:41:28.730 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-25T06:41:28.730 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-01-25T06:41:28.730 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.730 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-01-25T06:41:28.732 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.732 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-01-25T06:41:28.732 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.732 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-01-25T06:41:28.732 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.733 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-01-25T06:41:28.734 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-01-25T06:41:28.734 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-01-25T06:41:28.734 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.85,[v2:172.21.15.85:3301,v1:172.21.15.85:6790],172.21.15.173" 2023-01-25T06:41:28.734 INFO:teuthology.orchestra.run.smithi173.stdout: mon client directed command retry = 5 2023-01-25T06:41:28.734 INFO:teuthology.orchestra.run.smithi173.stdout: mon election default strategy = 1 2023-01-25T06:41:28.735 INFO:teuthology.orchestra.run.smithi173.stdout: ms bind msgr1 = False 2023-01-25T06:41:28.735 INFO:teuthology.orchestra.run.smithi173.stdout: ms bind msgr2 = True 2023-01-25T06:41:28.735 INFO:teuthology.orchestra.run.smithi173.stdout: ms inject socket failures = 5000 2023-01-25T06:41:28.735 INFO:teuthology.orchestra.run.smithi173.stdout: ms type = async 2023-01-25T06:41:28.735 INFO:teuthology.orchestra.run.smithi173.stdout: osd_object_clean_region_max_num_intervals = 1000 2023-01-25T06:41:28.736 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_min_size = 2 2023-01-25T06:41:28.736 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_size = 2 2023-01-25T06:41:28.736 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 1518175e-b72c-46a1-999a-d7e56798bccb 2023-01-25T06:41:28.736 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.736 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-01-25T06:41:28.737 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-01-25T06:41:28.737 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.737 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-01-25T06:41:28.737 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-01-25T06:41:28.738 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.738 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-01-25T06:41:28.738 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-01-25T06:41:28.738 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.738 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-01-25T06:41:28.739 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-01-25T06:41:28.739 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-01-25T06:41:28.739 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.739 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-01-25T06:41:28.740 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-01-25T06:41:28.740 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.740 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-01-25T06:41:28.740 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.740 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-01-25T06:41:28.741 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.741 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-01-25T06:41:28.741 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.741 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-01-25T06:41:28.741 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-01-25T06:41:28.742 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.742 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-01-25T06:41:28.742 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-01-25T06:41:28.742 INFO:teuthology.orchestra.run.smithi173.stdout: debug monc = 20 2023-01-25T06:41:28.743 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-01-25T06:41:28.743 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore compression algorithm = lz4 2023-01-25T06:41:28.743 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore compression mode = aggressive 2023-01-25T06:41:28.743 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-01-25T06:41:28.744 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore zero block detection = True 2023-01-25T06:41:28.744 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2023-01-25T06:41:28.744 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2023-01-25T06:41:28.744 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-01-25T06:41:28.745 INFO:teuthology.orchestra.run.smithi173.stdout: osd backoff on peering = True 2023-01-25T06:41:28.746 INFO:teuthology.orchestra.run.smithi173.stdout: osd blocked scrub grace period = 3600 2023-01-25T06:41:28.746 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify cached snaps = True 2023-01-25T06:41:28.746 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify missing on start = True 2023-01-25T06:41:28.746 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-01-25T06:41:28.746 INFO:teuthology.orchestra.run.smithi173.stdout: osd heartbeat use min delay socket = True 2023-01-25T06:41:28.747 INFO:teuthology.orchestra.run.smithi173.stdout: osd inject bad map crc probability = 0.1 2023-01-25T06:41:28.747 INFO:teuthology.orchestra.run.smithi173.stdout: osd max markdown count = 1000 2023-01-25T06:41:28.747 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock override recovery settings = True 2023-01-25T06:41:28.747 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-01-25T06:41:28.747 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue = debug_random 2023-01-25T06:41:28.748 INFO:teuthology.orchestra.run.smithi173.stdout: osd op queue cut off = debug_random 2023-01-25T06:41:28.748 INFO:teuthology.orchestra.run.smithi173.stdout: osd shutdown pgref assert = True 2023-01-25T06:41:28.748 INFO:teuthology.orchestra.run.smithi173.stdout: osd_max_pg_log_entries = 3000 2023-01-25T06:41:28.748 INFO:teuthology.orchestra.run.smithi173.stdout: osd_min_pg_log_entries = 3000 2023-01-25T06:41:28.748 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.749 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-01-25T06:41:28.749 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-01-25T06:41:28.749 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-01-25T06:41:28.749 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-01-25T06:41:28.749 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-01-25T06:41:28.750 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:41:28.750 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:41:28.750 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-01-25T06:41:28.750 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.750 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-01-25T06:41:28.751 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-01-25T06:41:28.751 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-01-25T06:41:28.751 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-01-25T06:41:28.751 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-01-25T06:41:28.751 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-01-25T06:41:28.752 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.753 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-25T06:41:28.753 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-01-25T06:41:28.753 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-01-25T06:41:28.753 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.753 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-01-25T06:41:28.754 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-25T06:41:28.754 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-25T06:41:28.754 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.754 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-01-25T06:41:28.754 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-01-25T06:41:28.755 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.755 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-01-25T06:41:28.755 INFO:teuthology.orchestra.run.smithi173.stdout: mon scrub interval = 300 2023-01-25T06:41:28.755 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-01-25T06:41:28.755 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-01-25T06:41:28.756 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-01-25T06:41:28.756 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-01-25T06:41:28.756 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-01-25T06:41:28.756 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-25T06:41:28.756 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-25T06:41:28.757 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-01-25T06:41:28.757 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-01-25T06:41:28.757 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-01-25T06:41:28.757 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-25T06:41:28.758 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-25T06:41:28.820 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-25T06:41:28.821 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:28.821 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-25T06:41:28.839 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:28.839 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-25T06:41:28.896 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:41:28.896 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:28.897 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T06:41:28.897 DEBUG:teuthology.orchestra.run.smithi085:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:41:28.972 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:28.975 DEBUG:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:29.030 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:41:29.030 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:29.030 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-25T06:41:29.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-25T06:41:29.068 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:29.068 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:29.125 INFO:tasks.ceph:Setting up mon nodes... 2023-01-25T06:41:29.126 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-25T06:41:29.126 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T06:41:29.180 INFO:teuthology.orchestra.run.smithi085.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-25T06:41:29.183 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T06:41:29.253 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-25T06:41:29.256 INFO:tasks.ceph:Setting up mds nodes... 2023-01-25T06:41:29.257 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-25T06:41:29.257 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-25T06:41:29.301 INFO:teuthology.orchestra.run.smithi085.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-25T06:41:29.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-25T06:41:29.358 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-25T06:41:29.370 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-25T06:41:29.371 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi085.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-25T06:41:29.371 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-25T06:41:29.398 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:29.399 INFO:tasks.ceph:role: osd.0 2023-01-25T06:41:29.399 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:41:29.399 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T06:41:29.474 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:29.474 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:29.474 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:29.474 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:29.475 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:29.475 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:29.475 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:29.475 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:29.476 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:29.476 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:29.896 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T06:41:29.897 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T06:41:29.898 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-25T06:41:30.068 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-25T06:41:30.102 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-25T06:41:30.169 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:30.169 INFO:tasks.ceph:role: osd.1 2023-01-25T06:41:30.170 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:41:30.170 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T06:41:30.244 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:30.244 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:30.244 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:30.245 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:30.245 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:30.245 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:30.245 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:30.245 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:30.246 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:30.246 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:30.679 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T06:41:30.680 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T06:41:30.681 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-25T06:41:30.782 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-25T06:41:30.813 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-25T06:41:30.881 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:30.881 INFO:tasks.ceph:role: osd.2 2023-01-25T06:41:30.881 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:41:30.882 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T06:41:30.955 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:30.956 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:30.956 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:30.956 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:30.956 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:30.956 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:30.957 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:30.957 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:30.957 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:30.957 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:31.405 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T06:41:31.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T06:41:31.407 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-25T06:41:31.577 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-25T06:41:31.609 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-25T06:41:31.676 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:31.677 INFO:tasks.ceph:role: osd.3 2023-01-25T06:41:31.677 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:41:31.677 DEBUG:teuthology.orchestra.run.smithi085:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T06:41:31.751 INFO:teuthology.orchestra.run.smithi085.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:31.751 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:31.751 INFO:teuthology.orchestra.run.smithi085.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:31.751 INFO:teuthology.orchestra.run.smithi085.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:31.752 INFO:teuthology.orchestra.run.smithi085.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:31.752 INFO:teuthology.orchestra.run.smithi085.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:31.752 INFO:teuthology.orchestra.run.smithi085.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:31.752 INFO:teuthology.orchestra.run.smithi085.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:31.753 INFO:teuthology.orchestra.run.smithi085.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:31.753 INFO:teuthology.orchestra.run.smithi085.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:32.188 INFO:teuthology.orchestra.run.smithi085.stdout:Discarding blocks...Done. 2023-01-25T06:41:32.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi085.front.sepia.ceph.com -o noatime 2023-01-25T06:41:32.190 DEBUG:teuthology.orchestra.run.smithi085:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-25T06:41:32.353 DEBUG:teuthology.orchestra.run.smithi085:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-25T06:41:32.386 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:32.489 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.487+0000 7fe1d95e15c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-25T06:41:32.490 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.488+0000 7fe1d95e15c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-25T06:41:32.490 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.488+0000 7fe1d95e15c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T06:41:32.490 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.488+0000 7fe1d95e15c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T06:41:32.490 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.488+0000 7fe1d95e15c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-25T06:41:32.490 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:32.488+0000 7fe1d95e15c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-25T06:41:33.013 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:33.012+0000 7fe1d95e15c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:33.778 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:33.776+0000 7fe1d95e15c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:34.543 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:34.542+0000 7fe1d95e15c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:35.335 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-25T06:41:35.367 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:35.458 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.456+0000 7f3ecd2725c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-25T06:41:35.458 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.457+0000 7f3ecd2725c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-25T06:41:35.458 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.457+0000 7f3ecd2725c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T06:41:35.459 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.457+0000 7f3ecd2725c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T06:41:35.459 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.457+0000 7f3ecd2725c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-25T06:41:35.459 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.457+0000 7f3ecd2725c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-25T06:41:35.982 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:35.981+0000 7f3ecd2725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:36.744 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:36.743+0000 7f3ecd2725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:37.507 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:37.505+0000 7f3ecd2725c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:38.299 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-25T06:41:38.332 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:38.425 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.424+0000 7f3f15dc65c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-25T06:41:38.426 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.424+0000 7f3f15dc65c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-25T06:41:38.426 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.424+0000 7f3f15dc65c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T06:41:38.426 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.424+0000 7f3f15dc65c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T06:41:38.426 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.424+0000 7f3f15dc65c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-25T06:41:38.427 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.425+0000 7f3f15dc65c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-25T06:41:38.949 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:38.948+0000 7f3f15dc65c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:39.714 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:39.713+0000 7f3f15dc65c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:40.479 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:40.478+0000 7f3f15dc65c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:41.271 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-25T06:41:41.302 DEBUG:teuthology.orchestra.run.smithi085:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:41.391 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.390+0000 7f2a328875c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-25T06:41:41.392 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.390+0000 7f2a328875c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-25T06:41:41.392 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.390+0000 7f2a328875c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T06:41:41.392 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.390+0000 7f2a328875c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T06:41:41.393 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.390+0000 7f2a328875c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-25T06:41:41.393 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.391+0000 7f2a328875c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-25T06:41:41.913 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:41.912+0000 7f2a328875c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:42.676 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:42.675+0000 7f2a328875c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:43.442 INFO:teuthology.orchestra.run.smithi085.stderr:2023-01-25T06:41:43.441+0000 7f2a328875c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:44.232 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-25T06:41:44.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-25T06:41:44.292 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:44.293 INFO:tasks.ceph:role: osd.4 2023-01-25T06:41:44.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:41:44.293 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-25T06:41:44.369 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:44.369 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:44.369 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:44.370 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:44.370 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:44.370 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:44.370 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:44.370 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:44.371 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:44.371 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:44.793 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-01-25T06:41:44.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-01-25T06:41:44.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-25T06:41:44.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-25T06:41:45.017 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-25T06:41:45.085 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:45.086 INFO:tasks.ceph:role: osd.5 2023-01-25T06:41:45.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:41:45.087 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-25T06:41:45.161 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:45.162 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:45.162 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:45.162 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:45.163 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:45.583 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-01-25T06:41:45.585 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-01-25T06:41:45.585 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-25T06:41:45.699 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-25T06:41:45.730 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-25T06:41:45.797 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:45.798 INFO:tasks.ceph:role: osd.6 2023-01-25T06:41:45.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:41:45.798 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-25T06:41:45.872 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:45.873 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:45.873 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:45.873 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:45.873 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:45.874 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:45.874 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:45.874 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:45.874 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:45.874 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:46.312 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-01-25T06:41:46.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-01-25T06:41:46.314 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-25T06:41:46.469 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-25T06:41:46.501 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-25T06:41:46.570 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-25T06:41:46.570 INFO:tasks.ceph:role: osd.7 2023-01-25T06:41:46.571 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2023-01-25T06:41:46.571 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-25T06:41:46.645 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-25T06:41:46.645 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-25T06:41:46.645 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-25T06:41:46.646 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-25T06:41:46.646 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-25T06:41:46.646 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-01-25T06:41:46.646 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-25T06:41:46.646 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-25T06:41:46.647 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-25T06:41:46.647 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-25T06:41:47.086 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-01-25T06:41:47.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-01-25T06:41:47.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-25T06:41:47.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-25T06:41:47.292 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:47.389 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.387+0000 7fb489af95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-25T06:41:47.390 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.388+0000 7fb489af95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-25T06:41:47.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.388+0000 7fb489af95c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T06:41:47.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.388+0000 7fb489af95c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T06:41:47.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.388+0000 7fb489af95c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-25T06:41:47.391 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.388+0000 7fb489af95c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-25T06:41:47.914 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:47.912+0000 7fb489af95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:48.680 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:48.678+0000 7fb489af95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:49.443 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:49.442+0000 7fb489af95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:50.238 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-25T06:41:50.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:50.364 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.362+0000 7f0a32cb95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-25T06:41:50.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.362+0000 7f0a32cb95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-25T06:41:50.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.362+0000 7f0a32cb95c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T06:41:50.365 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.362+0000 7f0a32cb95c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T06:41:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.362+0000 7f0a32cb95c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-25T06:41:50.366 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.363+0000 7f0a32cb95c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-25T06:41:50.888 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:50.887+0000 7f0a32cb95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:51.650 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:51.649+0000 7f0a32cb95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:52.416 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:52.415+0000 7f0a32cb95c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:53.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-25T06:41:53.244 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:53.334 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.333+0000 7f5a01b985c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-25T06:41:53.335 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.333+0000 7f5a01b985c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-25T06:41:53.335 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.333+0000 7f5a01b985c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T06:41:53.335 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.333+0000 7f5a01b985c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T06:41:53.335 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.333+0000 7f5a01b985c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-25T06:41:53.336 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.334+0000 7f5a01b985c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-25T06:41:53.858 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:53.857+0000 7f5a01b985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:54.623 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:54.621+0000 7f5a01b985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:55.386 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:55.384+0000 7f5a01b985c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:56.176 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-25T06:41:56.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:41:56.298 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-25T06:41:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-25T06:41:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T06:41:56.299 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T06:41:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-25T06:41:56.300 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.296+0000 7f101f1bd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-25T06:41:56.821 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:56.820+0000 7f101f1bd5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:57.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:57.582+0000 7f101f1bd5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:58.344 INFO:teuthology.orchestra.run.smithi173.stderr:2023-01-25T06:41:58.343+0000 7f101f1bd5c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-01-25T06:41:59.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-25T06:41:59.162 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-25T06:41:59.162 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.163 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-25T06:41:59.191 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.191 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-25T06:41:59.258 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.259 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-25T06:41:59.326 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.327 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-25T06:41:59.394 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.394 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-25T06:41:59.460 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.461 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-25T06:41:59.489 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.490 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-25T06:41:59.556 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.557 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-25T06:41:59.623 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.623 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-25T06:41:59.690 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.690 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-25T06:41:59.757 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:41:59.758 DEBUG:teuthology.orchestra.run.smithi085:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-25T06:41:59.776 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:41:59.776 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-25T06:41:59.814 INFO:tasks.ceph:Adding keys to all mons... 2023-01-25T06:41:59.815 DEBUG:teuthology.orchestra.run.smithi085:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T06:41:59.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-25T06:41:59.858 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr.y] 2023-01-25T06:41:59.858 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAZz9Bj9fTFChAATH9r3LcsQ2Pz8jmtp5pVoA== 2023-01-25T06:41:59.858 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.0] 2023-01-25T06:41:59.859 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAcz9BjQVApHRAA8BmBRnN65J173ywXlCIrbA== 2023-01-25T06:41:59.859 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.1] 2023-01-25T06:41:59.859 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAfz9Bj72ZPGxAAd9gRbNS7Em23wikBHlfC5w== 2023-01-25T06:41:59.859 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.2] 2023-01-25T06:41:59.859 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAiz9BjTWVeGRAAivLyP325rCR37q/o10Ez6w== 2023-01-25T06:41:59.860 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.3] 2023-01-25T06:41:59.860 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAlz9BjqBVYFxAAyCqPFNdoew44uq3ZDmQYeg== 2023-01-25T06:41:59.860 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr.x] 2023-01-25T06:41:59.860 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAZz9BjCGcnDxAARA/cbOiY4SfA1AdC9e+CCw== 2023-01-25T06:41:59.860 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.4] 2023-01-25T06:41:59.861 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQArz9BjnxUyFxAAMS4F22iPn+EAJfL8cRD0lw== 2023-01-25T06:41:59.861 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.5] 2023-01-25T06:41:59.861 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAuz9Bjo6GuFRAAY89O+wL5+Us1rhTlL7zBdA== 2023-01-25T06:41:59.861 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.6] 2023-01-25T06:41:59.861 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAxz9BjN5/1ExAACxzXs1vYCu8ikAub3OkXmQ== 2023-01-25T06:41:59.862 INFO:teuthology.orchestra.run.smithi085.stdout:[osd.7] 2023-01-25T06:41:59.862 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQA0z9BjDkq6ERAApgS6f5boyoEPW+ZevPvb4g== 2023-01-25T06:41:59.862 INFO:teuthology.orchestra.run.smithi085.stdout:[client.0] 2023-01-25T06:41:59.862 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAZz9Bj0p4EEhAAYn1/AAAaiHsHli8HZqToZw== 2023-01-25T06:41:59.862 INFO:teuthology.orchestra.run.smithi085.stdout:[client.1] 2023-01-25T06:41:59.863 INFO:teuthology.orchestra.run.smithi085.stdout: key = AQAZz9BjNbxnFRAAjK9jrBd9JqMF2DNMCqJdag== 2023-01-25T06:41:59.880 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2023-01-25T06:41:59.881 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZz9Bj9fTFChAATH9r3LcsQ2Pz8jmtp5pVoA== 2023-01-25T06:41:59.881 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2023-01-25T06:41:59.881 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAcz9BjQVApHRAA8BmBRnN65J173ywXlCIrbA== 2023-01-25T06:41:59.882 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2023-01-25T06:41:59.882 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAfz9Bj72ZPGxAAd9gRbNS7Em23wikBHlfC5w== 2023-01-25T06:41:59.882 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2023-01-25T06:41:59.882 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAiz9BjTWVeGRAAivLyP325rCR37q/o10Ez6w== 2023-01-25T06:41:59.882 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2023-01-25T06:41:59.883 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAlz9BjqBVYFxAAyCqPFNdoew44uq3ZDmQYeg== 2023-01-25T06:41:59.883 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2023-01-25T06:41:59.883 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZz9BjCGcnDxAARA/cbOiY4SfA1AdC9e+CCw== 2023-01-25T06:41:59.883 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2023-01-25T06:41:59.883 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQArz9BjnxUyFxAAMS4F22iPn+EAJfL8cRD0lw== 2023-01-25T06:41:59.884 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2023-01-25T06:41:59.884 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAuz9Bjo6GuFRAAY89O+wL5+Us1rhTlL7zBdA== 2023-01-25T06:41:59.884 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2023-01-25T06:41:59.884 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAxz9BjN5/1ExAACxzXs1vYCu8ikAub3OkXmQ== 2023-01-25T06:41:59.884 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2023-01-25T06:41:59.885 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQA0z9BjDkq6ERAApgS6f5boyoEPW+ZevPvb4g== 2023-01-25T06:41:59.885 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2023-01-25T06:41:59.885 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZz9Bj0p4EEhAAYn1/AAAaiHsHli8HZqToZw== 2023-01-25T06:41:59.885 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2023-01-25T06:41:59.885 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQAZz9BjNbxnFRAAjK9jrBd9JqMF2DNMCqJdag== 2023-01-25T06:41:59.886 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:41:59.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:41:59.980 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:41:59.982 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.036 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.040 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.093 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.096 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.150 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.152 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.205 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:42:00.208 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-25T06:42:00.261 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.263 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.317 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.376 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.432 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-25T06:42:00.488 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:42:00.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:42:00.547 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:42:00.550 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-25T06:42:00.606 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-25T06:42:00.606 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-25T06:42:00.634 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:42:00.733 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-25T06:42:00.760 DEBUG:teuthology.orchestra.run.smithi085:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-25T06:42:00.827 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:42:00.925 DEBUG:teuthology.orchestra.run.smithi085:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-25T06:42:00.952 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-25T06:42:00.981 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-25T06:42:01.078 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-25T06:42:01.105 DEBUG:teuthology.orchestra.run.smithi085:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:42:01.108 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-25T06:42:01.164 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-25T06:42:01.164 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-25T06:42:01.165 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-25T06:42:01.167 INFO:tasks.ceph.mon.a:Started 2023-01-25T06:42:01.168 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-25T06:42:01.168 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-25T06:42:01.170 INFO:tasks.ceph.mon.c:Started 2023-01-25T06:42:01.170 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-25T06:42:01.170 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-25T06:42:01.206 INFO:tasks.ceph.mon.b:Started 2023-01-25T06:42:01.207 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-25T06:42:01.207 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-25T06:42:01.208 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-25T06:42:01.214 INFO:tasks.ceph.mgr.y:Started 2023-01-25T06:42:01.214 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-25T06:42:01.215 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-25T06:42:01.217 INFO:tasks.ceph.mgr.x:Started 2023-01-25T06:42:01.217 INFO:tasks.ceph:Setting crush tunables to default 2023-01-25T06:42:01.217 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd crush tunables default 2023-01-25T06:42:06.608 INFO:teuthology.orchestra.run.smithi085.stderr:adjusted tunables profile to default 2023-01-25T06:42:06.619 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-25T06:42:06.620 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:42:06.620 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-25T06:42:06.648 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:42:06.648 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-25T06:42:06.714 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:42:06.714 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-25T06:42:06.780 DEBUG:teuthology.orchestra.run.smithi085:> set -ex 2023-01-25T06:42:06.781 DEBUG:teuthology.orchestra.run.smithi085:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-25T06:42:06.848 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:42:06.848 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-25T06:42:06.875 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:42:06.876 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-25T06:42:06.943 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:42:06.943 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-25T06:42:07.009 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-01-25T06:42:07.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-25T06:42:07.080 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 266898ad-3368-4d87-8cc4-72b680a03d6f 0 2023-01-25T06:42:07.338 INFO:teuthology.orchestra.run.smithi173.stdout:0 2023-01-25T06:42:07.351 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 0342c5ba-69de-4a01-8839-82cede9501d5 1 2023-01-25T06:42:07.433 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:07.432+0000 7f1d2995e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T06:42:07.478 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:07.478+0000 7f1c9a020200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-25T06:42:07.503 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:07.501+0000 7f1d2995e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T06:42:07.551 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:07.551+0000 7f1c9a020200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-25T06:42:07.570 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-01-25T06:42:07.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new db6de639-3ee0-45d3-9e8a-d9f3d099db0e 2 2023-01-25T06:42:07.596 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:07.595+0000 7f1d2995e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T06:42:07.634 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:07.634+0000 7f1c9a020200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-25T06:42:07.780 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:07.779+0000 7f1d2995e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T06:42:07.802 INFO:teuthology.orchestra.run.smithi173.stdout:2 2023-01-25T06:42:07.814 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 58432a7f-184d-40e9-9767-63009efe37d4 3 2023-01-25T06:42:07.827 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:07.827+0000 7f1c9a020200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-25T06:42:08.031 INFO:teuthology.orchestra.run.smithi173.stdout:3 2023-01-25T06:42:08.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e2e7c778-2aea-4961-9f71-58f8d9c0c447 4 2023-01-25T06:42:08.300 INFO:teuthology.orchestra.run.smithi173.stdout:4 2023-01-25T06:42:08.313 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 6dfa3357-af8b-4998-872a-03a6e39607e3 5 2023-01-25T06:42:08.556 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:08.554+0000 7f1d2995e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T06:42:08.564 INFO:teuthology.orchestra.run.smithi173.stdout:5 2023-01-25T06:42:08.577 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new d00a64e9-ae2b-4bc2-84ba-3822a5252880 6 2023-01-25T06:42:08.655 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:08.655+0000 7f1c9a020200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-25T06:42:08.695 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:08.694+0000 7f1d2995e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T06:42:08.795 INFO:teuthology.orchestra.run.smithi173.stdout:6 2023-01-25T06:42:08.801 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:08.801+0000 7f1c9a020200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-25T06:42:08.807 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 576ed6d5-5646-4569-b932-fa005340bfae 7 2023-01-25T06:42:08.914 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:08.913+0000 7f1d2995e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T06:42:08.986 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:08.984+0000 7f1d2995e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T06:42:09.028 INFO:teuthology.orchestra.run.smithi173.stdout:7 2023-01-25T06:42:09.038 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.038+0000 7f1c9a020200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-25T06:42:09.040 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-25T06:42:09.041 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-25T06:42:09.043 INFO:tasks.ceph.osd.0:Started 2023-01-25T06:42:09.043 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-25T06:42:09.044 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-25T06:42:09.046 INFO:tasks.ceph.osd.1:Started 2023-01-25T06:42:09.046 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-25T06:42:09.046 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-25T06:42:09.048 INFO:tasks.ceph.osd.2:Started 2023-01-25T06:42:09.049 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-25T06:42:09.049 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-25T06:42:09.051 INFO:tasks.ceph.osd.3:Started 2023-01-25T06:42:09.052 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-25T06:42:09.052 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-25T06:42:09.054 INFO:tasks.ceph.osd.4:Started 2023-01-25T06:42:09.054 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-25T06:42:09.055 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-25T06:42:09.057 INFO:tasks.ceph.osd.5:Started 2023-01-25T06:42:09.057 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-25T06:42:09.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-25T06:42:09.060 INFO:tasks.ceph.osd.6:Started 2023-01-25T06:42:09.060 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-25T06:42:09.060 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-25T06:42:09.062 INFO:tasks.ceph.osd.7:Started 2023-01-25T06:42:09.063 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:42:09.126 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.125+0000 7f1c9a020200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-25T06:42:09.139 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.137+0000 7f1d2995e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:42:09.279 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.279+0000 7f1c9a020200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:42:09.300 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:09.300 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":10,"fsid":"1518175e-b72c-46a1-999a-d7e56798bccb","created":"2023-01-25T06:42:06.498965+0000","modified":"2023-01-25T06:42:09.024018+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T06:42:09.024018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"266898ad-3368-4d87-8cc4-72b680a03d6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0342c5ba-69de-4a01-8839-82cede9501d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db6de639-3ee0-45d3-9e8a-d9f3d099db0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"58432a7f-184d-40e9-9767-63009efe37d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e2e7c778-2aea-4961-9f71-58f8d9c0c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6dfa3357-af8b-4998-872a-03a6e39607e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d00a64e9-ae2b-4bc2-84ba-3822a5252880","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"576ed6d5-5646-4569-b932-fa005340bfae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:42:09.313 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-25T06:42:09.313 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-25T06:42:09.418 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.417+0000 7f1d2995e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T06:42:09.544 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.544+0000 7f1c9a020200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-25T06:42:09.602 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.601+0000 7f1d2995e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T06:42:09.659 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:09.658+0000 7efe396a45c0 -1 Falling back to public interface 2023-01-25T06:42:09.669 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:09.668+0000 7f2dd601d5c0 -1 Falling back to public interface 2023-01-25T06:42:09.674 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:09.674+0000 7fb7546f25c0 -1 Falling back to public interface 2023-01-25T06:42:09.676 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:09.675+0000 7f9e11c775c0 -1 Falling back to public interface 2023-01-25T06:42:09.677 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:09.676+0000 7fca0923d5c0 -1 Falling back to public interface 2023-01-25T06:42:09.683 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-01-25T06:42:09.683+0000 7f2fd12095c0 -1 Falling back to public interface 2023-01-25T06:42:09.686 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:09.686+0000 7f4978dce5c0 -1 Falling back to public interface 2023-01-25T06:42:09.690 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:09.689+0000 7f74538c45c0 -1 Falling back to public interface 2023-01-25T06:42:09.734 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.734+0000 7f1c9a020200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-01-25T06:42:09.742 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.741+0000 7f1d2995e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T06:42:09.855 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.854+0000 7f1d2995e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T06:42:09.872 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.872+0000 7f1c9a020200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-25T06:42:09.988 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:09.987+0000 7f1c9a020200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-25T06:42:09.994 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:09.993+0000 7f1d2995e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:42:10.072 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:10.071+0000 7f1d2995e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T06:42:10.119 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T06:42:10.126 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:10.126+0000 7f1c9a020200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-25T06:42:10.204 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:10.204+0000 7f1c9a020200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-25T06:42:10.297 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:10.296+0000 7f1d2995e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T06:42:10.315 INFO:teuthology.misc.health.smithi085.stdout: 2023-01-25T06:42:10.315 INFO:teuthology.misc.health.smithi085.stdout:{"epoch":10,"fsid":"1518175e-b72c-46a1-999a-d7e56798bccb","created":"2023-01-25T06:42:06.498965+0000","modified":"2023-01-25T06:42:09.024018+0000","last_up_change":"0.000000","last_in_change":"2023-01-25T06:42:09.024018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"266898ad-3368-4d87-8cc4-72b680a03d6f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0342c5ba-69de-4a01-8839-82cede9501d5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"db6de639-3ee0-45d3-9e8a-d9f3d099db0e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"58432a7f-184d-40e9-9767-63009efe37d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e2e7c778-2aea-4961-9f71-58f8d9c0c447","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6dfa3357-af8b-4998-872a-03a6e39607e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d00a64e9-ae2b-4bc2-84ba-3822a5252880","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"576ed6d5-5646-4569-b932-fa005340bfae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:42:10.326 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-25T06:42:10.376 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:10.375+0000 7f1d2995e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T06:42:10.426 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:10.426+0000 7f1c9a020200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-25T06:42:10.504 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:10.504+0000 7f1c9a020200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-01-25T06:42:10.988 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:10.986+0000 7f1d2995e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T06:42:11.119 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.119+0000 7f1c9a020200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-25T06:42:11.240 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.239+0000 7f1d2995e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T06:42:11.315 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.314+0000 7f1d2995e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T06:42:11.388 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.388+0000 7f1c9a020200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-25T06:42:11.396 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.395+0000 7f1d2995e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T06:42:11.464 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.464+0000 7f1c9a020200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-25T06:42:11.545 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.545+0000 7f1c9a020200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-25T06:42:11.578 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.576+0000 7f1d2995e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T06:42:11.648 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.647+0000 7f1d2995e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T06:42:11.730 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.729+0000 7f1c9a020200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-25T06:42:11.800 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.800+0000 7f1c9a020200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-25T06:42:11.802 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:11.801+0000 7f1d2995e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T06:42:11.955 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-01-25T06:42:11.955+0000 7f1c9a020200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-25T06:42:12.824 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:12.823+0000 7f1ce349e700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-25T06:42:12.825 INFO:tasks.ceph.mgr.y.smithi085.stderr:2023-01-25T06:42:12.824+0000 7f1ce349e700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-25T06:42:12.924 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:12.923+0000 7fca0923d5c0 -1 osd.1 0 log_to_monitors true 2023-01-25T06:42:13.149 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:13.148+0000 7f2dd601d5c0 -1 osd.3 0 log_to_monitors true 2023-01-25T06:42:13.170 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:13.169+0000 7efe396a45c0 -1 osd.6 0 log_to_monitors true 2023-01-25T06:42:13.189 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:13.189+0000 7f4978dce5c0 -1 osd.7 0 log_to_monitors true 2023-01-25T06:42:13.189 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:13.189+0000 7f9e11c775c0 -1 osd.0 0 log_to_monitors true 2023-01-25T06:42:13.196 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:13.196+0000 7fb7546f25c0 -1 osd.4 0 log_to_monitors true 2023-01-25T06:42:13.197 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:13.196+0000 7f74538c45c0 -1 osd.2 0 log_to_monitors true 2023-01-25T06:42:13.198 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-01-25T06:42:13.198+0000 7f2fd12095c0 -1 osd.5 0 log_to_monitors true 2023-01-25T06:42:14.831 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:14.830+0000 7f496d176700 -1 osd.7 0 waiting for initial osdmap 2023-01-25T06:42:14.831 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:14.831+0000 7f4962ea4700 -1 osd.7 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.832 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:14.831+0000 7fc9fd5e5700 -1 osd.1 0 waiting for initial osdmap 2023-01-25T06:42:14.833 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:14.833+0000 7efe2da4c700 -1 osd.6 0 waiting for initial osdmap 2023-01-25T06:42:14.834 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:14.832+0000 7f2dca3c5700 -1 osd.3 0 waiting for initial osdmap 2023-01-25T06:42:14.834 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-01-25T06:42:14.834+0000 7f2fc55b1700 -1 osd.5 0 waiting for initial osdmap 2023-01-25T06:42:14.835 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:14.833+0000 7f9e0601f700 -1 osd.0 0 waiting for initial osdmap 2023-01-25T06:42:14.835 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:14.833+0000 7fc9f3313700 -1 osd.1 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.835 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:14.834+0000 7efe2377a700 -1 osd.6 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.839 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:14.839+0000 7f4967555700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.840 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-01-25T06:42:14.840+0000 7f2fbf990700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.842 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:14.842+0000 7fc9f79c4700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.843 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:14.842+0000 7f7447c6c700 -1 osd.2 0 waiting for initial osdmap 2023-01-25T06:42:14.843 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:14.842+0000 7f2dc47a4700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.844 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:14.842+0000 7f743d99a700 -1 osd.2 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.844 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:14.843+0000 7f9dfbd4d700 -1 osd.0 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.845 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:14.843+0000 7fb748a9a700 -1 osd.4 0 waiting for initial osdmap 2023-01-25T06:42:14.845 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:14.844+0000 7fb73e7c8700 -1 osd.4 0 handle_osd_map injecting map crc failure 2023-01-25T06:42:14.845 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:14.844+0000 7efe27e2b700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.849 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:14.848+0000 7f9e003fe700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.849 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:14.849+0000 7fb742e79700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:14.851 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:14.849+0000 7f744204b700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-25T06:42:15.848 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:15.846+0000 7f9dfbd4d700 -1 osd.0 12 handle_osd_map injecting map crc failure 2023-01-25T06:42:15.848 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:15.846+0000 7fc9f3313700 -1 osd.1 12 handle_osd_map injecting map crc failure 2023-01-25T06:42:15.849 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:15.848+0000 7fb73e7c8700 -1 osd.4 12 handle_osd_map injecting map crc failure 2023-01-25T06:42:17.134 DEBUG:teuthology.orchestra.run.smithi085:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-25T06:42:17.451 INFO:teuthology.misc.health.smithi085.stdout: 2023-01-25T06:42:17.451 INFO:teuthology.misc.health.smithi085.stdout:{"epoch":14,"fsid":"1518175e-b72c-46a1-999a-d7e56798bccb","created":"2023-01-25T06:42:06.498965+0000","modified":"2023-01-25T06:42:16.852069+0000","last_up_change":"2023-01-25T06:42:15.845572+0000","last_in_change":"2023-01-25T06:42:09.024018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"266898ad-3368-4d87-8cc4-72b680a03d6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106343}]},"public_addr":"172.21.15.85:6804/106343","cluster_addr":"172.21.15.85:6805/106343","heartbeat_back_addr":"172.21.15.85:6807/106343","heartbeat_front_addr":"172.21.15.85:6806/106343","state":["exists","up"]},{"osd":1,"uuid":"0342c5ba-69de-4a01-8839-82cede9501d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106344}]},"public_addr":"172.21.15.85:6808/106344","cluster_addr":"172.21.15.85:6809/106344","heartbeat_back_addr":"172.21.15.85:6811/106344","heartbeat_front_addr":"172.21.15.85:6810/106344","state":["exists","up"]},{"osd":2,"uuid":"db6de639-3ee0-45d3-9e8a-d9f3d099db0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106345}]},"public_addr":"172.21.15.85:6812/106345","cluster_addr":"172.21.15.85:6813/106345","heartbeat_back_addr":"172.21.15.85:6815/106345","heartbeat_front_addr":"172.21.15.85:6814/106345","state":["exists","up"]},{"osd":3,"uuid":"58432a7f-184d-40e9-9767-63009efe37d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106342}]},"public_addr":"172.21.15.85:6800/106342","cluster_addr":"172.21.15.85:6801/106342","heartbeat_back_addr":"172.21.15.85:6803/106342","heartbeat_front_addr":"172.21.15.85:6802/106342","state":["exists","up"]},{"osd":4,"uuid":"e2e7c778-2aea-4961-9f71-58f8d9c0c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":106290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6805","nonce":106290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":106290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":106290}]},"public_addr":"172.21.15.173:6804/106290","cluster_addr":"172.21.15.173:6805/106290","heartbeat_back_addr":"172.21.15.173:6807/106290","heartbeat_front_addr":"172.21.15.173:6806/106290","state":["exists","up"]},{"osd":5,"uuid":"6dfa3357-af8b-4998-872a-03a6e39607e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":106302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":106302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":106302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":106302}]},"public_addr":"172.21.15.173:6808/106302","cluster_addr":"172.21.15.173:6809/106302","heartbeat_back_addr":"172.21.15.173:6811/106302","heartbeat_front_addr":"172.21.15.173:6810/106302","state":["exists","up"]},{"osd":6,"uuid":"d00a64e9-ae2b-4bc2-84ba-3822a5252880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":106289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6801","nonce":106289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":106289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":106289}]},"public_addr":"172.21.15.173:6800/106289","cluster_addr":"172.21.15.173:6801/106289","heartbeat_back_addr":"172.21.15.173:6803/106289","heartbeat_front_addr":"172.21.15.173:6802/106289","state":["exists","up"]},{"osd":7,"uuid":"576ed6d5-5646-4569-b932-fa005340bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":106291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6813","nonce":106291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":106291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":106291}]},"public_addr":"172.21.15.173:6812/106291","cluster_addr":"172.21.15.173:6813/106291","heartbeat_back_addr":"172.21.15.173:6815/106291","heartbeat_front_addr":"172.21.15.173:6814/106291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.236184+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:13.890001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.228042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.194482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.195782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.234195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.169388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.229410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:42:17.463 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-25T06:42:17.464 INFO:tasks.ceph:Creating RBD pool 2023-01-25T06:42:17.464 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-25T06:42:17.869 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:17.868+0000 7f2dc00f3700 -1 osd.3 13 handle_osd_map injecting map crc failure 2023-01-25T06:42:17.871 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'rbd' created 2023-01-25T06:42:17.882 DEBUG:teuthology.orchestra.run.smithi085:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-25T06:42:18.874 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-01-25T06:42:18.874+0000 7f4962ea4700 -1 osd.7 15 handle_osd_map injecting map crc failure 2023-01-25T06:42:18.875 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-01-25T06:42:18.875+0000 7f2fbb2df700 -1 osd.5 15 handle_osd_map injecting map crc failure 2023-01-25T06:42:18.875 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:18.875+0000 7fb73e7c8700 -1 osd.4 15 handle_osd_map injecting map crc failure 2023-01-25T06:42:18.881 INFO:teuthology.orchestra.run.smithi085.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-25T06:42:18.894 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-25T06:42:18.895 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-25T06:42:18.895 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-25T06:42:18.896 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-25T06:42:18.896 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-25T06:42:19.294 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:19.306 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":4,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6816","nonce":106041}]},"active_addr":"172.21.15.85:6816/106041","active_change":"2023-01-25T06:42:11.815055+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":1933073741}]},{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":863364096}]},{"addrvec":[{"type":"v2","addr":"172.21.15.85:0","nonce":3546122931}]}]}} 2023-01-25T06:42:19.311 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-25T06:42:19.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-25T06:42:19.312 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:42:19.631 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:19.631 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":16,"fsid":"1518175e-b72c-46a1-999a-d7e56798bccb","created":"2023-01-25T06:42:06.498965+0000","modified":"2023-01-25T06:42:18.865928+0000","last_up_change":"2023-01-25T06:42:15.845572+0000","last_in_change":"2023-01-25T06:42:09.024018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T06:42:17.792100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T06:42:17.861847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"266898ad-3368-4d87-8cc4-72b680a03d6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106343}]},"public_addr":"172.21.15.85:6804/106343","cluster_addr":"172.21.15.85:6805/106343","heartbeat_back_addr":"172.21.15.85:6807/106343","heartbeat_front_addr":"172.21.15.85:6806/106343","state":["exists","up"]},{"osd":1,"uuid":"0342c5ba-69de-4a01-8839-82cede9501d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106344}]},"public_addr":"172.21.15.85:6808/106344","cluster_addr":"172.21.15.85:6809/106344","heartbeat_back_addr":"172.21.15.85:6811/106344","heartbeat_front_addr":"172.21.15.85:6810/106344","state":["exists","up"]},{"osd":2,"uuid":"db6de639-3ee0-45d3-9e8a-d9f3d099db0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106345}]},"public_addr":"172.21.15.85:6812/106345","cluster_addr":"172.21.15.85:6813/106345","heartbeat_back_addr":"172.21.15.85:6815/106345","heartbeat_front_addr":"172.21.15.85:6814/106345","state":["exists","up"]},{"osd":3,"uuid":"58432a7f-184d-40e9-9767-63009efe37d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106342}]},"public_addr":"172.21.15.85:6800/106342","cluster_addr":"172.21.15.85:6801/106342","heartbeat_back_addr":"172.21.15.85:6803/106342","heartbeat_front_addr":"172.21.15.85:6802/106342","state":["exists","up"]},{"osd":4,"uuid":"e2e7c778-2aea-4961-9f71-58f8d9c0c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":106290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6805","nonce":106290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":106290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":106290}]},"public_addr":"172.21.15.173:6804/106290","cluster_addr":"172.21.15.173:6805/106290","heartbeat_back_addr":"172.21.15.173:6807/106290","heartbeat_front_addr":"172.21.15.173:6806/106290","state":["exists","up"]},{"osd":5,"uuid":"6dfa3357-af8b-4998-872a-03a6e39607e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":106302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":106302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":106302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":106302}]},"public_addr":"172.21.15.173:6808/106302","cluster_addr":"172.21.15.173:6809/106302","heartbeat_back_addr":"172.21.15.173:6811/106302","heartbeat_front_addr":"172.21.15.173:6810/106302","state":["exists","up"]},{"osd":6,"uuid":"d00a64e9-ae2b-4bc2-84ba-3822a5252880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":106289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6801","nonce":106289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":106289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":106289}]},"public_addr":"172.21.15.173:6800/106289","cluster_addr":"172.21.15.173:6801/106289","heartbeat_back_addr":"172.21.15.173:6803/106289","heartbeat_front_addr":"172.21.15.173:6802/106289","state":["exists","up"]},{"osd":7,"uuid":"576ed6d5-5646-4569-b932-fa005340bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":106291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6813","nonce":106291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":106291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":106291}]},"public_addr":"172.21.15.173:6812/106291","cluster_addr":"172.21.15.173:6813/106291","heartbeat_back_addr":"172.21.15.173:6815/106291","heartbeat_front_addr":"172.21.15.173:6814/106291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.236184+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:13.890001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.228042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.194482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.195782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.234195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.169388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.229410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:42:19.645 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-25T06:42:19.645 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-25T06:42:19.969 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:19.969 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":17,"fsid":"1518175e-b72c-46a1-999a-d7e56798bccb","created":"2023-01-25T06:42:06.498965+0000","modified":"2023-01-25T06:42:19.874721+0000","last_up_change":"2023-01-25T06:42:15.845572+0000","last_in_change":"2023-01-25T06:42:09.024018+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-01-25T06:42:17.792100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-01-25T06:42:17.861847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"266898ad-3368-4d87-8cc4-72b680a03d6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6804","nonce":106343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6805","nonce":106343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6807","nonce":106343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6806","nonce":106343}]},"public_addr":"172.21.15.85:6804/106343","cluster_addr":"172.21.15.85:6805/106343","heartbeat_back_addr":"172.21.15.85:6807/106343","heartbeat_front_addr":"172.21.15.85:6806/106343","state":["exists","up"]},{"osd":1,"uuid":"0342c5ba-69de-4a01-8839-82cede9501d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6808","nonce":106344}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6809","nonce":106344}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6811","nonce":106344}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6810","nonce":106344}]},"public_addr":"172.21.15.85:6808/106344","cluster_addr":"172.21.15.85:6809/106344","heartbeat_back_addr":"172.21.15.85:6811/106344","heartbeat_front_addr":"172.21.15.85:6810/106344","state":["exists","up"]},{"osd":2,"uuid":"db6de639-3ee0-45d3-9e8a-d9f3d099db0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6812","nonce":106345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6813","nonce":106345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6815","nonce":106345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6814","nonce":106345}]},"public_addr":"172.21.15.85:6812/106345","cluster_addr":"172.21.15.85:6813/106345","heartbeat_back_addr":"172.21.15.85:6815/106345","heartbeat_front_addr":"172.21.15.85:6814/106345","state":["exists","up"]},{"osd":3,"uuid":"58432a7f-184d-40e9-9767-63009efe37d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6800","nonce":106342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6801","nonce":106342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6803","nonce":106342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.85:6802","nonce":106342}]},"public_addr":"172.21.15.85:6800/106342","cluster_addr":"172.21.15.85:6801/106342","heartbeat_back_addr":"172.21.15.85:6803/106342","heartbeat_front_addr":"172.21.15.85:6802/106342","state":["exists","up"]},{"osd":4,"uuid":"e2e7c778-2aea-4961-9f71-58f8d9c0c447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":106290}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6805","nonce":106290}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6807","nonce":106290}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":106290}]},"public_addr":"172.21.15.173:6804/106290","cluster_addr":"172.21.15.173:6805/106290","heartbeat_back_addr":"172.21.15.173:6807/106290","heartbeat_front_addr":"172.21.15.173:6806/106290","state":["exists","up"]},{"osd":5,"uuid":"6dfa3357-af8b-4998-872a-03a6e39607e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":106302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6809","nonce":106302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6811","nonce":106302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":106302}]},"public_addr":"172.21.15.173:6808/106302","cluster_addr":"172.21.15.173:6809/106302","heartbeat_back_addr":"172.21.15.173:6811/106302","heartbeat_front_addr":"172.21.15.173:6810/106302","state":["exists","up"]},{"osd":6,"uuid":"d00a64e9-ae2b-4bc2-84ba-3822a5252880","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":106289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6801","nonce":106289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6803","nonce":106289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":106289}]},"public_addr":"172.21.15.173:6800/106289","cluster_addr":"172.21.15.173:6801/106289","heartbeat_back_addr":"172.21.15.173:6803/106289","heartbeat_front_addr":"172.21.15.173:6802/106289","state":["exists","up"]},{"osd":7,"uuid":"576ed6d5-5646-4569-b932-fa005340bfae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":106291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6813","nonce":106291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6815","nonce":106291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":106291}]},"public_addr":"172.21.15.173:6812/106291","cluster_addr":"172.21.15.173:6813/106291","heartbeat_back_addr":"172.21.15.173:6815/106291","heartbeat_front_addr":"172.21.15.173:6814/106291","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.236184+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:13.890001+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.228042+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.194482+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.195782+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.234195+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.169388+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-01-25T06:42:14.229410+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-25T06:42:19.985 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-25T06:42:19.985 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-25T06:42:19.986 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-25T06:42:19.987 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-25T06:42:19.987 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-25T06:42:19.988 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-25T06:42:19.989 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-25T06:42:19.989 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-25T06:42:20.265 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:20.265 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T06:42:20.282 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:20.282 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T06:42:20.286 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.287 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T06:42:20.288 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.288 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T06:42:20.290 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:20.291 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T06:42:20.293 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:20.294 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T06:42:20.296 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.297 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T06:42:20.305 INFO:teuthology.orchestra.run.smithi085.stdout:55834574852 2023-01-25T06:42:20.306 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T06:42:20.672 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:20.672+0000 7efe21776700 -1 osd.6 16 handle_osd_map injecting map crc failure 2023-01-25T06:42:20.895 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.908 INFO:teuthology.orchestra.run.smithi085.stdout:55834574849 2023-01-25T06:42:20.908 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.911 INFO:teuthology.orchestra.run.smithi085.stdout:55834574849 2023-01-25T06:42:20.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2023-01-25T06:42:20.932 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.935 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.5 2023-01-25T06:42:20.935 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:20.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.1 2023-01-25T06:42:20.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.6 2023-01-25T06:42:20.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.0 2023-01-25T06:42:20.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2023-01-25T06:42:20.967 INFO:teuthology.orchestra.run.smithi085.stdout:55834574849 2023-01-25T06:42:20.974 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:20.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.7 2023-01-25T06:42:20.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2023-01-25T06:42:21.927 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-25T06:42:21.936 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-25T06:42:21.939 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-25T06:42:21.942 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-25T06:42:21.952 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-25T06:42:21.957 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-25T06:42:21.983 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-25T06:42:21.989 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-25T06:42:22.542 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:22.554 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:22.557 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:22.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.3 2023-01-25T06:42:22.562 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.6 2023-01-25T06:42:22.576 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2023-01-25T06:42:22.585 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.585 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:22.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.1 2023-01-25T06:42:22.601 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.609 INFO:teuthology.orchestra.run.smithi085.stdout:55834574851 2023-01-25T06:42:22.609 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:22.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.0 2023-01-25T06:42:22.626 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.5 2023-01-25T06:42:22.627 INFO:teuthology.orchestra.run.smithi085.stdout:55834574850 2023-01-25T06:42:22.628 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.634 INFO:teuthology.orchestra.run.smithi085.stdout:55834574852 2023-01-25T06:42:22.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.7 2023-01-25T06:42:22.642 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2023-01-25T06:42:22.649 DEBUG:teuthology.parallel:result is None 2023-01-25T06:42:22.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-25T06:42:22.650 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:42:22.999 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:23.001 INFO:teuthology.orchestra.run.smithi085.stderr:dumped all 2023-01-25T06:42:23.012 INFO:teuthology.orchestra.run.smithi085.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-25T06:42:21.820645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41848,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":40576,"kb_avail":754932872,"statfs":{"total":773094113280,"available":773051260928,"internally_reserved":0,"allocated":1179648,"data_stored":1378612,"data_compressed":16202,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41549824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:18.880962+0000","last_change":"2023-01-25T06:42:18.880292+0000","last_active":"2023-01-25T06:42:18.880962+0000","last_peered":"2023-01-25T06:42:18.880962+0000","last_clean":"2023-01-25T06:42:18.880962+0000","last_became_active":"2023-01-25T06:42:18.880025+0000","last_became_peered":"2023-01-25T06:42:18.880025+0000","last_unstale":"2023-01-25T06:42:18.880962+0000","last_undegraded":"2023-01-25T06:42:18.880962+0000","last_fullsized":"2023-01-25T06:42:18.880962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:44:09.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.147247+0000","last_change":"2023-01-25T06:42:19.144287+0000","last_active":"2023-01-25T06:42:19.147247+0000","last_peered":"2023-01-25T06:42:19.147247+0000","last_clean":"2023-01-25T06:42:19.147247+0000","last_became_active":"2023-01-25T06:42:19.144006+0000","last_became_peered":"2023-01-25T06:42:19.144006+0000","last_unstale":"2023-01-25T06:42:19.147247+0000","last_undegraded":"2023-01-25T06:42:19.147247+0000","last_fullsized":"2023-01-25T06:42:19.147247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T12:30:41.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.147220+0000","last_change":"2023-01-25T06:42:19.144412+0000","last_active":"2023-01-25T06:42:19.147220+0000","last_peered":"2023-01-25T06:42:19.147220+0000","last_clean":"2023-01-25T06:42:19.147220+0000","last_became_active":"2023-01-25T06:42:19.144089+0000","last_became_peered":"2023-01-25T06:42:19.144089+0000","last_unstale":"2023-01-25T06:42:19.147220+0000","last_undegraded":"2023-01-25T06:42:19.147220+0000","last_fullsized":"2023-01-25T06:42:19.147220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T15:24:27.126131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884735+0000","last_change":"2023-01-25T06:42:19.144268+0000","last_active":"2023-01-25T06:42:19.884735+0000","last_peered":"2023-01-25T06:42:19.884735+0000","last_clean":"2023-01-25T06:42:19.884735+0000","last_became_active":"2023-01-25T06:42:19.143988+0000","last_became_peered":"2023-01-25T06:42:19.143988+0000","last_unstale":"2023-01-25T06:42:19.884735+0000","last_undegraded":"2023-01-25T06:42:19.884735+0000","last_fullsized":"2023-01-25T06:42:19.884735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:47:14.738193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884744+0000","last_change":"2023-01-25T06:42:19.144240+0000","last_active":"2023-01-25T06:42:19.884744+0000","last_peered":"2023-01-25T06:42:19.884744+0000","last_clean":"2023-01-25T06:42:19.884744+0000","last_became_active":"2023-01-25T06:42:19.143974+0000","last_became_peered":"2023-01-25T06:42:19.143974+0000","last_unstale":"2023-01-25T06:42:19.884744+0000","last_undegraded":"2023-01-25T06:42:19.884744+0000","last_fullsized":"2023-01-25T06:42:19.884744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T06:48:24.516087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884723+0000","last_change":"2023-01-25T06:42:18.880229+0000","last_active":"2023-01-25T06:42:19.884723+0000","last_peered":"2023-01-25T06:42:19.884723+0000","last_clean":"2023-01-25T06:42:19.884723+0000","last_became_active":"2023-01-25T06:42:18.879922+0000","last_became_peered":"2023-01-25T06:42:18.879922+0000","last_unstale":"2023-01-25T06:42:19.884723+0000","last_undegraded":"2023-01-25T06:42:19.884723+0000","last_fullsized":"2023-01-25T06:42:19.884723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:13:59.052463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.888411+0000","last_change":"2023-01-25T06:42:18.881107+0000","last_active":"2023-01-25T06:42:19.888411+0000","last_peered":"2023-01-25T06:42:19.888411+0000","last_clean":"2023-01-25T06:42:19.888411+0000","last_became_active":"2023-01-25T06:42:18.880806+0000","last_became_peered":"2023-01-25T06:42:18.880806+0000","last_unstale":"2023-01-25T06:42:19.888411+0000","last_undegraded":"2023-01-25T06:42:19.888411+0000","last_fullsized":"2023-01-25T06:42:19.888411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T15:19:49.995045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:18.881445+0000","last_change":"2023-01-25T06:42:18.880756+0000","last_active":"2023-01-25T06:42:18.881445+0000","last_peered":"2023-01-25T06:42:18.881445+0000","last_clean":"2023-01-25T06:42:18.881445+0000","last_became_active":"2023-01-25T06:42:18.880453+0000","last_became_peered":"2023-01-25T06:42:18.880453+0000","last_unstale":"2023-01-25T06:42:18.881445+0000","last_undegraded":"2023-01-25T06:42:18.881445+0000","last_fullsized":"2023-01-25T06:42:18.881445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:30:54.000120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.128198+0000","last_change":"2023-01-25T06:42:19.127787+0000","last_active":"2023-01-25T06:42:19.128198+0000","last_peered":"2023-01-25T06:42:19.128198+0000","last_clean":"2023-01-25T06:42:19.128198+0000","last_became_active":"2023-01-25T06:42:19.127581+0000","last_became_peered":"2023-01-25T06:42:19.127581+0000","last_unstale":"2023-01-25T06:42:19.128198+0000","last_undegraded":"2023-01-25T06:42:19.128198+0000","last_fullsized":"2023-01-25T06:42:19.128198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:35:53.625412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":16202,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5668,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":94366172,"statfs":{"total":96636764160,"available":96630960128,"internally_reserved":0,"allocated":196608,"data_stored":573732,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":39624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5652,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":94366188,"statfs":{"total":96636764160,"available":96630976512,"internally_reserved":0,"allocated":180224,"data_stored":565602,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5116,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366724,"statfs":{"total":96636764160,"available":96631525376,"internally_reserved":0,"allocated":118784,"data_stored":36114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5144,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366696,"statfs":{"total":96636764160,"available":96631496704,"internally_reserved":0,"allocated":147456,"data_stored":45804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5064,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366776,"statfs":{"total":96636764160,"available":96631578624,"internally_reserved":0,"allocated":131072,"data_stored":39201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":38690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":39845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T06:42:23.014 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-25T06:42:23.324 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:23.326 INFO:teuthology.orchestra.run.smithi085.stderr:dumped all 2023-01-25T06:42:23.337 INFO:teuthology.orchestra.run.smithi085.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-01-25T06:42:21.820645+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":41848,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":40576,"kb_avail":754932872,"statfs":{"total":773094113280,"available":773051260928,"internally_reserved":0,"allocated":1179648,"data_stored":1378612,"data_compressed":16202,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":41549824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:18.880962+0000","last_change":"2023-01-25T06:42:18.880292+0000","last_active":"2023-01-25T06:42:18.880962+0000","last_peered":"2023-01-25T06:42:18.880962+0000","last_clean":"2023-01-25T06:42:18.880962+0000","last_became_active":"2023-01-25T06:42:18.880025+0000","last_became_peered":"2023-01-25T06:42:18.880025+0000","last_unstale":"2023-01-25T06:42:18.880962+0000","last_undegraded":"2023-01-25T06:42:18.880962+0000","last_fullsized":"2023-01-25T06:42:18.880962+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T10:44:09.556127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.147247+0000","last_change":"2023-01-25T06:42:19.144287+0000","last_active":"2023-01-25T06:42:19.147247+0000","last_peered":"2023-01-25T06:42:19.147247+0000","last_clean":"2023-01-25T06:42:19.147247+0000","last_became_active":"2023-01-25T06:42:19.144006+0000","last_became_peered":"2023-01-25T06:42:19.144006+0000","last_unstale":"2023-01-25T06:42:19.147247+0000","last_undegraded":"2023-01-25T06:42:19.147247+0000","last_fullsized":"2023-01-25T06:42:19.147247+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T12:30:41.033734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.147220+0000","last_change":"2023-01-25T06:42:19.144412+0000","last_active":"2023-01-25T06:42:19.147220+0000","last_peered":"2023-01-25T06:42:19.147220+0000","last_clean":"2023-01-25T06:42:19.147220+0000","last_became_active":"2023-01-25T06:42:19.144089+0000","last_became_peered":"2023-01-25T06:42:19.144089+0000","last_unstale":"2023-01-25T06:42:19.147220+0000","last_undegraded":"2023-01-25T06:42:19.147220+0000","last_fullsized":"2023-01-25T06:42:19.147220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T15:24:27.126131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884735+0000","last_change":"2023-01-25T06:42:19.144268+0000","last_active":"2023-01-25T06:42:19.884735+0000","last_peered":"2023-01-25T06:42:19.884735+0000","last_clean":"2023-01-25T06:42:19.884735+0000","last_became_active":"2023-01-25T06:42:19.143988+0000","last_became_peered":"2023-01-25T06:42:19.143988+0000","last_unstale":"2023-01-25T06:42:19.884735+0000","last_undegraded":"2023-01-25T06:42:19.884735+0000","last_fullsized":"2023-01-25T06:42:19.884735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:47:14.738193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884744+0000","last_change":"2023-01-25T06:42:19.144240+0000","last_active":"2023-01-25T06:42:19.884744+0000","last_peered":"2023-01-25T06:42:19.884744+0000","last_clean":"2023-01-25T06:42:19.884744+0000","last_became_active":"2023-01-25T06:42:19.143974+0000","last_became_peered":"2023-01-25T06:42:19.143974+0000","last_unstale":"2023-01-25T06:42:19.884744+0000","last_undegraded":"2023-01-25T06:42:19.884744+0000","last_fullsized":"2023-01-25T06:42:19.884744+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T06:48:24.516087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.884723+0000","last_change":"2023-01-25T06:42:18.880229+0000","last_active":"2023-01-25T06:42:19.884723+0000","last_peered":"2023-01-25T06:42:19.884723+0000","last_clean":"2023-01-25T06:42:19.884723+0000","last_became_active":"2023-01-25T06:42:18.879922+0000","last_became_peered":"2023-01-25T06:42:18.879922+0000","last_unstale":"2023-01-25T06:42:19.884723+0000","last_undegraded":"2023-01-25T06:42:19.884723+0000","last_fullsized":"2023-01-25T06:42:19.884723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T07:13:59.052463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.888411+0000","last_change":"2023-01-25T06:42:18.881107+0000","last_active":"2023-01-25T06:42:19.888411+0000","last_peered":"2023-01-25T06:42:19.888411+0000","last_clean":"2023-01-25T06:42:19.888411+0000","last_became_active":"2023-01-25T06:42:18.880806+0000","last_became_peered":"2023-01-25T06:42:18.880806+0000","last_unstale":"2023-01-25T06:42:19.888411+0000","last_undegraded":"2023-01-25T06:42:19.888411+0000","last_fullsized":"2023-01-25T06:42:19.888411+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T15:19:49.995045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:18.881445+0000","last_change":"2023-01-25T06:42:18.880756+0000","last_active":"2023-01-25T06:42:18.881445+0000","last_peered":"2023-01-25T06:42:18.881445+0000","last_clean":"2023-01-25T06:42:18.881445+0000","last_became_active":"2023-01-25T06:42:18.880453+0000","last_became_peered":"2023-01-25T06:42:18.880453+0000","last_unstale":"2023-01-25T06:42:18.881445+0000","last_undegraded":"2023-01-25T06:42:18.881445+0000","last_fullsized":"2023-01-25T06:42:18.881445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:30:54.000120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-01-25T06:42:19.128198+0000","last_change":"2023-01-25T06:42:19.127787+0000","last_active":"2023-01-25T06:42:19.128198+0000","last_peered":"2023-01-25T06:42:19.128198+0000","last_clean":"2023-01-25T06:42:19.128198+0000","last_became_active":"2023-01-25T06:42:19.127581+0000","last_became_peered":"2023-01-25T06:42:19.127581+0000","last_unstale":"2023-01-25T06:42:19.128198+0000","last_undegraded":"2023-01-25T06:42:19.128198+0000","last_fullsized":"2023-01-25T06:42:19.128198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-25T06:42:17.862312+0000","last_clean_scrub_stamp":"2023-01-25T06:42:17.862312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-01-26T11:35:53.625412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":16202,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574850,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5668,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":94366172,"statfs":{"total":96636764160,"available":96630960128,"internally_reserved":0,"allocated":196608,"data_stored":573732,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574850,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":39624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5652,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":94366188,"statfs":{"total":96636764160,"available":96630976512,"internally_reserved":0,"allocated":180224,"data_stored":565602,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5116,"kb_used_data":116,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366724,"statfs":{"total":96636764160,"available":96631525376,"internally_reserved":0,"allocated":118784,"data_stored":36114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5144,"kb_used_data":144,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":94366696,"statfs":{"total":96636764160,"available":96631496704,"internally_reserved":0,"allocated":147456,"data_stored":45804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5064,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366776,"statfs":{"total":96636764160,"available":96631578624,"internally_reserved":0,"allocated":131072,"data_stored":39201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":38690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574850,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5068,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366772,"statfs":{"total":96636764160,"available":96631574528,"internally_reserved":0,"allocated":135168,"data_stored":39845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":8101,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-25T06:42:23.339 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-25T06:42:23.339 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-25T06:42:23.339 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-25T06:42:23.340 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-25T06:42:23.689 INFO:teuthology.orchestra.run.smithi085.stdout: 2023-01-25T06:42:23.689 INFO:teuthology.orchestra.run.smithi085.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-25T06:42:23.703 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-25T06:42:23.704 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T06:42:23.717 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T06:42:23.717 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:42:23.717 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! ceph balancer status ; do sleep 1 ; done' 2023-01-25T06:42:24.026 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2023-01-25T06:42:24.026 INFO:teuthology.orchestra.run.smithi085.stdout: "active": true, 2023-01-25T06:42:24.027 INFO:teuthology.orchestra.run.smithi085.stdout: "last_optimize_duration": "0:00:00.000301", 2023-01-25T06:42:24.027 INFO:teuthology.orchestra.run.smithi085.stdout: "last_optimize_started": "Wed Jan 25 06:42:11 2023", 2023-01-25T06:42:24.027 INFO:teuthology.orchestra.run.smithi085.stdout: "mode": "upmap", 2023-01-25T06:42:24.027 INFO:teuthology.orchestra.run.smithi085.stdout: "no_optimization_needed": false, 2023-01-25T06:42:24.028 INFO:teuthology.orchestra.run.smithi085.stdout: "optimize_result": "No pools available", 2023-01-25T06:42:24.028 INFO:teuthology.orchestra.run.smithi085.stdout: "plans": [] 2023-01-25T06:42:24.028 INFO:teuthology.orchestra.run.smithi085.stdout:} 2023-01-25T06:42:24.040 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer mode crush-compat' 2023-01-25T06:42:25.306 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph balancer on' 2023-01-25T06:42:25.634 INFO:teuthology.run_tasks:Running task exec... 2023-01-25T06:42:25.649 INFO:teuthology.task.exec:Executing custom commands... 2023-01-25T06:42:25.649 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi085.front.sepia.ceph.com 2023-01-25T06:42:25.649 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create base 4' 2023-01-25T06:42:26.298 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'base' created 2023-01-25T06:42:26.311 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool application enable base rados' 2023-01-25T06:42:27.306 INFO:teuthology.orchestra.run.smithi085.stderr:enabled application 'rados' on pool 'base' 2023-01-25T06:42:27.318 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-01-25T06:42:28.301 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'cache' created 2023-01-25T06:42:28.315 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add base cache' 2023-01-25T06:42:28.400 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:28.399+0000 7f743b996700 -1 osd.2 20 handle_osd_map injecting map crc failure 2023-01-25T06:42:29.306 INFO:teuthology.orchestra.run.smithi085.stderr:pool 'cache' is now (or already was) a tier of 'base' 2023-01-25T06:42:29.321 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-01-25T06:42:30.298 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:30.296+0000 7f743d99a700 -1 osd.2 22 handle_osd_map injecting map crc failure 2023-01-25T06:42:30.302 INFO:teuthology.orchestra.run.smithi085.stderr:set cache-mode for pool 'cache' to writeback 2023-01-25T06:42:30.316 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay base cache' 2023-01-25T06:42:31.328 INFO:teuthology.orchestra.run.smithi085.stderr:overlay for 'base' is now (or already was) 'cache' 2023-01-25T06:42:31.343 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-01-25T06:42:31.773 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:31.772+0000 7efe21776700 -1 osd.6 23 handle_osd_map injecting map crc failure 2023-01-25T06:42:31.774 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:31.773+0000 7efe21776700 -1 osd.6 23 handle_osd_map injecting map crc failure 2023-01-25T06:42:31.900 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:31.899+0000 7f9df9d49700 -1 osd.0 23 handle_osd_map injecting map crc failure 2023-01-25T06:42:32.336 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_type to bloom 2023-01-25T06:42:32.351 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-01-25T06:42:33.344 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_count to 8 2023-01-25T06:42:33.357 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 3600' 2023-01-25T06:42:33.395 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-01-25T06:42:33.394+0000 7efe21776700 -1 osd.6 25 handle_osd_map injecting map crc failure 2023-01-25T06:42:34.345 INFO:tasks.ceph.osd.0.smithi085.stderr:2023-01-25T06:42:34.344+0000 7f9dfbd4d700 -1 osd.0 26 handle_osd_map injecting map crc failure 2023-01-25T06:42:34.350 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 hit_set_period to 3600 2023-01-25T06:42:34.364 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-01-25T06:42:35.129 INFO:tasks.ceph.osd.1.smithi085.stderr:2023-01-25T06:42:35.127+0000 7fc9f130f700 -1 osd.1 26 handle_osd_map injecting map crc failure 2023-01-25T06:42:35.304 INFO:tasks.ceph.osd.3.smithi085.stderr:2023-01-25T06:42:35.300+0000 7f2dbe0ef700 -1 osd.3 26 handle_osd_map injecting map crc failure 2023-01-25T06:42:35.349 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:35.348+0000 7f743d99a700 -1 osd.2 27 handle_osd_map injecting map crc failure 2023-01-25T06:42:35.355 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 target_max_objects to 250 2023-01-25T06:42:35.370 DEBUG:teuthology.orchestra.run.smithi085:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache min_read_recency_for_promote 2' 2023-01-25T06:42:36.369 INFO:teuthology.orchestra.run.smithi085.stderr:set pool 4 min_read_recency_for_promote to 2 2023-01-25T06:42:36.382 INFO:teuthology.run_tasks:Running task rados... 2023-01-25T06:42:36.395 INFO:tasks.rados:Beginning rados... 2023-01-25T06:42:36.396 DEBUG:teuthology.run_tasks:Unwinding manager rados 2023-01-25T06:42:36.426 INFO:tasks.rados:joining rados 2023-01-25T06:42:36.427 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2023-01-25T06:42:36.428 INFO:tasks.rados:starting run 0 out of 1 2023-01-25T06:42:36.429 DEBUG:teuthology.orchestra.run.smithi085:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op cache_flush 50 --op cache_try_flush 50 --op cache_evict 50 --op write_excl 50 --pool base 2023-01-25T06:42:36.461 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight read -> 100 2023-01-25T06:42:36.462 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight write -> 50 2023-01-25T06:42:36.462 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight delete -> 50 2023-01-25T06:42:36.462 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight snap_create -> 50 2023-01-25T06:42:36.463 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight snap_remove -> 50 2023-01-25T06:42:36.463 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight rollback -> 50 2023-01-25T06:42:36.463 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight copy_from -> 50 2023-01-25T06:42:36.463 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_flush -> 50 2023-01-25T06:42:36.463 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_try_flush -> 50 2023-01-25T06:42:36.464 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight cache_evict -> 50 2023-01-25T06:42:36.464 INFO:tasks.rados.rados.0.smithi085.stdout:adding op weight write_excl -> 50 2023-01-25T06:42:36.464 INFO:tasks.rados.rados.0.smithi085.stdout:ceph version 18.0.0-1963-g61996d73 (61996d73ab738798e4ee0055c86457f5c459da4a) reef (dev) 2023-01-25T06:42:36.464 INFO:tasks.rados.rados.0.smithi085.stdout:Configuration: 2023-01-25T06:42:36.464 INFO:tasks.rados.rados.0.smithi085.stdout: Number of operations: 4000 2023-01-25T06:42:36.465 INFO:tasks.rados.rados.0.smithi085.stdout: Number of objects: 500 2023-01-25T06:42:36.465 INFO:tasks.rados.rados.0.smithi085.stdout: Max in flight operations: 16 2023-01-25T06:42:36.465 INFO:tasks.rados.rados.0.smithi085.stdout: Object size (in bytes): 4000000 2023-01-25T06:42:36.465 INFO:tasks.rados.rados.0.smithi085.stdout: Write stride min: 400000 2023-01-25T06:42:36.465 INFO:tasks.rados.rados.0.smithi085.stdout: Write stride max: 800000 2023-01-25T06:42:37.369 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-01-25T06:42:37.368+0000 7fb73e7c8700 -1 osd.4 29 handle_osd_map injecting map crc failure 2023-01-25T06:42:37.370 INFO:tasks.rados.rados.0.smithi085.stdout:1: write initial oid 1 2023-01-25T06:42:37.370 INFO:tasks.rados.rados.0.smithi085.stdout:1: seq_num 0 ranges {416807=475249,1542129=474678} 2023-01-25T06:42:37.375 INFO:tasks.rados.rados.0.smithi085.stdout:1: writing smithi085112113-1 from 416807 to 892056 tid 1 2023-01-25T06:42:37.383 INFO:tasks.rados.rados.0.smithi085.stdout:1: writing smithi085112113-1 from 1542129 to 2016807 tid 2 2023-01-25T06:42:37.383 INFO:tasks.rados.rados.0.smithi085.stdout:2: write initial oid 2 2023-01-25T06:42:37.383 INFO:tasks.rados.rados.0.smithi085.stdout:2: seq_num 1 ranges {416807=475249,1542129=474678} 2023-01-25T06:42:37.387 INFO:tasks.rados.rados.0.smithi085.stdout:2: writing smithi085112113-2 from 416807 to 892056 tid 1 2023-01-25T06:42:37.393 INFO:tasks.ceph.osd.2.smithi085.stderr:2023-01-25T06:42:37.392+0000 7f743b996700 -1 osd.2 29 handle_osd_map injecting map crc failure 2023-01-25T06:42:37.394 INFO:tasks.rados.rados.0.smithi085.stdout:2: writing smithi085112113-2 from 1542129 to 2016807 tid 2 2023-01-25T06:42:37.394 INFO:tasks.rados.rados.0.smithi085.stdout:3: write initial oid 3 2023-01-25T06:42:37.394 INFO:tasks.rados.rados.0.smithi085.stdout:3: seq_num 2 ranges {433614=550498,1600611=433003} 2023-01-25T06:42:37.400 INFO:tasks.rados.rados.0.smithi085.stdout:3: writing smithi085112113-3 from 433614 to 984112 tid 1 2023-01-25T06:42:37.406 INFO:tasks.rados.rados.0.smithi085.stdout:3: writing smithi085112113-3 from 1600611 to 2033614 tid 2 2023-01-25T06:42:37.406 INFO:tasks.rados.rados.0.smithi085.stdout:4: write initial oid 4 2023-01-25T06:42:37.406 INFO:tasks.rados.rados.0.smithi085.stdout:4: seq_num 3 ranges {450421=625747,1659093=391328} 2023-01-25T06:42:37.413 INFO:tasks.rados.rados.0.smithi085.stdout:4: writing smithi085112113-4 from 450421 to 1076168 tid 1 2023-01-25T06:42:37.418 INFO:tasks.rados.rados.0.smithi085.stdout:4: writing smithi085112113-4 from 1659093 to 2050421 tid 2 2023-01-25T06:42:37.418 INFO:tasks.rados.rados.0.smithi085.stdout:5: write initial oid 5 2023-01-25T06:42:37.418 INFO:tasks.rados.rados.0.smithi085.stdout:5: seq_num 4 ranges {467228=700996,1717575=349653} 2023-01-25T06:42:37.424 INFO:tasks.rados.rados.0.smithi085.stdout:5: writing smithi085112113-5 from 467228 to 1168224 tid 1 2023-01-25T06:42:37.430 INFO:tasks.rados.rados.0.smithi085.stdout:5: writing smithi085112113-5 from 1717575 to 2067228 tid 2 2023-01-25T06:42:37.430 INFO:tasks.rados.rados.0.smithi085.stdout:6: write initial oid 6 2023-01-25T06:42:37.430 INFO:tasks.rados.rados.0.smithi085.stdout:6: seq_num 5 ranges {484035=776245,2059704=24331} 2023-01-25T06:42:37.437 INFO:tasks.rados.rados.0.smithi085.stdout:6: writing smithi085112113-6 from 484035 to 1260280 tid 1 2023-01-25T06:42:37.442 INFO:tasks.rados.rados.0.smithi085.stdout:6: writing smithi085112113-6 from 2059704 to 2084035 tid 2 2023-01-25T06:42:37.442 INFO:tasks.rados.rados.0.smithi085.stdout:7: write initial oid 7 2023-01-25T06:42:37.442 INFO:tasks.rados.rados.0.smithi085.stdout:7: seq_num 6 ranges {500842=451494,1718186=382656} 2023-01-25T06:42:37.447 INFO:tasks.rados.rados.0.smithi085.stdout:7: writing smithi085112113-7 from 500842 to 952336 tid 1 2023-01-25T06:42:37.455 INFO:tasks.rados.rados.0.smithi085.stdout:7: writing smithi085112113-7 from 1718186 to 2100842 tid 2 2023-01-25T06:42:37.455 INFO:tasks.rados.rados.0.smithi085.stdout:8: write initial oid 8 2023-01-25T06:42:37.455 INFO:tasks.rados.rados.0.smithi085.stdout:8: seq_num 7 ranges {517649=526743,1776668=340981} 2023-01-25T06:42:37.459 INFO:tasks.rados.rados.0.smithi085.stdout:8: writing smithi085112113-8 from 517649 to 1044392 tid 1 2023-01-25T06:42:37.466 INFO:tasks.rados.rados.0.smithi085.stdout:8: writing smithi085112113-8 from 1776668 to 2117649 tid 2 2023-01-25T06:42:37.466 INFO:tasks.rados.rados.0.smithi085.stdout:9: write initial oid 9 2023-01-25T06:42:37.466 INFO:tasks.rados.rados.0.smithi085.stdout:9: seq_num 8 ranges {534456=718345,1951503=182953} 2023-01-25T06:42:37.472 INFO:tasks.rados.rados.0.smithi085.stdout:9: writing smithi085112113-9 from 534456 to 1252801 tid 1 2023-01-25T06:42:37.477 INFO:tasks.rados.rados.0.smithi085.stdout:9: writing smithi085112113-9 from 1951503 to 2134456 tid 2 2023-01-25T06:42:37.477 INFO:tasks.rados.rados.0.smithi085.stdout:10: write initial oid 10 2023-01-25T06:42:37.478 INFO:tasks.rados.rados.0.smithi085.stdout:10: seq_num 9 ranges {551263=793594,1893632=257631} 2023-01-25T06:42:37.485 INFO:tasks.rados.rados.0.smithi085.stdout:10: writing smithi085112113-10 from 551263 to 1344857 tid 1 2023-01-25T06:42:37.489 INFO:tasks.rados.rados.0.smithi085.stdout:10: writing smithi085112113-10 from 1893632 to 2151263 tid 2 2023-01-25T06:42:37.489 INFO:tasks.rados.rados.0.smithi085.stdout:11: write initial oid 11 2023-01-25T06:42:37.490 INFO:tasks.rados.rados.0.smithi085.stdout:11: seq_num 10 ranges {568070=468843,1552114=615956} 2023-01-25T06:42:37.495 INFO:tasks.rados.rados.0.smithi085.stdout:11: writing smithi085112113-11 from 568070 to 1036913 tid 1 2023-01-25T06:42:37.502 INFO:tasks.rados.rados.0.smithi085.stdout:11: writing smithi085112113-11 from 1552114 to 2168070 tid 2 2023-01-25T06:42:37.502 INFO:tasks.rados.rados.0.smithi085.stdout:12: write initial oid 12 2023-01-25T06:42:37.502 INFO:tasks.rados.rados.0.smithi085.stdout:12: seq_num 11 ranges {584877=544092,1610596=562003} 2023-01-25T06:42:37.508 INFO:tasks.rados.rados.0.smithi085.stdout:12: writing smithi085112113-12 from 584877 to 1128969 tid 1 2023-01-25T06:42:37.514 INFO:tasks.rados.rados.0.smithi085.stdout:12: writing smithi085112113-12 from 1610596 to 2172599 tid 2 2023-01-25T06:42:37.514 INFO:tasks.rados.rados.0.smithi085.stdout:13: write initial oid 13 2023-01-25T06:42:37.514 INFO:tasks.rados.rados.0.smithi085.stdout:13: seq_num 12 ranges {601684=619341,1669078=532606} 2023-01-25T06:42:37.520 INFO:tasks.rados.rados.0.smithi085.stdout:13: writing smithi085112113-13 from 601684 to 1221025 tid 1 2023-01-25T06:42:37.526 INFO:tasks.rados.rados.0.smithi085.stdout:13: writing smithi085112113-13 from 1669078 to 2201684 tid 2 2023-01-25T06:42:37.527 INFO:tasks.rados.rados.0.smithi085.stdout:14: write initial oid 14 2023-01-25T06:42:37.527 INFO:tasks.rados.rados.0.smithi085.stdout:14: seq_num 13 ranges {618491=694590,2011207=207284} 2023-01-25T06:42:37.533 INFO:tasks.rados.rados.0.smithi085.stdout:14: writing smithi085112113-14 from 618491 to 1313081 tid 1 2023-01-25T06:42:37.539 INFO:tasks.rados.rados.0.smithi085.stdout:14: writing smithi085112113-14 from 2011207 to 2218491 tid 2 2023-01-25T06:42:37.539 INFO:tasks.rados.rados.0.smithi085.stdout:15: write initial oid 15 2023-01-25T06:42:37.540 INFO:tasks.rados.rados.0.smithi085.stdout:15: seq_num 14 ranges {635298=769839,2069689=165609} 2023-01-25T06:42:37.546 INFO:tasks.rados.rados.0.smithi085.stdout:15: writing smithi085112113-15 from 635298 to 1405137 tid 1 2023-01-25T06:42:37.551 INFO:tasks.rados.rados.0.smithi085.stdout:15: writing smithi085112113-15 from 2069689 to 2235298 tid 2 2023-01-25T06:42:37.551 INFO:tasks.rados.rados.0.smithi085.stdout:16: write initial oid 16 2023-01-25T06:42:37.552 INFO:tasks.rados.rados.0.smithi085.stdout:16: seq_num 15 ranges {652105=445088,1728171=452988} 2023-01-25T06:42:37.557 INFO:tasks.rados.rados.0.smithi085.stdout:16: writing smithi085112113-16 from 652105 to 1097193 tid 1 2023-01-25T06:42:37.564 INFO:tasks.rados.rados.0.smithi085.stdout:16: writing smithi085112113-16 from 1728171 to 2181159 tid 2 2023-01-25T06:42:37.564 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.564 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 1 to smithi085112113-1 2023-01-25T06:42:37.564 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 2 to smithi085112113-1 2023-01-25T06:42:37.565 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 3 to smithi085112113-1 2023-01-25T06:42:37.565 INFO:tasks.rados.rados.0.smithi085.stdout:1: finishing write tid 4 to smithi085112113-1 2023-01-25T06:42:37.565 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 0 to 1 2023-01-25T06:42:37.565 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 1 to 2 2023-01-25T06:42:37.565 INFO:tasks.rados.rados.0.smithi085.stdout:1: oid 1 updating version 2 to 3 2023-01-25T06:42:37.566 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 1 v 3 (ObjNum 0 snap 0 seq_num 0) dirty exists 2023-01-25T06:42:37.566 INFO:tasks.rados.rados.0.smithi085.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2023-01-25T06:42:37.566 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 1 to smithi085112113-2 2023-01-25T06:42:37.566 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 2 to smithi085112113-2 2023-01-25T06:42:37.566 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 3 to smithi085112113-2 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:2: finishing write tid 4 to smithi085112113-2 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 0 to 1 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 1 to 2 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:2: oid 2 updating version 2 to 3 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 2 v 3 (ObjNum 1 snap 0 seq_num 1) dirty exists 2023-01-25T06:42:37.567 INFO:tasks.rados.rados.0.smithi085.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2023-01-25T06:42:37.568 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 1 to smithi085112113-3 2023-01-25T06:42:37.568 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 2 to smithi085112113-3 2023-01-25T06:42:37.568 INFO:tasks.rados.rados.0.smithi085.stdout:1: done (15 left) 2023-01-25T06:42:37.568 INFO:tasks.rados.rados.0.smithi085.stdout:2: done (14 left) 2023-01-25T06:42:37.568 INFO:tasks.rados.rados.0.smithi085.stdout:17: write initial oid 17 2023-01-25T06:42:37.569 INFO:tasks.rados.rados.0.smithi085.stdout:17: seq_num 16 ranges {668912=636690,1903006=365906} 2023-01-25T06:42:37.570 INFO:tasks.rados.rados.0.smithi085.stdout:17: writing smithi085112113-17 from 668912 to 1305602 tid 1 2023-01-25T06:42:37.576 INFO:tasks.rados.rados.0.smithi085.stdout:17: writing smithi085112113-17 from 1903006 to 2268912 tid 2 2023-01-25T06:42:37.576 INFO:tasks.rados.rados.0.smithi085.stdout:18: write initial oid 18 2023-01-25T06:42:37.576 INFO:tasks.rados.rados.0.smithi085.stdout:18: seq_num 17 ranges {685719=711939,1845135=440584} 2023-01-25T06:42:37.583 INFO:tasks.rados.rados.0.smithi085.stdout:18: writing smithi085112113-18 from 685719 to 1397658 tid 1 2023-01-25T06:42:37.590 INFO:tasks.rados.rados.0.smithi085.stdout:18: writing smithi085112113-18 from 1845135 to 2285719 tid 2 2023-01-25T06:42:37.590 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.591 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 3 to smithi085112113-3 2023-01-25T06:42:37.591 INFO:tasks.rados.rados.0.smithi085.stdout:3: finishing write tid 4 to smithi085112113-3 2023-01-25T06:42:37.591 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 updating version 0 to 1 2023-01-25T06:42:37.591 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 updating version 1 to 2 2023-01-25T06:42:37.591 INFO:tasks.rados.rados.0.smithi085.stdout:3: oid 3 updating version 2 to 3 2023-01-25T06:42:37.592 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 3 v 3 (ObjNum 2 snap 0 seq_num 2) dirty exists 2023-01-25T06:42:37.592 INFO:tasks.rados.rados.0.smithi085.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2023-01-25T06:42:37.592 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 1 to smithi085112113-4 2023-01-25T06:42:37.592 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 1 to smithi085112113-5 2023-01-25T06:42:37.593 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 2 to smithi085112113-4 2023-01-25T06:42:37.593 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 3 to smithi085112113-4 2023-01-25T06:42:37.593 INFO:tasks.rados.rados.0.smithi085.stdout:4: finishing write tid 4 to smithi085112113-4 2023-01-25T06:42:37.593 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 updating version 0 to 5 2023-01-25T06:42:37.593 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 version 5 is already newer than 2 2023-01-25T06:42:37.594 INFO:tasks.rados.rados.0.smithi085.stdout:4: oid 4 updating version 5 to 6 2023-01-25T06:42:37.594 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 4 v 6 (ObjNum 3 snap 0 seq_num 3) dirty exists 2023-01-25T06:42:37.594 INFO:tasks.rados.rados.0.smithi085.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2023-01-25T06:42:37.594 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 2 to smithi085112113-5 2023-01-25T06:42:37.594 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 3 to smithi085112113-5 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:5: finishing write tid 4 to smithi085112113-5 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 updating version 0 to 1 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 updating version 1 to 3 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:5: oid 5 version 3 is already newer than 2 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 5 v 3 (ObjNum 4 snap 0 seq_num 4) dirty exists 2023-01-25T06:42:37.595 INFO:tasks.rados.rados.0.smithi085.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2023-01-25T06:42:37.596 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 1 to smithi085112113-6 2023-01-25T06:42:37.596 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 2 to smithi085112113-6 2023-01-25T06:42:37.596 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 3 to smithi085112113-6 2023-01-25T06:42:37.596 INFO:tasks.rados.rados.0.smithi085.stdout:6: finishing write tid 4 to smithi085112113-6 2023-01-25T06:42:37.596 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 updating version 0 to 5 2023-01-25T06:42:37.597 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 updating version 5 to 6 2023-01-25T06:42:37.597 INFO:tasks.rados.rados.0.smithi085.stdout:6: oid 6 version 6 is already newer than 2 2023-01-25T06:42:37.597 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 6 v 6 (ObjNum 5 snap 0 seq_num 5) dirty exists 2023-01-25T06:42:37.597 INFO:tasks.rados.rados.0.smithi085.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2023-01-25T06:42:37.597 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 1 to smithi085112113-7 2023-01-25T06:42:37.598 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 2 to smithi085112113-7 2023-01-25T06:42:37.598 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 3 to smithi085112113-7 2023-01-25T06:42:37.598 INFO:tasks.rados.rados.0.smithi085.stdout:7: finishing write tid 4 to smithi085112113-7 2023-01-25T06:42:37.598 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 updating version 0 to 3 2023-01-25T06:42:37.598 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 updating version 3 to 9 2023-01-25T06:42:37.599 INFO:tasks.rados.rados.0.smithi085.stdout:7: oid 7 version 9 is already newer than 8 2023-01-25T06:42:37.599 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 7 v 9 (ObjNum 6 snap 0 seq_num 6) dirty exists 2023-01-25T06:42:37.599 INFO:tasks.rados.rados.0.smithi085.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2023-01-25T06:42:37.599 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 1 to smithi085112113-8 2023-01-25T06:42:37.599 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 1 to smithi085112113-9 2023-01-25T06:42:37.600 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 2 to smithi085112113-8 2023-01-25T06:42:37.600 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 3 to smithi085112113-8 2023-01-25T06:42:37.600 INFO:tasks.rados.rados.0.smithi085.stdout:8: finishing write tid 4 to smithi085112113-8 2023-01-25T06:42:37.600 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 0 to 3 2023-01-25T06:42:37.600 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 3 to 8 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:8: oid 8 updating version 8 to 9 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 8 v 9 (ObjNum 7 snap 0 seq_num 7) dirty exists 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 2 to smithi085112113-9 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 3 to smithi085112113-9 2023-01-25T06:42:37.601 INFO:tasks.rados.rados.0.smithi085.stdout:3: done (15 left) 2023-01-25T06:42:37.602 INFO:tasks.rados.rados.0.smithi085.stdout:4: done (14 left) 2023-01-25T06:42:37.602 INFO:tasks.rados.rados.0.smithi085.stdout:5: done (13 left) 2023-01-25T06:42:37.602 INFO:tasks.rados.rados.0.smithi085.stdout:6: done (12 left) 2023-01-25T06:42:37.602 INFO:tasks.rados.rados.0.smithi085.stdout:7: done (11 left) 2023-01-25T06:42:37.602 INFO:tasks.rados.rados.0.smithi085.stdout:8: done (10 left) 2023-01-25T06:42:37.603 INFO:tasks.rados.rados.0.smithi085.stdout:19: write initial oid 19 2023-01-25T06:42:37.603 INFO:tasks.rados.rados.0.smithi085.stdout:19: seq_num 18 ranges {702526=787188,1903617=398909} 2023-01-25T06:42:37.604 INFO:tasks.rados.rados.0.smithi085.stdout:19: writing smithi085112113-19 from 702526 to 1489714 tid 1 2023-01-25T06:42:37.604 INFO:tasks.rados.rados.0.smithi085.stdout:19: writing smithi085112113-19 from 1903617 to 2302526 tid 2 2023-01-25T06:42:37.604 INFO:tasks.rados.rados.0.smithi085.stdout:20: write initial oid 20 2023-01-25T06:42:37.604 INFO:tasks.rados.rados.0.smithi085.stdout:20: seq_num 19 ranges {719333=462437,1962099=357234} 2023-01-25T06:42:37.608 INFO:tasks.rados.rados.0.smithi085.stdout:20: writing smithi085112113-20 from 719333 to 1181770 tid 1 2023-01-25T06:42:37.615 INFO:tasks.rados.rados.0.smithi085.stdout:20: writing smithi085112113-20 from 1962099 to 2319333 tid 2 2023-01-25T06:42:37.615 INFO:tasks.rados.rados.0.smithi085.stdout:21: write initial oid 21 2023-01-25T06:42:37.616 INFO:tasks.rados.rados.0.smithi085.stdout:21: seq_num 20 ranges {736140=537686,2020581=315559} 2023-01-25T06:42:37.622 INFO:tasks.rados.rados.0.smithi085.stdout:21: writing smithi085112113-21 from 736140 to 1273826 tid 1 2023-01-25T06:42:37.628 INFO:tasks.rados.rados.0.smithi085.stdout:21: writing smithi085112113-21 from 2020581 to 2336140 tid 2 2023-01-25T06:42:37.628 INFO:tasks.rados.rados.0.smithi085.stdout:22: write initial oid 22 2023-01-25T06:42:37.629 INFO:tasks.rados.rados.0.smithi085.stdout:22: seq_num 21 ranges {752947=612935,1962710=390237} 2023-01-25T06:42:37.636 INFO:tasks.rados.rados.0.smithi085.stdout:22: writing smithi085112113-22 from 752947 to 1365882 tid 1 2023-01-25T06:42:37.641 INFO:tasks.rados.rados.0.smithi085.stdout:22: writing smithi085112113-22 from 1962710 to 2352947 tid 2 2023-01-25T06:42:37.642 INFO:tasks.rados.rados.0.smithi085.stdout:23: write initial oid 23 2023-01-25T06:42:37.642 INFO:tasks.rados.rados.0.smithi085.stdout:23: seq_num 22 ranges {769754=688184,2021192=348562} 2023-01-25T06:42:37.649 INFO:tasks.rados.rados.0.smithi085.stdout:23: writing smithi085112113-23 from 769754 to 1457938 tid 1 2023-01-25T06:42:37.655 INFO:tasks.rados.rados.0.smithi085.stdout:23: writing smithi085112113-23 from 2021192 to 2369754 tid 2 2023-01-25T06:42:37.655 INFO:tasks.rados.rados.0.smithi085.stdout:24: write initial oid 24 2023-01-25T06:42:37.655 INFO:tasks.rados.rados.0.smithi085.stdout:24: seq_num 23 ranges {786561=479786,1796027=467664} 2023-01-25T06:42:37.661 INFO:tasks.rados.rados.0.smithi085.stdout:24: writing smithi085112113-24 from 786561 to 1266347 tid 1 2023-01-25T06:42:37.667 INFO:tasks.rados.rados.0.smithi085.stdout:24: writing smithi085112113-24 from 1796027 to 2263691 tid 2 2023-01-25T06:42:37.668 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.668 INFO:tasks.rados.rados.0.smithi085.stdout:9: finishing write tid 4 to smithi085112113-9 2023-01-25T06:42:37.668 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 updating version 0 to 6 2023-01-25T06:42:37.668 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 version 6 is already newer than 2 2023-01-25T06:42:37.669 INFO:tasks.rados.rados.0.smithi085.stdout:9: oid 9 version 6 is already newer than 5 2023-01-25T06:42:37.669 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 9 v 6 (ObjNum 8 snap 0 seq_num 8) dirty exists 2023-01-25T06:42:37.669 INFO:tasks.rados.rados.0.smithi085.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2023-01-25T06:42:37.669 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 1 to smithi085112113-10 2023-01-25T06:42:37.669 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 2 to smithi085112113-10 2023-01-25T06:42:37.670 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 3 to smithi085112113-10 2023-01-25T06:42:37.670 INFO:tasks.rados.rados.0.smithi085.stdout:10: finishing write tid 4 to smithi085112113-10 2023-01-25T06:42:37.670 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 updating version 0 to 4 2023-01-25T06:42:37.670 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 updating version 4 to 11 2023-01-25T06:42:37.670 INFO:tasks.rados.rados.0.smithi085.stdout:10: oid 10 updating version 11 to 12 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 10 v 12 (ObjNum 9 snap 0 seq_num 9) dirty exists 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 1 to smithi085112113-11 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:9: done (15 left) 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:10: done (14 left) 2023-01-25T06:42:37.671 INFO:tasks.rados.rados.0.smithi085.stdout:25: write initial oid 25 2023-01-25T06:42:37.672 INFO:tasks.rados.rados.0.smithi085.stdout:25: seq_num 24 ranges {403368=555035,1454509=727675} 2023-01-25T06:42:37.673 INFO:tasks.rados.rados.0.smithi085.stdout:25: writing smithi085112113-25 from 403368 to 958403 tid 1 2023-01-25T06:42:37.680 INFO:tasks.rados.rados.0.smithi085.stdout:25: writing smithi085112113-25 from 1454509 to 2182184 tid 2 2023-01-25T06:42:37.680 INFO:tasks.rados.rados.0.smithi085.stdout:26: write initial oid 26 2023-01-25T06:42:37.680 INFO:tasks.rados.rados.0.smithi085.stdout:26: seq_num 25 ranges {420175=630284,1796638=471333} 2023-01-25T06:42:37.687 INFO:tasks.rados.rados.0.smithi085.stdout:26: writing smithi085112113-26 from 420175 to 1050459 tid 1 2023-01-25T06:42:37.692 INFO:tasks.rados.rados.0.smithi085.stdout:26: writing smithi085112113-26 from 1796638 to 2267971 tid 2 2023-01-25T06:42:37.693 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.693 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 2 to smithi085112113-11 2023-01-25T06:42:37.693 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 3 to smithi085112113-11 2023-01-25T06:42:37.693 INFO:tasks.rados.rados.0.smithi085.stdout:11: finishing write tid 4 to smithi085112113-11 2023-01-25T06:42:37.693 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 updating version 0 to 3 2023-01-25T06:42:37.694 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 updating version 3 to 9 2023-01-25T06:42:37.694 INFO:tasks.rados.rados.0.smithi085.stdout:11: oid 11 version 9 is already newer than 8 2023-01-25T06:42:37.694 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 11 v 9 (ObjNum 10 snap 0 seq_num 10) dirty exists 2023-01-25T06:42:37.694 INFO:tasks.rados.rados.0.smithi085.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2023-01-25T06:42:37.694 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 1 to smithi085112113-12 2023-01-25T06:42:37.695 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 2 to smithi085112113-12 2023-01-25T06:42:37.695 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 3 to smithi085112113-12 2023-01-25T06:42:37.695 INFO:tasks.rados.rados.0.smithi085.stdout:11: done (15 left) 2023-01-25T06:42:37.695 INFO:tasks.rados.rados.0.smithi085.stdout:27: write initial oid 27 2023-01-25T06:42:37.695 INFO:tasks.rados.rados.0.smithi085.stdout:27: seq_num 26 ranges {436982=705533,1855120=581862} 2023-01-25T06:42:37.698 INFO:tasks.rados.rados.0.smithi085.stdout:27: writing smithi085112113-27 from 436982 to 1142515 tid 1 2023-01-25T06:42:37.707 INFO:tasks.rados.rados.0.smithi085.stdout:27: writing smithi085112113-27 from 1855120 to 2436982 tid 2 2023-01-25T06:42:37.707 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.707 INFO:tasks.rados.rados.0.smithi085.stdout:12: finishing write tid 4 to smithi085112113-12 2023-01-25T06:42:37.707 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 updating version 0 to 14 2023-01-25T06:42:37.708 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 updating version 14 to 15 2023-01-25T06:42:37.708 INFO:tasks.rados.rados.0.smithi085.stdout:12: oid 12 version 15 is already newer than 5 2023-01-25T06:42:37.708 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 12 v 15 (ObjNum 11 snap 0 seq_num 11) dirty exists 2023-01-25T06:42:37.708 INFO:tasks.rados.rados.0.smithi085.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2023-01-25T06:42:37.708 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 1 to smithi085112113-13 2023-01-25T06:42:37.709 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 2 to smithi085112113-13 2023-01-25T06:42:37.709 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 3 to smithi085112113-13 2023-01-25T06:42:37.709 INFO:tasks.rados.rados.0.smithi085.stdout:13: finishing write tid 4 to smithi085112113-13 2023-01-25T06:42:37.709 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 0 to 6 2023-01-25T06:42:37.709 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 6 to 17 2023-01-25T06:42:37.710 INFO:tasks.rados.rados.0.smithi085.stdout:13: oid 13 updating version 17 to 18 2023-01-25T06:42:37.710 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 13 v 18 (ObjNum 12 snap 0 seq_num 12) dirty exists 2023-01-25T06:42:37.710 INFO:tasks.rados.rados.0.smithi085.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2023-01-25T06:42:37.710 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 1 to smithi085112113-14 2023-01-25T06:42:37.710 INFO:tasks.rados.rados.0.smithi085.stdout:12: done (15 left) 2023-01-25T06:42:37.711 INFO:tasks.rados.rados.0.smithi085.stdout:13: done (14 left) 2023-01-25T06:42:37.711 INFO:tasks.rados.rados.0.smithi085.stdout:28: write initial oid 28 2023-01-25T06:42:37.711 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 2 to smithi085112113-14 2023-01-25T06:42:37.711 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 3 to smithi085112113-14 2023-01-25T06:42:37.711 INFO:tasks.rados.rados.0.smithi085.stdout:14: finishing write tid 4 to smithi085112113-14 2023-01-25T06:42:37.712 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 updating version 0 to 11 2023-01-25T06:42:37.712 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 updating version 11 to 12 2023-01-25T06:42:37.712 INFO:tasks.rados.rados.0.smithi085.stdout:14: oid 14 version 12 is already newer than 4 2023-01-25T06:42:37.712 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 14 v 12 (ObjNum 13 snap 0 seq_num 13) dirty exists 2023-01-25T06:42:37.712 INFO:tasks.rados.rados.0.smithi085.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2023-01-25T06:42:37.713 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 1 to smithi085112113-15 2023-01-25T06:42:37.713 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 2 to smithi085112113-15 2023-01-25T06:42:37.713 INFO:tasks.rados.rados.0.smithi085.stdout:28: seq_num 27 ranges {453789=780782,1913602=475002} 2023-01-25T06:42:37.713 INFO:tasks.rados.rados.0.smithi085.stdout:28: writing smithi085112113-28 from 453789 to 1234571 tid 1 2023-01-25T06:42:37.720 INFO:tasks.rados.rados.0.smithi085.stdout:28: writing smithi085112113-28 from 1913602 to 2388604 tid 2 2023-01-25T06:42:37.720 INFO:tasks.rados.rados.0.smithi085.stdout:14: done (14 left) 2023-01-25T06:42:37.720 INFO:tasks.rados.rados.0.smithi085.stdout:29: write initial oid 29 2023-01-25T06:42:37.720 INFO:tasks.rados.rados.0.smithi085.stdout:29: seq_num 28 ranges {470596=456031,1572084=618660} 2023-01-25T06:42:37.724 INFO:tasks.rados.rados.0.smithi085.stdout:29: writing smithi085112113-29 from 470596 to 926627 tid 1 2023-01-25T06:42:37.731 INFO:tasks.rados.rados.0.smithi085.stdout:29: writing smithi085112113-29 from 1572084 to 2190744 tid 2 2023-01-25T06:42:37.731 INFO:tasks.rados.rados.0.smithi085.stdout:30: write initial oid 30 2023-01-25T06:42:37.732 INFO:tasks.rados.rados.0.smithi085.stdout:30: seq_num 29 ranges {487403=531280,1514213=478671} 2023-01-25T06:42:37.737 INFO:tasks.rados.rados.0.smithi085.stdout:30: writing smithi085112113-30 from 487403 to 1018683 tid 1 2023-01-25T06:42:37.743 INFO:tasks.rados.rados.0.smithi085.stdout:30: writing smithi085112113-30 from 1514213 to 1992884 tid 2 2023-01-25T06:42:37.743 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.743 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 3 to smithi085112113-15 2023-01-25T06:42:37.743 INFO:tasks.rados.rados.0.smithi085.stdout:15: finishing write tid 4 to smithi085112113-15 2023-01-25T06:42:37.744 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 updating version 0 to 5 2023-01-25T06:42:37.744 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 updating version 5 to 6 2023-01-25T06:42:37.744 INFO:tasks.rados.rados.0.smithi085.stdout:15: oid 15 version 6 is already newer than 2 2023-01-25T06:42:37.744 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 15 v 6 (ObjNum 14 snap 0 seq_num 14) dirty exists 2023-01-25T06:42:37.744 INFO:tasks.rados.rados.0.smithi085.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2023-01-25T06:42:37.745 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 1 to smithi085112113-16 2023-01-25T06:42:37.745 INFO:tasks.rados.rados.0.smithi085.stdout:15: done (15 left) 2023-01-25T06:42:37.745 INFO:tasks.rados.rados.0.smithi085.stdout:31: write initial oid 31 2023-01-25T06:42:37.747 INFO:tasks.rados.rados.0.smithi085.stdout:31: seq_num 30 ranges {504210=606529,1572695=622329} 2023-01-25T06:42:37.748 INFO:tasks.rados.rados.0.smithi085.stdout:31: writing smithi085112113-31 from 504210 to 1110739 tid 1 2023-01-25T06:42:37.755 INFO:tasks.rados.rados.0.smithi085.stdout:31: writing smithi085112113-31 from 1572695 to 2195024 tid 2 2023-01-25T06:42:37.755 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.755 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 2 to smithi085112113-16 2023-01-25T06:42:37.756 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 3 to smithi085112113-16 2023-01-25T06:42:37.756 INFO:tasks.rados.rados.0.smithi085.stdout:16: finishing write tid 4 to smithi085112113-16 2023-01-25T06:42:37.756 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 updating version 0 to 7 2023-01-25T06:42:37.756 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 updating version 7 to 20 2023-01-25T06:42:37.757 INFO:tasks.rados.rados.0.smithi085.stdout:16: oid 16 updating version 20 to 21 2023-01-25T06:42:37.757 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 16 v 21 (ObjNum 15 snap 0 seq_num 15) dirty exists 2023-01-25T06:42:37.757 INFO:tasks.rados.rados.0.smithi085.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2023-01-25T06:42:37.757 INFO:tasks.rados.rados.0.smithi085.stdout:16: done (15 left) 2023-01-25T06:42:37.757 INFO:tasks.rados.rados.0.smithi085.stdout:32: write initial oid 32 2023-01-25T06:42:37.758 INFO:tasks.rados.rados.0.smithi085.stdout:32: seq_num 31 ranges {521017=798131,1747530=482340} 2023-01-25T06:42:37.762 INFO:tasks.rados.rados.0.smithi085.stdout:32: writing smithi085112113-32 from 521017 to 1319148 tid 1 2023-01-25T06:42:37.768 INFO:tasks.rados.rados.0.smithi085.stdout:32: writing smithi085112113-32 from 1747530 to 2229870 tid 2 2023-01-25T06:42:37.768 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.768 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 1 to smithi085112113-17 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 2 to smithi085112113-17 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 3 to smithi085112113-17 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: finishing write tid 4 to smithi085112113-17 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 updating version 0 to 15 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 version 15 is already newer than 14 2023-01-25T06:42:37.769 INFO:tasks.rados.rados.0.smithi085.stdout:17: oid 17 version 15 is already newer than 5 2023-01-25T06:42:37.770 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 17 v 15 (ObjNum 16 snap 0 seq_num 16) dirty exists 2023-01-25T06:42:37.770 INFO:tasks.rados.rados.0.smithi085.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2023-01-25T06:42:37.770 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 1 to smithi085112113-18 2023-01-25T06:42:37.770 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 2 to smithi085112113-18 2023-01-25T06:42:37.772 INFO:tasks.rados.rados.0.smithi085.stdout:17: done (15 left) 2023-01-25T06:42:37.772 INFO:tasks.rados.rados.0.smithi085.stdout:33: write initial oid 33 2023-01-25T06:42:37.773 INFO:tasks.rados.rados.0.smithi085.stdout:33: seq_num 32 ranges {537824=473380,1806012=625998} 2023-01-25T06:42:37.773 INFO:tasks.rados.rados.0.smithi085.stdout:33: writing smithi085112113-33 from 537824 to 1011204 tid 1 2023-01-25T06:42:37.783 INFO:tasks.rados.rados.0.smithi085.stdout:33: writing smithi085112113-33 from 1806012 to 2432010 tid 2 2023-01-25T06:42:37.784 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.784 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 3 to smithi085112113-18 2023-01-25T06:42:37.784 INFO:tasks.rados.rados.0.smithi085.stdout:18: finishing write tid 4 to smithi085112113-18 2023-01-25T06:42:37.784 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 updating version 0 to 8 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 updating version 8 to 9 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:18: oid 18 version 9 is already newer than 3 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 18 v 9 (ObjNum 17 snap 0 seq_num 17) dirty exists 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 1 to smithi085112113-19 2023-01-25T06:42:37.785 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 1 to smithi085112113-20 2023-01-25T06:42:37.786 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 2 to smithi085112113-19 2023-01-25T06:42:37.786 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 3 to smithi085112113-19 2023-01-25T06:42:37.786 INFO:tasks.rados.rados.0.smithi085.stdout:19: finishing write tid 4 to smithi085112113-19 2023-01-25T06:42:37.786 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 updating version 0 to 8 2023-01-25T06:42:37.786 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 updating version 8 to 23 2023-01-25T06:42:37.787 INFO:tasks.rados.rados.0.smithi085.stdout:19: oid 19 updating version 23 to 24 2023-01-25T06:42:37.787 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 19 v 24 (ObjNum 18 snap 0 seq_num 18) dirty exists 2023-01-25T06:42:37.787 INFO:tasks.rados.rados.0.smithi085.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2023-01-25T06:42:37.787 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 2 to smithi085112113-20 2023-01-25T06:42:37.787 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 3 to smithi085112113-20 2023-01-25T06:42:37.788 INFO:tasks.rados.rados.0.smithi085.stdout:20: finishing write tid 4 to smithi085112113-20 2023-01-25T06:42:37.788 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 updating version 0 to 12 2023-01-25T06:42:37.788 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 version 12 is already newer than 11 2023-01-25T06:42:37.788 INFO:tasks.rados.rados.0.smithi085.stdout:20: oid 20 version 12 is already newer than 4 2023-01-25T06:42:37.789 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 20 v 12 (ObjNum 19 snap 0 seq_num 19) dirty exists 2023-01-25T06:42:37.789 INFO:tasks.rados.rados.0.smithi085.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2023-01-25T06:42:37.789 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 1 to smithi085112113-21 2023-01-25T06:42:37.789 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 2 to smithi085112113-21 2023-01-25T06:42:37.789 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 3 to smithi085112113-21 2023-01-25T06:42:37.790 INFO:tasks.rados.rados.0.smithi085.stdout:21: finishing write tid 4 to smithi085112113-21 2023-01-25T06:42:37.790 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 updating version 0 to 15 2023-01-25T06:42:37.790 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 version 15 is already newer than 5 2023-01-25T06:42:37.790 INFO:tasks.rados.rados.0.smithi085.stdout:21: oid 21 version 15 is already newer than 14 2023-01-25T06:42:37.791 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 21 v 15 (ObjNum 20 snap 0 seq_num 20) dirty exists 2023-01-25T06:42:37.791 INFO:tasks.rados.rados.0.smithi085.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2023-01-25T06:42:37.791 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 1 to smithi085112113-22 2023-01-25T06:42:37.791 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 2 to smithi085112113-22 2023-01-25T06:42:37.791 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 3 to smithi085112113-22 2023-01-25T06:42:37.792 INFO:tasks.rados.rados.0.smithi085.stdout:22: finishing write tid 4 to smithi085112113-22 2023-01-25T06:42:37.792 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 updating version 0 to 12 2023-01-25T06:42:37.792 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 version 12 is already newer than 4 2023-01-25T06:42:37.792 INFO:tasks.rados.rados.0.smithi085.stdout:22: oid 22 version 12 is already newer than 11 2023-01-25T06:42:37.792 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 22 v 12 (ObjNum 21 snap 0 seq_num 21) dirty exists 2023-01-25T06:42:37.793 INFO:tasks.rados.rados.0.smithi085.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2023-01-25T06:42:37.793 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 1 to smithi085112113-23 2023-01-25T06:42:37.793 INFO:tasks.rados.rados.0.smithi085.stdout:18: done (15 left) 2023-01-25T06:42:37.793 INFO:tasks.rados.rados.0.smithi085.stdout:19: done (14 left) 2023-01-25T06:42:37.793 INFO:tasks.rados.rados.0.smithi085.stdout:20: done (13 left) 2023-01-25T06:42:37.794 INFO:tasks.rados.rados.0.smithi085.stdout:21: done (12 left) 2023-01-25T06:42:37.794 INFO:tasks.rados.rados.0.smithi085.stdout:22: done (11 left) 2023-01-25T06:42:37.794 INFO:tasks.rados.rados.0.smithi085.stdout:34: write initial oid 34 2023-01-25T06:42:37.794 INFO:tasks.rados.rados.0.smithi085.stdout:34: seq_num 33 ranges {554631=548629,1748141=486009} 2023-01-25T06:42:37.795 INFO:tasks.rados.rados.0.smithi085.stdout:34: writing smithi085112113-34 from 554631 to 1103260 tid 1 2023-01-25T06:42:37.795 INFO:tasks.rados.rados.0.smithi085.stdout:34: writing smithi085112113-34 from 1748141 to 2234150 tid 2 2023-01-25T06:42:37.795 INFO:tasks.rados.rados.0.smithi085.stdout:35: write initial oid 35 2023-01-25T06:42:37.796 INFO:tasks.rados.rados.0.smithi085.stdout:35: seq_num 34 ranges {571438=623878,1806623=629667} 2023-01-25T06:42:37.801 INFO:tasks.rados.rados.0.smithi085.stdout:35: writing smithi085112113-35 from 571438 to 1195316 tid 1 2023-01-25T06:42:37.808 INFO:tasks.rados.rados.0.smithi085.stdout:35: writing smithi085112113-35 from 1806623 to 2436290 tid 2 2023-01-25T06:42:37.808 INFO:tasks.rados.rados.0.smithi085.stdout:36: write initial oid 36 2023-01-25T06:42:37.808 INFO:tasks.rados.rados.0.smithi085.stdout:36: seq_num 35 ranges {588245=699127,1865105=489678} 2023-01-25T06:42:37.815 INFO:tasks.rados.rados.0.smithi085.stdout:36: writing smithi085112113-36 from 588245 to 1287372 tid 1 2023-01-25T06:42:37.821 INFO:tasks.rados.rados.0.smithi085.stdout:36: writing smithi085112113-36 from 1865105 to 2354783 tid 2 2023-01-25T06:42:37.821 INFO:tasks.rados.rados.0.smithi085.stdout:37: write initial oid 37 2023-01-25T06:42:37.821 INFO:tasks.rados.rados.0.smithi085.stdout:37: seq_num 36 ranges {605052=774376,1923587=633336} 2023-01-25T06:42:37.828 INFO:tasks.rados.rados.0.smithi085.stdout:37: writing smithi085112113-37 from 605052 to 1379428 tid 1 2023-01-25T06:42:37.835 INFO:tasks.rados.rados.0.smithi085.stdout:37: writing smithi085112113-37 from 1923587 to 2556923 tid 2 2023-01-25T06:42:37.835 INFO:tasks.rados.rados.0.smithi085.stdout:38: write initial oid 38 2023-01-25T06:42:37.836 INFO:tasks.rados.rados.0.smithi085.stdout:38: seq_num 37 ranges {621859=449625,1865716=756143} 2023-01-25T06:42:37.842 INFO:tasks.rados.rados.0.smithi085.stdout:38: writing smithi085112113-38 from 621859 to 1071484 tid 1 2023-01-25T06:42:37.851 INFO:tasks.rados.rados.0.smithi085.stdout:38: writing smithi085112113-38 from 1865716 to 2621859 tid 2 2023-01-25T06:42:37.851 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.851 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 1 to smithi085112113-24 2023-01-25T06:42:37.852 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 2 to smithi085112113-23 2023-01-25T06:42:37.852 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 3 to smithi085112113-23 2023-01-25T06:42:37.852 INFO:tasks.rados.rados.0.smithi085.stdout:23: finishing write tid 4 to smithi085112113-23 2023-01-25T06:42:37.852 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 updating version 0 to 26 2023-01-25T06:42:37.852 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 version 26 is already newer than 9 2023-01-25T06:42:37.853 INFO:tasks.rados.rados.0.smithi085.stdout:23: oid 23 updating version 26 to 27 2023-01-25T06:42:37.853 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 23 v 27 (ObjNum 22 snap 0 seq_num 22) dirty exists 2023-01-25T06:42:37.853 INFO:tasks.rados.rados.0.smithi085.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2023-01-25T06:42:37.853 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 2 to smithi085112113-24 2023-01-25T06:42:37.853 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 3 to smithi085112113-24 2023-01-25T06:42:37.854 INFO:tasks.rados.rados.0.smithi085.stdout:23: done (15 left) 2023-01-25T06:42:37.854 INFO:tasks.rados.rados.0.smithi085.stdout:39: write initial oid 39 2023-01-25T06:42:37.854 INFO:tasks.rados.rados.0.smithi085.stdout:39: seq_num 38 ranges {638666=524874,1924198=637005} 2023-01-25T06:42:37.857 INFO:tasks.rados.rados.0.smithi085.stdout:39: writing smithi085112113-39 from 638666 to 1163540 tid 1 2023-01-25T06:42:37.865 INFO:tasks.rados.rados.0.smithi085.stdout:39: writing smithi085112113-39 from 1924198 to 2561203 tid 2 2023-01-25T06:42:37.865 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.866 INFO:tasks.rados.rados.0.smithi085.stdout:24: finishing write tid 4 to smithi085112113-24 2023-01-25T06:42:37.866 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 updating version 0 to 15 2023-01-25T06:42:37.866 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 version 15 is already newer than 5 2023-01-25T06:42:37.866 INFO:tasks.rados.rados.0.smithi085.stdout:24: oid 24 version 15 is already newer than 14 2023-01-25T06:42:37.866 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 24 v 15 (ObjNum 23 snap 0 seq_num 23) dirty exists 2023-01-25T06:42:37.867 INFO:tasks.rados.rados.0.smithi085.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2023-01-25T06:42:37.867 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 1 to smithi085112113-25 2023-01-25T06:42:37.867 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 2 to smithi085112113-25 2023-01-25T06:42:37.867 INFO:tasks.rados.rados.0.smithi085.stdout:24: done (15 left) 2023-01-25T06:42:37.868 INFO:tasks.rados.rados.0.smithi085.stdout:40: write initial oid 40 2023-01-25T06:42:37.868 INFO:tasks.rados.rados.0.smithi085.stdout:40: seq_num 39 ranges {655473=716476,2099033=556440} 2023-01-25T06:42:37.872 INFO:tasks.rados.rados.0.smithi085.stdout:40: writing smithi085112113-40 from 655473 to 1371949 tid 1 2023-01-25T06:42:37.880 INFO:tasks.rados.rados.0.smithi085.stdout:40: writing smithi085112113-40 from 2099033 to 2655473 tid 2 2023-01-25T06:42:37.881 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.881 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 3 to smithi085112113-25 2023-01-25T06:42:37.881 INFO:tasks.rados.rados.0.smithi085.stdout:25: finishing write tid 4 to smithi085112113-25 2023-01-25T06:42:37.881 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 updating version 0 to 10 2023-01-25T06:42:37.882 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 updating version 10 to 11 2023-01-25T06:42:37.882 INFO:tasks.rados.rados.0.smithi085.stdout:25: oid 25 updating version 11 to 12 2023-01-25T06:42:37.882 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 25 v 12 (ObjNum 24 snap 0 seq_num 24) dirty exists 2023-01-25T06:42:37.882 INFO:tasks.rados.rados.0.smithi085.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2023-01-25T06:42:37.882 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 1 to smithi085112113-26 2023-01-25T06:42:37.883 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 2 to smithi085112113-26 2023-01-25T06:42:37.883 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 3 to smithi085112113-26 2023-01-25T06:42:37.883 INFO:tasks.rados.rados.0.smithi085.stdout:26: finishing write tid 4 to smithi085112113-26 2023-01-25T06:42:37.883 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 updating version 0 to 13 2023-01-25T06:42:37.884 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 updating version 13 to 15 2023-01-25T06:42:37.884 INFO:tasks.rados.rados.0.smithi085.stdout:26: oid 26 version 15 is already newer than 14 2023-01-25T06:42:37.884 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 26 v 15 (ObjNum 25 snap 0 seq_num 25) dirty exists 2023-01-25T06:42:37.884 INFO:tasks.rados.rados.0.smithi085.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2023-01-25T06:42:37.885 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 1 to smithi085112113-27 2023-01-25T06:42:37.885 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 2 to smithi085112113-27 2023-01-25T06:42:37.885 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 3 to smithi085112113-27 2023-01-25T06:42:37.886 INFO:tasks.rados.rados.0.smithi085.stdout:27: finishing write tid 4 to smithi085112113-27 2023-01-25T06:42:37.886 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 updating version 0 to 6 2023-01-25T06:42:37.886 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 updating version 6 to 18 2023-01-25T06:42:37.886 INFO:tasks.rados.rados.0.smithi085.stdout:27: oid 27 version 18 is already newer than 17 2023-01-25T06:42:37.886 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 27 v 18 (ObjNum 26 snap 0 seq_num 26) dirty exists 2023-01-25T06:42:37.887 INFO:tasks.rados.rados.0.smithi085.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2023-01-25T06:42:37.887 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 1 to smithi085112113-28 2023-01-25T06:42:37.887 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 2 to smithi085112113-28 2023-01-25T06:42:37.887 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 3 to smithi085112113-28 2023-01-25T06:42:37.887 INFO:tasks.rados.rados.0.smithi085.stdout:28: finishing write tid 4 to smithi085112113-28 2023-01-25T06:42:37.888 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 updating version 0 to 16 2023-01-25T06:42:37.888 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 updating version 16 to 18 2023-01-25T06:42:37.888 INFO:tasks.rados.rados.0.smithi085.stdout:28: oid 28 version 18 is already newer than 17 2023-01-25T06:42:37.888 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 28 v 18 (ObjNum 27 snap 0 seq_num 27) dirty exists 2023-01-25T06:42:37.888 INFO:tasks.rados.rados.0.smithi085.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2023-01-25T06:42:37.889 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 1 to smithi085112113-29 2023-01-25T06:42:37.889 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 2 to smithi085112113-29 2023-01-25T06:42:37.889 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 3 to smithi085112113-29 2023-01-25T06:42:37.889 INFO:tasks.rados.rados.0.smithi085.stdout:29: finishing write tid 4 to smithi085112113-29 2023-01-25T06:42:37.890 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 updating version 0 to 19 2023-01-25T06:42:37.890 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 updating version 19 to 20 2023-01-25T06:42:37.890 INFO:tasks.rados.rados.0.smithi085.stdout:29: oid 29 updating version 20 to 21 2023-01-25T06:42:37.890 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 29 v 21 (ObjNum 28 snap 0 seq_num 28) dirty exists 2023-01-25T06:42:37.890 INFO:tasks.rados.rados.0.smithi085.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2023-01-25T06:42:37.891 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 1 to smithi085112113-30 2023-01-25T06:42:37.891 INFO:tasks.rados.rados.0.smithi085.stdout:25: done (15 left) 2023-01-25T06:42:37.891 INFO:tasks.rados.rados.0.smithi085.stdout:26: done (14 left) 2023-01-25T06:42:37.891 INFO:tasks.rados.rados.0.smithi085.stdout:27: done (13 left) 2023-01-25T06:42:37.892 INFO:tasks.rados.rados.0.smithi085.stdout:28: done (12 left) 2023-01-25T06:42:37.892 INFO:tasks.rados.rados.0.smithi085.stdout:29: done (11 left) 2023-01-25T06:42:37.892 INFO:tasks.rados.rados.0.smithi085.stdout:41: write initial oid 41 2023-01-25T06:42:37.892 INFO:tasks.rados.rados.0.smithi085.stdout:41: seq_num 40 ranges {672280=791725,2157515=514765} 2023-01-25T06:42:37.893 INFO:tasks.rados.rados.0.smithi085.stdout:41: writing smithi085112113-41 from 672280 to 1464005 tid 1 2023-01-25T06:42:37.894 INFO:tasks.rados.rados.0.smithi085.stdout:41: writing smithi085112113-41 from 2157515 to 2672280 tid 2 2023-01-25T06:42:37.895 INFO:tasks.rados.rados.0.smithi085.stdout:42: write initial oid 42 2023-01-25T06:42:37.895 INFO:tasks.rados.rados.0.smithi085.stdout:42: seq_num 41 ranges {689087=466974,1699644=784332} 2023-01-25T06:42:37.901 INFO:tasks.rados.rados.0.smithi085.stdout:42: writing smithi085112113-42 from 689087 to 1156061 tid 1 2023-01-25T06:42:37.908 INFO:tasks.rados.rados.0.smithi085.stdout:42: writing smithi085112113-42 from 1699644 to 2483976 tid 2 2023-01-25T06:42:37.909 INFO:tasks.rados.rados.0.smithi085.stdout:43: write initial oid 43 2023-01-25T06:42:37.909 INFO:tasks.rados.rados.0.smithi085.stdout:43: seq_num 42 ranges {705894=542223,1758126=644343} 2023-01-25T06:42:37.915 INFO:tasks.rados.rados.0.smithi085.stdout:43: writing smithi085112113-43 from 705894 to 1248117 tid 1 2023-01-25T06:42:37.922 INFO:tasks.rados.rados.0.smithi085.stdout:43: writing smithi085112113-43 from 1758126 to 2402469 tid 2 2023-01-25T06:42:37.922 INFO:tasks.rados.rados.0.smithi085.stdout:44: write initial oid 44 2023-01-25T06:42:37.922 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 2 to smithi085112113-30 2023-01-25T06:42:37.923 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 3 to smithi085112113-30 2023-01-25T06:42:37.923 INFO:tasks.rados.rados.0.smithi085.stdout:30: finishing write tid 4 to smithi085112113-30 2023-01-25T06:42:37.923 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 updating version 0 to 7 2023-01-25T06:42:37.923 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 updating version 7 to 20 2023-01-25T06:42:37.923 INFO:tasks.rados.rados.0.smithi085.stdout:30: oid 30 updating version 20 to 21 2023-01-25T06:42:37.924 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 30 v 21 (ObjNum 29 snap 0 seq_num 29) dirty exists 2023-01-25T06:42:37.924 INFO:tasks.rados.rados.0.smithi085.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2023-01-25T06:42:37.924 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 1 to smithi085112113-31 2023-01-25T06:42:37.924 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 2 to smithi085112113-31 2023-01-25T06:42:37.924 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 3 to smithi085112113-31 2023-01-25T06:42:37.925 INFO:tasks.rados.rados.0.smithi085.stdout:31: finishing write tid 4 to smithi085112113-31 2023-01-25T06:42:37.925 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 updating version 0 to 24 2023-01-25T06:42:37.925 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 version 24 is already newer than 8 2023-01-25T06:42:37.925 INFO:tasks.rados.rados.0.smithi085.stdout:31: oid 31 version 24 is already newer than 23 2023-01-25T06:42:37.925 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 31 v 24 (ObjNum 30 snap 0 seq_num 30) dirty exists 2023-01-25T06:42:37.926 INFO:tasks.rados.rados.0.smithi085.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2023-01-25T06:42:37.926 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 1 to smithi085112113-32 2023-01-25T06:42:37.926 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 1 to smithi085112113-33 2023-01-25T06:42:37.926 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 2 to smithi085112113-32 2023-01-25T06:42:37.926 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 3 to smithi085112113-32 2023-01-25T06:42:37.927 INFO:tasks.rados.rados.0.smithi085.stdout:44: seq_num 43 ranges {722701=617472,1816608=788001} 2023-01-25T06:42:37.929 INFO:tasks.rados.rados.0.smithi085.stdout:44: writing smithi085112113-44 from 722701 to 1340173 tid 1 2023-01-25T06:42:37.936 INFO:tasks.rados.rados.0.smithi085.stdout:44: writing smithi085112113-44 from 1816608 to 2604609 tid 2 2023-01-25T06:42:37.937 INFO:tasks.rados.rados.0.smithi085.stdout:30: done (14 left) 2023-01-25T06:42:37.937 INFO:tasks.rados.rados.0.smithi085.stdout:31: done (13 left) 2023-01-25T06:42:37.937 INFO:tasks.rados.rados.0.smithi085.stdout:45: write initial oid 45 2023-01-25T06:42:37.937 INFO:tasks.rados.rados.0.smithi085.stdout:45: seq_num 44 ranges {739508=692721,1875090=648012} 2023-01-25T06:42:37.944 INFO:tasks.rados.rados.0.smithi085.stdout:45: writing smithi085112113-45 from 739508 to 1432229 tid 1 2023-01-25T06:42:37.950 INFO:tasks.rados.rados.0.smithi085.stdout:45: writing smithi085112113-45 from 1875090 to 2523102 tid 2 2023-01-25T06:42:37.951 INFO:tasks.rados.rados.0.smithi085.stdout:46: write initial oid 46 2023-01-25T06:42:37.951 INFO:tasks.rados.rados.0.smithi085.stdout:46: seq_num 45 ranges {756315=767970,1933572=791670} 2023-01-25T06:42:37.958 INFO:tasks.rados.rados.0.smithi085.stdout:46: writing smithi085112113-46 from 756315 to 1524285 tid 1 2023-01-25T06:42:37.965 INFO:tasks.rados.rados.0.smithi085.stdout:46: writing smithi085112113-46 from 1933572 to 2725242 tid 2 2023-01-25T06:42:37.966 INFO:tasks.rados.rados.0.smithi085.stdout:47: write initial oid 47 2023-01-25T06:42:37.966 INFO:tasks.rados.rados.0.smithi085.stdout:47: seq_num 46 ranges {773122=559572,1992054=651681} 2023-01-25T06:42:37.972 INFO:tasks.rados.rados.0.smithi085.stdout:47: writing smithi085112113-47 from 773122 to 1332694 tid 1 2023-01-25T06:42:37.981 INFO:tasks.rados.rados.0.smithi085.stdout:47: writing smithi085112113-47 from 1992054 to 2643735 tid 2 2023-01-25T06:42:37.981 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:37.982 INFO:tasks.rados.rados.0.smithi085.stdout:32: finishing write tid 4 to smithi085112113-32 2023-01-25T06:42:37.982 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 updating version 0 to 18 2023-01-25T06:42:37.982 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 version 18 is already newer than 6 2023-01-25T06:42:37.982 INFO:tasks.rados.rados.0.smithi085.stdout:32: oid 32 version 18 is already newer than 17 2023-01-25T06:42:37.982 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 32 v 18 (ObjNum 31 snap 0 seq_num 31) dirty exists 2023-01-25T06:42:37.983 INFO:tasks.rados.rados.0.smithi085.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2023-01-25T06:42:37.983 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 1 to smithi085112113-34 2023-01-25T06:42:37.983 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 2 to smithi085112113-33 2023-01-25T06:42:37.983 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 3 to smithi085112113-33 2023-01-25T06:42:37.983 INFO:tasks.rados.rados.0.smithi085.stdout:33: finishing write tid 4 to smithi085112113-33 2023-01-25T06:42:37.984 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 updating version 0 to 20 2023-01-25T06:42:37.984 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 version 20 is already newer than 7 2023-01-25T06:42:37.984 INFO:tasks.rados.rados.0.smithi085.stdout:33: oid 33 updating version 20 to 21 2023-01-25T06:42:37.984 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 33 v 21 (ObjNum 32 snap 0 seq_num 32) dirty exists 2023-01-25T06:42:37.985 INFO:tasks.rados.rados.0.smithi085.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2023-01-25T06:42:37.985 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 2 to smithi085112113-34 2023-01-25T06:42:37.985 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 3 to smithi085112113-34 2023-01-25T06:42:37.985 INFO:tasks.rados.rados.0.smithi085.stdout:34: finishing write tid 4 to smithi085112113-34 2023-01-25T06:42:37.985 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 updating version 0 to 27 2023-01-25T06:42:37.986 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 version 27 is already newer than 9 2023-01-25T06:42:37.986 INFO:tasks.rados.rados.0.smithi085.stdout:34: oid 34 version 27 is already newer than 26 2023-01-25T06:42:37.986 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 34 v 27 (ObjNum 33 snap 0 seq_num 33) dirty exists 2023-01-25T06:42:37.986 INFO:tasks.rados.rados.0.smithi085.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2023-01-25T06:42:37.986 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 1 to smithi085112113-35 2023-01-25T06:42:37.987 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 2 to smithi085112113-35 2023-01-25T06:42:37.987 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 3 to smithi085112113-35 2023-01-25T06:42:37.987 INFO:tasks.rados.rados.0.smithi085.stdout:35: finishing write tid 4 to smithi085112113-35 2023-01-25T06:42:37.987 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 updating version 0 to 22 2023-01-25T06:42:37.987 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 updating version 22 to 24 2023-01-25T06:42:37.988 INFO:tasks.rados.rados.0.smithi085.stdout:35: oid 35 version 24 is already newer than 23 2023-01-25T06:42:37.988 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 35 v 24 (ObjNum 34 snap 0 seq_num 34) dirty exists 2023-01-25T06:42:37.988 INFO:tasks.rados.rados.0.smithi085.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2023-01-25T06:42:37.988 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 1 to smithi085112113-36 2023-01-25T06:42:37.988 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 2 to smithi085112113-36 2023-01-25T06:42:37.989 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 3 to smithi085112113-36 2023-01-25T06:42:37.989 INFO:tasks.rados.rados.0.smithi085.stdout:36: finishing write tid 4 to smithi085112113-36 2023-01-25T06:42:37.989 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 updating version 0 to 18 2023-01-25T06:42:37.989 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 version 18 is already newer than 6 2023-01-25T06:42:37.989 INFO:tasks.rados.rados.0.smithi085.stdout:36: oid 36 version 18 is already newer than 17 2023-01-25T06:42:37.990 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 36 v 18 (ObjNum 35 snap 0 seq_num 35) dirty exists 2023-01-25T06:42:37.990 INFO:tasks.rados.rados.0.smithi085.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2023-01-25T06:42:37.990 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 1 to smithi085112113-37 2023-01-25T06:42:37.990 INFO:tasks.rados.rados.0.smithi085.stdout:32: done (15 left) 2023-01-25T06:42:37.990 INFO:tasks.rados.rados.0.smithi085.stdout:33: done (14 left) 2023-01-25T06:42:37.991 INFO:tasks.rados.rados.0.smithi085.stdout:34: done (13 left) 2023-01-25T06:42:37.993 INFO:tasks.rados.rados.0.smithi085.stdout:35: done (12 left) 2023-01-25T06:42:37.993 INFO:tasks.rados.rados.0.smithi085.stdout:36: done (11 left) 2023-01-25T06:42:37.993 INFO:tasks.rados.rados.0.smithi085.stdout:48: write initial oid 48 2023-01-25T06:42:37.993 INFO:tasks.rados.rados.0.smithi085.stdout:48: seq_num 47 ranges {789929=634821,2050536=739393} 2023-01-25T06:42:37.994 INFO:tasks.rados.rados.0.smithi085.stdout:48: writing smithi085112113-48 from 789929 to 1424750 tid 1 2023-01-25T06:42:37.995 INFO:tasks.rados.rados.0.smithi085.stdout:48: writing smithi085112113-48 from 2050536 to 2789929 tid 2 2023-01-25T06:42:37.996 INFO:tasks.rados.rados.0.smithi085.stdout:49: write initial oid 49 2023-01-25T06:42:37.996 INFO:tasks.rados.rados.0.smithi085.stdout:49: seq_num 48 ranges {406736=710070,1709018=655350} 2023-01-25T06:42:38.001 INFO:tasks.rados.rados.0.smithi085.stdout:49: writing smithi085112113-49 from 406736 to 1116806 tid 1 2023-01-25T06:42:38.008 INFO:tasks.rados.rados.0.smithi085.stdout:49: writing smithi085112113-49 from 1709018 to 2364368 tid 2 2023-01-25T06:42:38.009 INFO:tasks.rados.rados.0.smithi085.stdout:50: write initial oid 50 2023-01-25T06:42:38.009 INFO:tasks.rados.rados.0.smithi085.stdout:50: seq_num 49 ranges {423543=785319,1767500=799008} 2023-01-25T06:42:38.015 INFO:tasks.rados.rados.0.smithi085.stdout:50: writing smithi085112113-50 from 423543 to 1208862 tid 1 2023-01-25T06:42:38.023 INFO:tasks.rados.rados.0.smithi085.stdout:50: writing smithi085112113-50 from 1767500 to 2566508 tid 2 2023-01-25T06:42:38.023 INFO:tasks.rados.rados.0.smithi085.stdout:51: write initial oid 51 2023-01-25T06:42:38.023 INFO:tasks.rados.rados.0.smithi085.stdout:51: seq_num 50 ranges {440350=460568,1309629=542666,2323973=516377} 2023-01-25T06:42:38.027 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112113-51 from 440350 to 900918 tid 1 2023-01-25T06:42:38.033 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112113-51 from 1309629 to 1852295 tid 2 2023-01-25T06:42:38.038 INFO:tasks.rados.rados.0.smithi085.stdout:51: writing smithi085112113-51 from 2323973 to 2840350 tid 3 2023-01-25T06:42:38.039 INFO:tasks.rados.rados.0.smithi085.stdout:52: write initial oid 52 2023-01-25T06:42:38.039 INFO:tasks.rados.rados.0.smithi085.stdout:52: seq_num 51 ranges {457157=535817,1768111=402677} 2023-01-25T06:42:38.044 INFO:tasks.rados.rados.0.smithi085.stdout:52: writing smithi085112113-52 from 457157 to 992974 tid 1 2023-01-25T06:42:38.051 INFO:tasks.rados.rados.0.smithi085.stdout:52: writing smithi085112113-52 from 1768111 to 2170788 tid 2 2023-01-25T06:42:38.051 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.051 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 2 to smithi085112113-37 2023-01-25T06:42:38.051 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 3 to smithi085112113-37 2023-01-25T06:42:38.052 INFO:tasks.rados.rados.0.smithi085.stdout:37: finishing write tid 4 to smithi085112113-37 2023-01-25T06:42:38.052 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 0 to 8 2023-01-25T06:42:38.052 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 8 to 23 2023-01-25T06:42:38.052 INFO:tasks.rados.rados.0.smithi085.stdout:37: oid 37 updating version 23 to 24 2023-01-25T06:42:38.052 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 37 v 24 (ObjNum 36 snap 0 seq_num 36) dirty exists 2023-01-25T06:42:38.053 INFO:tasks.rados.rados.0.smithi085.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2023-01-25T06:42:38.053 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 1 to smithi085112113-38 2023-01-25T06:42:38.053 INFO:tasks.rados.rados.0.smithi085.stdout:37: done (15 left) 2023-01-25T06:42:38.053 INFO:tasks.rados.rados.0.smithi085.stdout:53: write initial oid 53 2023-01-25T06:42:38.053 INFO:tasks.rados.rados.0.smithi085.stdout:53: seq_num 52 ranges {473964=611066,1826593=546335,2778819=95145} 2023-01-25T06:42:38.057 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112113-53 from 473964 to 1085030 tid 1 2023-01-25T06:42:38.064 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112113-53 from 1826593 to 2372928 tid 2 2023-01-25T06:42:38.067 INFO:tasks.rados.rados.0.smithi085.stdout:53: writing smithi085112113-53 from 2778819 to 2873964 tid 3 2023-01-25T06:42:38.067 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.068 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 2 to smithi085112113-38 2023-01-25T06:42:38.068 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 3 to smithi085112113-38 2023-01-25T06:42:38.068 INFO:tasks.rados.rados.0.smithi085.stdout:38: finishing write tid 4 to smithi085112113-38 2023-01-25T06:42:38.068 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 updating version 0 to 10 2023-01-25T06:42:38.068 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 updating version 10 to 30 2023-01-25T06:42:38.069 INFO:tasks.rados.rados.0.smithi085.stdout:38: oid 38 version 30 is already newer than 29 2023-01-25T06:42:38.069 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 38 v 30 (ObjNum 37 snap 0 seq_num 37) dirty exists 2023-01-25T06:42:38.069 INFO:tasks.rados.rados.0.smithi085.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2023-01-25T06:42:38.069 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 1 to smithi085112113-39 2023-01-25T06:42:38.069 INFO:tasks.rados.rados.0.smithi085.stdout:38: done (15 left) 2023-01-25T06:42:38.070 INFO:tasks.rados.rados.0.smithi085.stdout:54: write initial oid 54 2023-01-25T06:42:38.070 INFO:tasks.rados.rados.0.smithi085.stdout:54: seq_num 53 ranges {490771=686315,1885075=406346} 2023-01-25T06:42:38.073 INFO:tasks.rados.rados.0.smithi085.stdout:54: writing smithi085112113-54 from 490771 to 1177086 tid 1 2023-01-25T06:42:38.079 INFO:tasks.rados.rados.0.smithi085.stdout:54: writing smithi085112113-54 from 1885075 to 2291421 tid 2 2023-01-25T06:42:38.080 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.080 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 2 to smithi085112113-39 2023-01-25T06:42:38.080 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 3 to smithi085112113-39 2023-01-25T06:42:38.080 INFO:tasks.rados.rados.0.smithi085.stdout:39: finishing write tid 4 to smithi085112113-39 2023-01-25T06:42:38.081 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 updating version 0 to 26 2023-01-25T06:42:38.081 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 version 26 is already newer than 9 2023-01-25T06:42:38.081 INFO:tasks.rados.rados.0.smithi085.stdout:39: oid 39 updating version 26 to 27 2023-01-25T06:42:38.081 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 39 v 27 (ObjNum 38 snap 0 seq_num 38) dirty exists 2023-01-25T06:42:38.081 INFO:tasks.rados.rados.0.smithi085.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2023-01-25T06:42:38.082 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 1 to smithi085112113-40 2023-01-25T06:42:38.082 INFO:tasks.rados.rados.0.smithi085.stdout:39: done (15 left) 2023-01-25T06:42:38.082 INFO:tasks.rados.rados.0.smithi085.stdout:55: write initial oid 55 2023-01-25T06:42:38.082 INFO:tasks.rados.rados.0.smithi085.stdout:55: seq_num 54 ranges {507578=477917,1543557=550004,2833665=73913} 2023-01-25T06:42:38.085 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112113-55 from 507578 to 985495 tid 1 2023-01-25T06:42:38.091 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112113-55 from 1543557 to 2093561 tid 2 2023-01-25T06:42:38.095 INFO:tasks.rados.rados.0.smithi085.stdout:55: writing smithi085112113-55 from 2833665 to 2907578 tid 3 2023-01-25T06:42:38.096 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.096 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 2 to smithi085112113-40 2023-01-25T06:42:38.096 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 3 to smithi085112113-40 2023-01-25T06:42:38.096 INFO:tasks.rados.rados.0.smithi085.stdout:40: finishing write tid 4 to smithi085112113-40 2023-01-25T06:42:38.097 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 updating version 0 to 7 2023-01-25T06:42:38.097 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 updating version 7 to 21 2023-01-25T06:42:38.097 INFO:tasks.rados.rados.0.smithi085.stdout:40: oid 40 version 21 is already newer than 20 2023-01-25T06:42:38.097 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 40 v 21 (ObjNum 39 snap 0 seq_num 39) dirty exists 2023-01-25T06:42:38.097 INFO:tasks.rados.rados.0.smithi085.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2023-01-25T06:42:38.098 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 1 to smithi085112113-41 2023-01-25T06:42:38.098 INFO:tasks.rados.rados.0.smithi085.stdout:40: done (15 left) 2023-01-25T06:42:38.098 INFO:tasks.rados.rados.0.smithi085.stdout:56: write initial oid 56 2023-01-25T06:42:38.098 INFO:tasks.rados.rados.0.smithi085.stdout:56: seq_num 55 ranges {524385=553166,1602039=410015,2577441=346944} 2023-01-25T06:42:38.101 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112113-56 from 524385 to 1077551 tid 1 2023-01-25T06:42:38.106 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112113-56 from 1602039 to 2012054 tid 2 2023-01-25T06:42:38.112 INFO:tasks.rados.rados.0.smithi085.stdout:56: writing smithi085112113-56 from 2577441 to 2924385 tid 3 2023-01-25T06:42:38.112 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.112 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 2 to smithi085112113-41 2023-01-25T06:42:38.113 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 3 to smithi085112113-41 2023-01-25T06:42:38.113 INFO:tasks.rados.rados.0.smithi085.stdout:41: finishing write tid 4 to smithi085112113-41 2023-01-25T06:42:38.113 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 updating version 0 to 27 2023-01-25T06:42:38.113 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 version 27 is already newer than 26 2023-01-25T06:42:38.113 INFO:tasks.rados.rados.0.smithi085.stdout:41: oid 41 version 27 is already newer than 25 2023-01-25T06:42:38.114 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 41 v 27 (ObjNum 40 snap 0 seq_num 40) dirty exists 2023-01-25T06:42:38.114 INFO:tasks.rados.rados.0.smithi085.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2023-01-25T06:42:38.114 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 1 to smithi085112113-42 2023-01-25T06:42:38.114 INFO:tasks.rados.rados.0.smithi085.stdout:41: done (15 left) 2023-01-25T06:42:38.114 INFO:tasks.rados.rados.0.smithi085.stdout:57: write initial oid 57 2023-01-25T06:42:38.115 INFO:tasks.rados.rados.0.smithi085.stdout:57: seq_num 56 ranges {541192=628415,1660521=553673,2888511=52681} 2023-01-25T06:42:38.118 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112113-57 from 541192 to 1169607 tid 1 2023-01-25T06:42:38.124 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112113-57 from 1660521 to 2214194 tid 2 2023-01-25T06:42:38.129 INFO:tasks.rados.rados.0.smithi085.stdout:57: writing smithi085112113-57 from 2888511 to 2941192 tid 3 2023-01-25T06:42:38.129 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.129 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 2 to smithi085112113-42 2023-01-25T06:42:38.129 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 3 to smithi085112113-42 2023-01-25T06:42:38.129 INFO:tasks.rados.rados.0.smithi085.stdout:42: finishing write tid 4 to smithi085112113-42 2023-01-25T06:42:38.130 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 updating version 0 to 12 2023-01-25T06:42:38.130 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 version 12 is already newer than 10 2023-01-25T06:42:38.130 INFO:tasks.rados.rados.0.smithi085.stdout:42: oid 42 version 12 is already newer than 11 2023-01-25T06:42:38.130 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 42 v 12 (ObjNum 41 snap 0 seq_num 41) dirty exists 2023-01-25T06:42:38.131 INFO:tasks.rados.rados.0.smithi085.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2023-01-25T06:42:38.131 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 1 to smithi085112113-43 2023-01-25T06:42:38.131 INFO:tasks.rados.rados.0.smithi085.stdout:42: done (15 left) 2023-01-25T06:42:38.132 INFO:tasks.rados.rados.0.smithi085.stdout:58: write initial oid 58 2023-01-25T06:42:38.136 INFO:tasks.rados.rados.0.smithi085.stdout:58: seq_num 57 ranges {557999=703664,1719003=413684,2632287=325712} 2023-01-25T06:42:38.137 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112113-58 from 557999 to 1261663 tid 1 2023-01-25T06:42:38.140 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112113-58 from 1719003 to 2132687 tid 2 2023-01-25T06:42:38.145 INFO:tasks.rados.rados.0.smithi085.stdout:58: writing smithi085112113-58 from 2632287 to 2957999 tid 3 2023-01-25T06:42:38.145 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.145 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 2 to smithi085112113-43 2023-01-25T06:42:38.145 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 3 to smithi085112113-43 2023-01-25T06:42:38.146 INFO:tasks.rados.rados.0.smithi085.stdout:43: finishing write tid 4 to smithi085112113-43 2023-01-25T06:42:38.146 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 updating version 0 to 28 2023-01-25T06:42:38.146 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 updating version 28 to 30 2023-01-25T06:42:38.146 INFO:tasks.rados.rados.0.smithi085.stdout:43: oid 43 version 30 is already newer than 29 2023-01-25T06:42:38.146 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 43 v 30 (ObjNum 42 snap 0 seq_num 42) dirty exists 2023-01-25T06:42:38.147 INFO:tasks.rados.rados.0.smithi085.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2023-01-25T06:42:38.147 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 1 to smithi085112113-44 2023-01-25T06:42:38.147 INFO:tasks.rados.rados.0.smithi085.stdout:43: done (15 left) 2023-01-25T06:42:38.147 INFO:tasks.rados.rados.0.smithi085.stdout:59: write initial oid 59 2023-01-25T06:42:38.147 INFO:tasks.rados.rados.0.smithi085.stdout:59: seq_num 58 ranges {574806=778913,2061132=557342} 2023-01-25T06:42:38.152 INFO:tasks.rados.rados.0.smithi085.stdout:59: writing smithi085112113-59 from 574806 to 1353719 tid 1 2023-01-25T06:42:38.159 INFO:tasks.rados.rados.0.smithi085.stdout:59: writing smithi085112113-59 from 2061132 to 2618474 tid 2 2023-01-25T06:42:38.159 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.160 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 2 to smithi085112113-44 2023-01-25T06:42:38.160 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 3 to smithi085112113-44 2023-01-25T06:42:38.160 INFO:tasks.rados.rados.0.smithi085.stdout:44: finishing write tid 4 to smithi085112113-44 2023-01-25T06:42:38.160 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 updating version 0 to 12 2023-01-25T06:42:38.160 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 version 12 is already newer than 11 2023-01-25T06:42:38.161 INFO:tasks.rados.rados.0.smithi085.stdout:44: oid 44 updating version 12 to 13 2023-01-25T06:42:38.161 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 44 v 13 (ObjNum 43 snap 0 seq_num 43) dirty exists 2023-01-25T06:42:38.161 INFO:tasks.rados.rados.0.smithi085.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2023-01-25T06:42:38.161 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 1 to smithi085112113-45 2023-01-25T06:42:38.161 INFO:tasks.rados.rados.0.smithi085.stdout:44: done (15 left) 2023-01-25T06:42:38.162 INFO:tasks.rados.rados.0.smithi085.stdout:60: write initial oid 60 2023-01-25T06:42:38.162 INFO:tasks.rados.rados.0.smithi085.stdout:60: seq_num 59 ranges {591613=454162,1719614=417353,2570780=420833} 2023-01-25T06:42:38.164 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112113-60 from 591613 to 1045775 tid 1 2023-01-25T06:42:38.171 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112113-60 from 1719614 to 2136967 tid 2 2023-01-25T06:42:38.176 INFO:tasks.rados.rados.0.smithi085.stdout:60: writing smithi085112113-60 from 2570780 to 2991613 tid 3 2023-01-25T06:42:38.176 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 2 to smithi085112113-45 2023-01-25T06:42:38.176 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.177 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 3 to smithi085112113-45 2023-01-25T06:42:38.177 INFO:tasks.rados.rados.0.smithi085.stdout:45: finishing write tid 4 to smithi085112113-45 2023-01-25T06:42:38.177 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 updating version 0 to 32 2023-01-25T06:42:38.177 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 version 32 is already newer than 31 2023-01-25T06:42:38.177 INFO:tasks.rados.rados.0.smithi085.stdout:45: oid 45 updating version 32 to 33 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 45 v 33 (ObjNum 44 snap 0 seq_num 44) dirty exists 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 1 to smithi085112113-46 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 2 to smithi085112113-46 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 3 to smithi085112113-46 2023-01-25T06:42:38.178 INFO:tasks.rados.rados.0.smithi085.stdout:46: finishing write tid 4 to smithi085112113-46 2023-01-25T06:42:38.179 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 updating version 0 to 35 2023-01-25T06:42:38.179 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 version 35 is already newer than 34 2023-01-25T06:42:38.179 INFO:tasks.rados.rados.0.smithi085.stdout:46: oid 46 updating version 35 to 36 2023-01-25T06:42:38.179 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 46 v 36 (ObjNum 45 snap 0 seq_num 45) dirty exists 2023-01-25T06:42:38.179 INFO:tasks.rados.rados.0.smithi085.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2023-01-25T06:42:38.180 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 1 to smithi085112113-47 2023-01-25T06:42:38.180 INFO:tasks.rados.rados.0.smithi085.stdout:45: done (15 left) 2023-01-25T06:42:38.180 INFO:tasks.rados.rados.0.smithi085.stdout:46: done (14 left) 2023-01-25T06:42:38.180 INFO:tasks.rados.rados.0.smithi085.stdout:61: write initial oid 61 2023-01-25T06:42:38.180 INFO:tasks.rados.rados.0.smithi085.stdout:61: seq_num 60 ranges {608420=529411,1778096=561011,2881850=126570} 2023-01-25T06:42:38.182 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112113-61 from 608420 to 1137831 tid 1 2023-01-25T06:42:38.188 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112113-61 from 1778096 to 2339107 tid 2 2023-01-25T06:42:38.192 INFO:tasks.rados.rados.0.smithi085.stdout:61: writing smithi085112113-61 from 2881850 to 3008420 tid 3 2023-01-25T06:42:38.193 INFO:tasks.rados.rados.0.smithi085.stdout:62: write initial oid 62 2023-01-25T06:42:38.193 INFO:tasks.rados.rados.0.smithi085.stdout:62: seq_num 61 ranges {625227=721013,1952931=704669} 2023-01-25T06:42:38.199 INFO:tasks.rados.rados.0.smithi085.stdout:62: writing smithi085112113-62 from 625227 to 1346240 tid 1 2023-01-25T06:42:38.207 INFO:tasks.rados.rados.0.smithi085.stdout:62: writing smithi085112113-62 from 1952931 to 2657600 tid 2 2023-01-25T06:42:38.207 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.208 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 2 to smithi085112113-47 2023-01-25T06:42:38.208 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 3 to smithi085112113-47 2023-01-25T06:42:38.208 INFO:tasks.rados.rados.0.smithi085.stdout:47: finishing write tid 4 to smithi085112113-47 2023-01-25T06:42:38.208 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 updating version 0 to 16 2023-01-25T06:42:38.209 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 version 16 is already newer than 15 2023-01-25T06:42:38.209 INFO:tasks.rados.rados.0.smithi085.stdout:47: oid 47 version 16 is already newer than 14 2023-01-25T06:42:38.209 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 47 v 16 (ObjNum 46 snap 0 seq_num 46) dirty exists 2023-01-25T06:42:38.209 INFO:tasks.rados.rados.0.smithi085.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2023-01-25T06:42:38.210 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 1 to smithi085112113-48 2023-01-25T06:42:38.210 INFO:tasks.rados.rados.0.smithi085.stdout:47: done (15 left) 2023-01-25T06:42:38.210 INFO:tasks.rados.rados.0.smithi085.stdout:63: write initial oid 63 2023-01-25T06:42:38.210 INFO:tasks.rados.rados.0.smithi085.stdout:63: seq_num 62 ranges {642034=796262,1895060=564680} 2023-01-25T06:42:38.215 INFO:tasks.rados.rados.0.smithi085.stdout:63: writing smithi085112113-63 from 642034 to 1438296 tid 1 2023-01-25T06:42:38.223 INFO:tasks.rados.rados.0.smithi085.stdout:63: writing smithi085112113-63 from 1895060 to 2459740 tid 2 2023-01-25T06:42:38.223 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.223 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 2 to smithi085112113-48 2023-01-25T06:42:38.224 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 3 to smithi085112113-48 2023-01-25T06:42:38.224 INFO:tasks.rados.rados.0.smithi085.stdout:48: finishing write tid 4 to smithi085112113-48 2023-01-25T06:42:38.224 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 updating version 0 to 13 2023-01-25T06:42:38.224 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 updating version 13 to 15 2023-01-25T06:42:38.224 INFO:tasks.rados.rados.0.smithi085.stdout:48: oid 48 version 15 is already newer than 14 2023-01-25T06:42:38.225 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 48 v 15 (ObjNum 47 snap 0 seq_num 47) dirty exists 2023-01-25T06:42:38.225 INFO:tasks.rados.rados.0.smithi085.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2023-01-25T06:42:38.225 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 1 to smithi085112113-49 2023-01-25T06:42:38.225 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 2 to smithi085112113-49 2023-01-25T06:42:38.225 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 3 to smithi085112113-49 2023-01-25T06:42:38.226 INFO:tasks.rados.rados.0.smithi085.stdout:49: finishing write tid 4 to smithi085112113-49 2023-01-25T06:42:38.226 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 updating version 0 to 18 2023-01-25T06:42:38.226 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 version 18 is already newer than 16 2023-01-25T06:42:38.226 INFO:tasks.rados.rados.0.smithi085.stdout:49: oid 49 version 18 is already newer than 17 2023-01-25T06:42:38.226 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 49 v 18 (ObjNum 48 snap 0 seq_num 48) dirty exists 2023-01-25T06:42:38.227 INFO:tasks.rados.rados.0.smithi085.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2023-01-25T06:42:38.227 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 1 to smithi085112113-50 2023-01-25T06:42:38.227 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 2 to smithi085112113-50 2023-01-25T06:42:38.227 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 3 to smithi085112113-50 2023-01-25T06:42:38.227 INFO:tasks.rados.rados.0.smithi085.stdout:50: finishing write tid 4 to smithi085112113-50 2023-01-25T06:42:38.228 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 updating version 0 to 20 2023-01-25T06:42:38.228 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 updating version 20 to 21 2023-01-25T06:42:38.228 INFO:tasks.rados.rados.0.smithi085.stdout:50: oid 50 version 21 is already newer than 19 2023-01-25T06:42:38.228 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 50 v 21 (ObjNum 49 snap 0 seq_num 49) dirty exists 2023-01-25T06:42:38.228 INFO:tasks.rados.rados.0.smithi085.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2023-01-25T06:42:38.229 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 1 to smithi085112113-51 2023-01-25T06:42:38.229 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 2 to smithi085112113-51 2023-01-25T06:42:38.229 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 3 to smithi085112113-51 2023-01-25T06:42:38.229 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 4 to smithi085112113-51 2023-01-25T06:42:38.229 INFO:tasks.rados.rados.0.smithi085.stdout:51: finishing write tid 5 to smithi085112113-51 2023-01-25T06:42:38.230 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 0 to 17 2023-01-25T06:42:38.230 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 17 to 19 2023-01-25T06:42:38.230 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 version 19 is already newer than 18 2023-01-25T06:42:38.230 INFO:tasks.rados.rados.0.smithi085.stdout:51: oid 51 updating version 19 to 20 2023-01-25T06:42:38.230 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 51 v 20 (ObjNum 50 snap 0 seq_num 50) dirty exists 2023-01-25T06:42:38.231 INFO:tasks.rados.rados.0.smithi085.stdout:51: left oid 51 (ObjNum 50 snap 0 seq_num 50) 2023-01-25T06:42:38.231 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 1 to smithi085112113-52 2023-01-25T06:42:38.231 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 2 to smithi085112113-52 2023-01-25T06:42:38.231 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 3 to smithi085112113-52 2023-01-25T06:42:38.231 INFO:tasks.rados.rados.0.smithi085.stdout:52: finishing write tid 4 to smithi085112113-52 2023-01-25T06:42:38.232 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 updating version 0 to 8 2023-01-25T06:42:38.232 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 updating version 8 to 24 2023-01-25T06:42:38.232 INFO:tasks.rados.rados.0.smithi085.stdout:52: oid 52 version 24 is already newer than 23 2023-01-25T06:42:38.233 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 52 v 24 (ObjNum 51 snap 0 seq_num 51) dirty exists 2023-01-25T06:42:38.233 INFO:tasks.rados.rados.0.smithi085.stdout:52: left oid 52 (ObjNum 51 snap 0 seq_num 51) 2023-01-25T06:42:38.233 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 1 to smithi085112113-53 2023-01-25T06:42:38.233 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 2 to smithi085112113-53 2023-01-25T06:42:38.233 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 3 to smithi085112113-53 2023-01-25T06:42:38.234 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 4 to smithi085112113-53 2023-01-25T06:42:38.234 INFO:tasks.rados.rados.0.smithi085.stdout:53: finishing write tid 5 to smithi085112113-53 2023-01-25T06:42:38.234 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 0 to 23 2023-01-25T06:42:38.234 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 23 to 24 2023-01-25T06:42:38.234 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 version 24 is already newer than 22 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:53: oid 53 updating version 24 to 25 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 53 v 25 (ObjNum 52 snap 0 seq_num 52) dirty exists 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:53: left oid 53 (ObjNum 52 snap 0 seq_num 52) 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 1 to smithi085112113-54 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:48: done (15 left) 2023-01-25T06:42:38.235 INFO:tasks.rados.rados.0.smithi085.stdout:49: done (14 left) 2023-01-25T06:42:38.236 INFO:tasks.rados.rados.0.smithi085.stdout:50: done (13 left) 2023-01-25T06:42:38.236 INFO:tasks.rados.rados.0.smithi085.stdout:51: done (12 left) 2023-01-25T06:42:38.236 INFO:tasks.rados.rados.0.smithi085.stdout:52: done (11 left) 2023-01-25T06:42:38.236 INFO:tasks.rados.rados.0.smithi085.stdout:53: done (10 left) 2023-01-25T06:42:38.236 INFO:tasks.rados.rados.0.smithi085.stdout:64: write initial oid 64 2023-01-25T06:42:38.237 INFO:tasks.rados.rados.0.smithi085.stdout:64: seq_num 63 ranges {658841=471511,1553542=708338,2964119=94722} 2023-01-25T06:42:38.237 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112113-64 from 658841 to 1130352 tid 1 2023-01-25T06:42:38.238 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112113-64 from 1553542 to 2261880 tid 2 2023-01-25T06:42:38.238 INFO:tasks.rados.rados.0.smithi085.stdout:64: writing smithi085112113-64 from 2964119 to 3058841 tid 3 2023-01-25T06:42:38.239 INFO:tasks.rados.rados.0.smithi085.stdout:65: write initial oid 65 2023-01-25T06:42:38.239 INFO:tasks.rados.rados.0.smithi085.stdout:65: seq_num 64 ranges {675648=546760,2012024=568349} 2023-01-25T06:42:38.245 INFO:tasks.rados.rados.0.smithi085.stdout:65: writing smithi085112113-65 from 675648 to 1222408 tid 1 2023-01-25T06:42:38.253 INFO:tasks.rados.rados.0.smithi085.stdout:65: writing smithi085112113-65 from 2012024 to 2580373 tid 2 2023-01-25T06:42:38.253 INFO:tasks.rados.rados.0.smithi085.stdout:66: write initial oid 66 2023-01-25T06:42:38.253 INFO:tasks.rados.rados.0.smithi085.stdout:66: seq_num 65 ranges {692455=622009,2070506=712007} 2023-01-25T06:42:38.260 INFO:tasks.rados.rados.0.smithi085.stdout:66: writing smithi085112113-66 from 692455 to 1314464 tid 1 2023-01-25T06:42:38.269 INFO:tasks.rados.rados.0.smithi085.stdout:66: writing smithi085112113-66 from 2070506 to 2782513 tid 2 2023-01-25T06:42:38.269 INFO:tasks.rados.rados.0.smithi085.stdout:67: write initial oid 67 2023-01-25T06:42:38.269 INFO:tasks.rados.rados.0.smithi085.stdout:67: seq_num 66 ranges {709262=697258,2012635=572018,3046388=62874} 2023-01-25T06:42:38.276 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112113-67 from 709262 to 1406520 tid 1 2023-01-25T06:42:38.283 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112113-67 from 2012635 to 2584653 tid 2 2023-01-25T06:42:38.288 INFO:tasks.rados.rados.0.smithi085.stdout:67: writing smithi085112113-67 from 3046388 to 3109262 tid 3 2023-01-25T06:42:38.288 INFO:tasks.rados.rados.0.smithi085.stdout:68: write initial oid 68 2023-01-25T06:42:38.288 INFO:tasks.rados.rados.0.smithi085.stdout:68: seq_num 67 ranges {726069=772507,2071117=715676} 2023-01-25T06:42:38.294 INFO:tasks.rados.rados.0.smithi085.stdout:68: writing smithi085112113-68 from 726069 to 1498576 tid 1 2023-01-25T06:42:38.301 INFO:tasks.rados.rados.0.smithi085.stdout:68: writing smithi085112113-68 from 2071117 to 2786793 tid 2 2023-01-25T06:42:38.302 INFO:tasks.rados.rados.0.smithi085.stdout:69: write initial oid 69 2023-01-25T06:42:38.302 INFO:tasks.rados.rados.0.smithi085.stdout:69: seq_num 68 ranges {742876=447756,1729599=575687,3101234=41642} 2023-01-25T06:42:38.308 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112113-69 from 742876 to 1190632 tid 1 2023-01-25T06:42:38.314 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112113-69 from 1729599 to 2305286 tid 2 2023-01-25T06:42:38.320 INFO:tasks.rados.rados.0.smithi085.stdout:69: writing smithi085112113-69 from 3101234 to 3142876 tid 3 2023-01-25T06:42:38.320 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.321 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 2 to smithi085112113-54 2023-01-25T06:42:38.321 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 3 to smithi085112113-54 2023-01-25T06:42:38.321 INFO:tasks.rados.rados.0.smithi085.stdout:54: finishing write tid 4 to smithi085112113-54 2023-01-25T06:42:38.322 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 updating version 0 to 38 2023-01-25T06:42:38.322 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 updating version 38 to 39 2023-01-25T06:42:38.323 INFO:tasks.rados.rados.0.smithi085.stdout:54: oid 54 version 39 is already newer than 37 2023-01-25T06:42:38.323 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 54 v 39 (ObjNum 53 snap 0 seq_num 53) dirty exists 2023-01-25T06:42:38.323 INFO:tasks.rados.rados.0.smithi085.stdout:54: left oid 54 (ObjNum 53 snap 0 seq_num 53) 2023-01-25T06:42:38.324 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 1 to smithi085112113-55 2023-01-25T06:42:38.324 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 2 to smithi085112113-55 2023-01-25T06:42:38.324 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 3 to smithi085112113-55 2023-01-25T06:42:38.325 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 4 to smithi085112113-55 2023-01-25T06:42:38.325 INFO:tasks.rados.rados.0.smithi085.stdout:55: finishing write tid 5 to smithi085112113-55 2023-01-25T06:42:38.325 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 updating version 0 to 42 2023-01-25T06:42:38.326 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 updating version 42 to 43 2023-01-25T06:42:38.326 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 version 43 is already newer than 41 2023-01-25T06:42:38.326 INFO:tasks.rados.rados.0.smithi085.stdout:55: oid 55 version 43 is already newer than 40 2023-01-25T06:42:38.327 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 55 v 43 (ObjNum 54 snap 0 seq_num 54) dirty exists 2023-01-25T06:42:38.327 INFO:tasks.rados.rados.0.smithi085.stdout:55: left oid 55 (ObjNum 54 snap 0 seq_num 54) 2023-01-25T06:42:38.327 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 1 to smithi085112113-56 2023-01-25T06:42:38.328 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 2 to smithi085112113-56 2023-01-25T06:42:38.328 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 3 to smithi085112113-56 2023-01-25T06:42:38.328 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 4 to smithi085112113-56 2023-01-25T06:42:38.328 INFO:tasks.rados.rados.0.smithi085.stdout:54: done (15 left) 2023-01-25T06:42:38.328 INFO:tasks.rados.rados.0.smithi085.stdout:55: done (14 left) 2023-01-25T06:42:38.329 INFO:tasks.rados.rados.0.smithi085.stdout:70: write initial oid 70 2023-01-25T06:42:38.329 INFO:tasks.rados.rados.0.smithi085.stdout:70: seq_num 69 ranges {759683=639358,1904434=719345,3128657=31026} 2023-01-25T06:42:38.329 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112113-70 from 759683 to 1399041 tid 1 2023-01-25T06:42:38.333 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112113-70 from 1904434 to 2623779 tid 2 2023-01-25T06:42:38.336 INFO:tasks.rados.rados.0.smithi085.stdout:70: writing smithi085112113-70 from 3128657 to 3159683 tid 3 2023-01-25T06:42:38.337 INFO:tasks.rados.rados.0.smithi085.stdout:71: write initial oid 71 2023-01-25T06:42:38.337 INFO:tasks.rados.rados.0.smithi085.stdout:71: seq_num 70 ranges {776490=714607,2246563=579356} 2023-01-25T06:42:38.344 INFO:tasks.rados.rados.0.smithi085.stdout:71: writing smithi085112113-71 from 776490 to 1491097 tid 1 2023-01-25T06:42:38.353 INFO:tasks.rados.rados.0.smithi085.stdout:71: writing smithi085112113-71 from 2246563 to 2825919 tid 2 2023-01-25T06:42:38.353 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.354 INFO:tasks.rados.rados.0.smithi085.stdout:56: finishing write tid 5 to smithi085112113-56 2023-01-25T06:42:38.354 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 updating version 0 to 10 2023-01-25T06:42:38.354 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 version 10 is already newer than 9 2023-01-25T06:42:38.354 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 updating version 10 to 27 2023-01-25T06:42:38.354 INFO:tasks.rados.rados.0.smithi085.stdout:56: oid 56 version 27 is already newer than 26 2023-01-25T06:42:38.355 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 56 v 27 (ObjNum 55 snap 0 seq_num 55) dirty exists 2023-01-25T06:42:38.355 INFO:tasks.rados.rados.0.smithi085.stdout:56: left oid 56 (ObjNum 55 snap 0 seq_num 55) 2023-01-25T06:42:38.355 INFO:tasks.rados.rados.0.smithi085.stdout:56: done (15 left) 2023-01-25T06:42:38.355 INFO:tasks.rados.rados.0.smithi085.stdout:72: write initial oid 72 2023-01-25T06:42:38.355 INFO:tasks.rados.rados.0.smithi085.stdout:72: seq_num 71 ranges {793297=789856,2305045=723014} 2023-01-25T06:42:38.360 INFO:tasks.rados.rados.0.smithi085.stdout:72: writing smithi085112113-72 from 793297 to 1583153 tid 1 2023-01-25T06:42:38.369 INFO:tasks.rados.rados.0.smithi085.stdout:72: writing smithi085112113-72 from 2305045 to 3028059 tid 2 2023-01-25T06:42:38.369 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.369 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 1 to smithi085112113-57 2023-01-25T06:42:38.370 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 2 to smithi085112113-57 2023-01-25T06:42:38.370 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 3 to smithi085112113-57 2023-01-25T06:42:38.370 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 1 to smithi085112113-58 2023-01-25T06:42:38.370 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 4 to smithi085112113-57 2023-01-25T06:42:38.370 INFO:tasks.rados.rados.0.smithi085.stdout:57: finishing write tid 5 to smithi085112113-57 2023-01-25T06:42:38.371 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 updating version 0 to 29 2023-01-25T06:42:38.371 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 version 29 is already newer than 26 2023-01-25T06:42:38.371 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 version 29 is already newer than 27 2023-01-25T06:42:38.371 INFO:tasks.rados.rados.0.smithi085.stdout:57: oid 57 updating version 29 to 30 2023-01-25T06:42:38.371 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 57 v 30 (ObjNum 56 snap 0 seq_num 56) dirty exists 2023-01-25T06:42:38.372 INFO:tasks.rados.rados.0.smithi085.stdout:57: left oid 57 (ObjNum 56 snap 0 seq_num 56) 2023-01-25T06:42:38.372 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 2 to smithi085112113-58 2023-01-25T06:42:38.372 INFO:tasks.rados.rados.0.smithi085.stdout:57: done (15 left) 2023-01-25T06:42:38.372 INFO:tasks.rados.rados.0.smithi085.stdout:73: write initial oid 73 2023-01-25T06:42:38.372 INFO:tasks.rados.rados.0.smithi085.stdout:73: seq_num 72 ranges {410104=465105,1563527=583025,2810926=399178} 2023-01-25T06:42:38.373 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112113-73 from 410104 to 875209 tid 1 2023-01-25T06:42:38.380 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112113-73 from 1563527 to 2146552 tid 2 2023-01-25T06:42:38.387 INFO:tasks.rados.rados.0.smithi085.stdout:73: writing smithi085112113-73 from 2810926 to 3210104 tid 3 2023-01-25T06:42:38.387 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.388 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 3 to smithi085112113-58 2023-01-25T06:42:38.388 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 4 to smithi085112113-58 2023-01-25T06:42:38.388 INFO:tasks.rados.rados.0.smithi085.stdout:58: finishing write tid 5 to smithi085112113-58 2023-01-25T06:42:38.388 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 updating version 0 to 46 2023-01-25T06:42:38.388 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 updating version 46 to 47 2023-01-25T06:42:38.389 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 version 47 is already newer than 44 2023-01-25T06:42:38.389 INFO:tasks.rados.rados.0.smithi085.stdout:58: oid 58 version 47 is already newer than 45 2023-01-25T06:42:38.389 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 58 v 47 (ObjNum 57 snap 0 seq_num 57) dirty exists 2023-01-25T06:42:38.389 INFO:tasks.rados.rados.0.smithi085.stdout:58: left oid 58 (ObjNum 57 snap 0 seq_num 57) 2023-01-25T06:42:38.389 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 1 to smithi085112113-59 2023-01-25T06:42:38.390 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 1 to smithi085112113-60 2023-01-25T06:42:38.390 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 2 to smithi085112113-59 2023-01-25T06:42:38.390 INFO:tasks.rados.rados.0.smithi085.stdout:58: done (15 left) 2023-01-25T06:42:38.390 INFO:tasks.rados.rados.0.smithi085.stdout:74: write initial oid 74 2023-01-25T06:42:38.391 INFO:tasks.rados.rados.0.smithi085.stdout:74: seq_num 73 ranges {426911=540354,1622009=726683,3121996=104915} 2023-01-25T06:42:38.392 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112113-74 from 426911 to 967265 tid 1 2023-01-25T06:42:38.399 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112113-74 from 1622009 to 2348692 tid 2 2023-01-25T06:42:38.405 INFO:tasks.rados.rados.0.smithi085.stdout:74: writing smithi085112113-74 from 3121996 to 3226911 tid 3 2023-01-25T06:42:38.405 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.405 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 3 to smithi085112113-59 2023-01-25T06:42:38.406 INFO:tasks.rados.rados.0.smithi085.stdout:59: finishing write tid 4 to smithi085112113-59 2023-01-25T06:42:38.406 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 updating version 0 to 46 2023-01-25T06:42:38.406 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 updating version 46 to 49 2023-01-25T06:42:38.406 INFO:tasks.rados.rados.0.smithi085.stdout:59: oid 59 version 49 is already newer than 48 2023-01-25T06:42:38.406 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 59 v 49 (ObjNum 58 snap 0 seq_num 58) dirty exists 2023-01-25T06:42:38.407 INFO:tasks.rados.rados.0.smithi085.stdout:59: left oid 59 (ObjNum 58 snap 0 seq_num 58) 2023-01-25T06:42:38.407 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 2 to smithi085112113-60 2023-01-25T06:42:38.407 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 3 to smithi085112113-60 2023-01-25T06:42:38.408 INFO:tasks.rados.rados.0.smithi085.stdout:59: done (15 left) 2023-01-25T06:42:38.408 INFO:tasks.rados.rados.0.smithi085.stdout:75: write initial oid 75 2023-01-25T06:42:38.408 INFO:tasks.rados.rados.0.smithi085.stdout:75: seq_num 74 ranges {443718=615603,1564138=470341,2633066=610652} 2023-01-25T06:42:38.410 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112113-75 from 443718 to 1059321 tid 1 2023-01-25T06:42:38.416 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112113-75 from 1564138 to 2034479 tid 2 2023-01-25T06:42:38.423 INFO:tasks.rados.rados.0.smithi085.stdout:75: writing smithi085112113-75 from 2633066 to 3243718 tid 3 2023-01-25T06:42:38.423 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.423 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 4 to smithi085112113-60 2023-01-25T06:42:38.424 INFO:tasks.rados.rados.0.smithi085.stdout:60: finishing write tid 5 to smithi085112113-60 2023-01-25T06:42:38.424 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 updating version 0 to 11 2023-01-25T06:42:38.424 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 updating version 11 to 29 2023-01-25T06:42:38.424 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 updating version 29 to 31 2023-01-25T06:42:38.424 INFO:tasks.rados.rados.0.smithi085.stdout:60: oid 60 version 31 is already newer than 30 2023-01-25T06:42:38.425 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 60 v 31 (ObjNum 59 snap 0 seq_num 59) dirty exists 2023-01-25T06:42:38.425 INFO:tasks.rados.rados.0.smithi085.stdout:60: left oid 60 (ObjNum 59 snap 0 seq_num 59) 2023-01-25T06:42:38.425 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 1 to smithi085112113-61 2023-01-25T06:42:38.425 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 2 to smithi085112113-61 2023-01-25T06:42:38.426 INFO:tasks.rados.rados.0.smithi085.stdout:60: done (15 left) 2023-01-25T06:42:38.426 INFO:tasks.rados.rados.0.smithi085.stdout:76: write initial oid 76 2023-01-25T06:42:38.426 INFO:tasks.rados.rados.0.smithi085.stdout:76: seq_num 75 ranges {460525=690852,1622620=730352,3060489=200036} 2023-01-25T06:42:38.429 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112113-76 from 460525 to 1151377 tid 1 2023-01-25T06:42:38.435 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112113-76 from 1622620 to 2352972 tid 2 2023-01-25T06:42:38.441 INFO:tasks.rados.rados.0.smithi085.stdout:76: writing smithi085112113-76 from 3060489 to 3260525 tid 3 2023-01-25T06:42:38.441 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.441 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 3 to smithi085112113-61 2023-01-25T06:42:38.441 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 4 to smithi085112113-61 2023-01-25T06:42:38.442 INFO:tasks.rados.rados.0.smithi085.stdout:61: finishing write tid 5 to smithi085112113-61 2023-01-25T06:42:38.442 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 0 to 21 2023-01-25T06:42:38.442 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 21 to 33 2023-01-25T06:42:38.442 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 version 33 is already newer than 32 2023-01-25T06:42:38.442 INFO:tasks.rados.rados.0.smithi085.stdout:61: oid 61 updating version 33 to 34 2023-01-25T06:42:38.443 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 61 v 34 (ObjNum 60 snap 0 seq_num 60) dirty exists 2023-01-25T06:42:38.443 INFO:tasks.rados.rados.0.smithi085.stdout:61: left oid 61 (ObjNum 60 snap 0 seq_num 60) 2023-01-25T06:42:38.443 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 1 to smithi085112113-62 2023-01-25T06:42:38.443 INFO:tasks.rados.rados.0.smithi085.stdout:61: done (15 left) 2023-01-25T06:42:38.443 INFO:tasks.rados.rados.0.smithi085.stdout:77: write initial oid 77 2023-01-25T06:42:38.444 INFO:tasks.rados.rados.0.smithi085.stdout:77: seq_num 76 ranges {477332=766101,1681102=474010,2687912=589420} 2023-01-25T06:42:38.447 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112113-77 from 477332 to 1243433 tid 1 2023-01-25T06:42:38.452 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112113-77 from 1681102 to 2155112 tid 2 2023-01-25T06:42:38.459 INFO:tasks.rados.rados.0.smithi085.stdout:77: writing smithi085112113-77 from 2687912 to 3277332 tid 3 2023-01-25T06:42:38.459 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.459 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 2 to smithi085112113-62 2023-01-25T06:42:38.460 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 3 to smithi085112113-62 2023-01-25T06:42:38.460 INFO:tasks.rados.rados.0.smithi085.stdout:62: finishing write tid 4 to smithi085112113-62 2023-01-25T06:42:38.460 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 updating version 0 to 12 2023-01-25T06:42:38.460 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 updating version 12 to 34 2023-01-25T06:42:38.460 INFO:tasks.rados.rados.0.smithi085.stdout:62: oid 62 version 34 is already newer than 33 2023-01-25T06:42:38.461 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 62 v 34 (ObjNum 61 snap 0 seq_num 61) dirty exists 2023-01-25T06:42:38.461 INFO:tasks.rados.rados.0.smithi085.stdout:62: left oid 62 (ObjNum 61 snap 0 seq_num 61) 2023-01-25T06:42:38.461 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 1 to smithi085112113-63 2023-01-25T06:42:38.461 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 1 to smithi085112113-64 2023-01-25T06:42:38.461 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 2 to smithi085112113-63 2023-01-25T06:42:38.462 INFO:tasks.rados.rados.0.smithi085.stdout:62: done (15 left) 2023-01-25T06:42:38.462 INFO:tasks.rados.rados.0.smithi085.stdout:78: write initial oid 78 2023-01-25T06:42:38.462 INFO:tasks.rados.rados.0.smithi085.stdout:78: seq_num 77 ranges {494139=557703,1455937=734021,2948041=346098} 2023-01-25T06:42:38.464 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112113-78 from 494139 to 1051842 tid 1 2023-01-25T06:42:38.471 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112113-78 from 1455937 to 2189958 tid 2 2023-01-25T06:42:38.477 INFO:tasks.rados.rados.0.smithi085.stdout:78: writing smithi085112113-78 from 2948041 to 3294139 tid 3 2023-01-25T06:42:38.478 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.478 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 3 to smithi085112113-63 2023-01-25T06:42:38.478 INFO:tasks.rados.rados.0.smithi085.stdout:63: finishing write tid 4 to smithi085112113-63 2023-01-25T06:42:38.478 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 updating version 0 to 33 2023-01-25T06:42:38.479 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 version 33 is already newer than 32 2023-01-25T06:42:38.479 INFO:tasks.rados.rados.0.smithi085.stdout:63: oid 63 version 33 is already newer than 28 2023-01-25T06:42:38.479 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 63 v 33 (ObjNum 62 snap 0 seq_num 62) dirty exists 2023-01-25T06:42:38.479 INFO:tasks.rados.rados.0.smithi085.stdout:63: left oid 63 (ObjNum 62 snap 0 seq_num 62) 2023-01-25T06:42:38.479 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 2 to smithi085112113-64 2023-01-25T06:42:38.480 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 3 to smithi085112113-64 2023-01-25T06:42:38.480 INFO:tasks.rados.rados.0.smithi085.stdout:63: done (15 left) 2023-01-25T06:42:38.480 INFO:tasks.rados.rados.0.smithi085.stdout:79: write initial oid 79 2023-01-25T06:42:38.480 INFO:tasks.rados.rados.0.smithi085.stdout:79: seq_num 78 ranges {510946=632952,1798066=477679,2742758=457217} 2023-01-25T06:42:38.483 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112113-79 from 510946 to 1143898 tid 1 2023-01-25T06:42:38.489 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112113-79 from 1798066 to 2275745 tid 2 2023-01-25T06:42:38.495 INFO:tasks.rados.rados.0.smithi085.stdout:79: writing smithi085112113-79 from 2742758 to 3199975 tid 3 2023-01-25T06:42:38.495 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.496 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 4 to smithi085112113-64 2023-01-25T06:42:38.496 INFO:tasks.rados.rados.0.smithi085.stdout:64: finishing write tid 5 to smithi085112113-64 2023-01-25T06:42:38.496 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 updating version 0 to 37 2023-01-25T06:42:38.496 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 version 37 is already newer than 36 2023-01-25T06:42:38.496 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 version 37 is already newer than 23 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:64: oid 64 version 37 is already newer than 22 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 64 v 37 (ObjNum 63 snap 0 seq_num 63) dirty exists 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:64: left oid 64 (ObjNum 63 snap 0 seq_num 63) 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 1 to smithi085112113-65 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 2 to smithi085112113-65 2023-01-25T06:42:38.497 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 3 to smithi085112113-65 2023-01-25T06:42:38.498 INFO:tasks.rados.rados.0.smithi085.stdout:64: done (15 left) 2023-01-25T06:42:38.498 INFO:tasks.rados.rados.0.smithi085.stdout:80: write initial oid 80 2023-01-25T06:42:38.498 INFO:tasks.rados.rados.0.smithi085.stdout:80: seq_num 79 ranges {527753=708201,1856548=737690,3286534=41219} 2023-01-25T06:42:38.501 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112113-80 from 527753 to 1235954 tid 1 2023-01-25T06:42:38.509 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112113-80 from 1856548 to 2594238 tid 2 2023-01-25T06:42:38.513 INFO:tasks.rados.rados.0.smithi085.stdout:80: writing smithi085112113-80 from 3286534 to 3327753 tid 3 2023-01-25T06:42:38.513 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.514 INFO:tasks.rados.rados.0.smithi085.stdout:65: finishing write tid 4 to smithi085112113-65 2023-01-25T06:42:38.515 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 updating version 0 to 24 2023-01-25T06:42:38.515 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 updating version 24 to 39 2023-01-25T06:42:38.515 INFO:tasks.rados.rados.0.smithi085.stdout:65: oid 65 updating version 39 to 40 2023-01-25T06:42:38.516 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 65 v 40 (ObjNum 64 snap 0 seq_num 64) dirty exists 2023-01-25T06:42:38.516 INFO:tasks.rados.rados.0.smithi085.stdout:65: left oid 65 (ObjNum 64 snap 0 seq_num 64) 2023-01-25T06:42:38.516 INFO:tasks.rados.rados.0.smithi085.stdout:65: done (15 left) 2023-01-25T06:42:38.516 INFO:tasks.rados.rados.0.smithi085.stdout:81: write initial oid 81 2023-01-25T06:42:38.517 INFO:tasks.rados.rados.0.smithi085.stdout:81: seq_num 80 ranges {544560=783450,1915030=481348,2797604=479761} 2023-01-25T06:42:38.520 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112113-81 from 544560 to 1328010 tid 1 2023-01-25T06:42:38.526 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112113-81 from 1915030 to 2396378 tid 2 2023-01-25T06:42:38.531 INFO:tasks.rados.rados.0.smithi085.stdout:81: writing smithi085112113-81 from 2797604 to 3277365 tid 3 2023-01-25T06:42:38.532 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.532 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 1 to smithi085112113-66 2023-01-25T06:42:38.532 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 2 to smithi085112113-66 2023-01-25T06:42:38.532 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 3 to smithi085112113-66 2023-01-25T06:42:38.533 INFO:tasks.rados.rados.0.smithi085.stdout:66: finishing write tid 4 to smithi085112113-66 2023-01-25T06:42:38.533 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 updating version 0 to 29 2023-01-25T06:42:38.533 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 updating version 29 to 36 2023-01-25T06:42:38.533 INFO:tasks.rados.rados.0.smithi085.stdout:66: oid 66 version 36 is already newer than 35 2023-01-25T06:42:38.533 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 66 v 36 (ObjNum 65 snap 0 seq_num 65) dirty exists 2023-01-25T06:42:38.534 INFO:tasks.rados.rados.0.smithi085.stdout:66: left oid 66 (ObjNum 65 snap 0 seq_num 65) 2023-01-25T06:42:38.534 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 1 to smithi085112113-67 2023-01-25T06:42:38.534 INFO:tasks.rados.rados.0.smithi085.stdout:66: done (15 left) 2023-01-25T06:42:38.534 INFO:tasks.rados.rados.0.smithi085.stdout:82: write initial oid 82 2023-01-25T06:42:38.534 INFO:tasks.rados.rados.0.smithi085.stdout:82: seq_num 81 ranges {561367=458699,1573512=741359,2941380=419987} 2023-01-25T06:42:38.537 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112113-82 from 561367 to 1020066 tid 1 2023-01-25T06:42:38.544 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112113-82 from 1573512 to 2314871 tid 2 2023-01-25T06:42:38.550 INFO:tasks.rados.rados.0.smithi085.stdout:82: writing smithi085112113-82 from 2941380 to 3361367 tid 3 2023-01-25T06:42:38.550 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.551 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 2 to smithi085112113-67 2023-01-25T06:42:38.551 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 3 to smithi085112113-67 2023-01-25T06:42:38.551 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 4 to smithi085112113-67 2023-01-25T06:42:38.551 INFO:tasks.rados.rados.0.smithi085.stdout:67: finishing write tid 5 to smithi085112113-67 2023-01-25T06:42:38.551 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 updating version 0 to 50 2023-01-25T06:42:38.552 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 updating version 50 to 52 2023-01-25T06:42:38.552 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 version 52 is already newer than 51 2023-01-25T06:42:38.552 INFO:tasks.rados.rados.0.smithi085.stdout:67: oid 67 version 52 is already newer than 47 2023-01-25T06:42:38.552 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 67 v 52 (ObjNum 66 snap 0 seq_num 66) dirty exists 2023-01-25T06:42:38.553 INFO:tasks.rados.rados.0.smithi085.stdout:67: left oid 67 (ObjNum 66 snap 0 seq_num 66) 2023-01-25T06:42:38.553 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 1 to smithi085112113-68 2023-01-25T06:42:38.553 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 2 to smithi085112113-68 2023-01-25T06:42:38.553 INFO:tasks.rados.rados.0.smithi085.stdout:67: done (15 left) 2023-01-25T06:42:38.553 INFO:tasks.rados.rados.0.smithi085.stdout:83: write initial oid 83 2023-01-25T06:42:38.554 INFO:tasks.rados.rados.0.smithi085.stdout:83: seq_num 82 ranges {578174=533948,1515641=485017,2736097=502305} 2023-01-25T06:42:38.556 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112113-83 from 578174 to 1112122 tid 1 2023-01-25T06:42:38.561 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112113-83 from 1515641 to 2000658 tid 2 2023-01-25T06:42:38.568 INFO:tasks.rados.rados.0.smithi085.stdout:83: writing smithi085112113-83 from 2736097 to 3238402 tid 3 2023-01-25T06:42:38.568 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.568 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 3 to smithi085112113-68 2023-01-25T06:42:38.569 INFO:tasks.rados.rados.0.smithi085.stdout:68: finishing write tid 4 to smithi085112113-68 2023-01-25T06:42:38.569 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 updating version 0 to 30 2023-01-25T06:42:38.569 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 updating version 30 to 39 2023-01-25T06:42:38.570 INFO:tasks.rados.rados.0.smithi085.stdout:68: oid 68 version 39 is already newer than 38 2023-01-25T06:42:38.570 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 68 v 39 (ObjNum 67 snap 0 seq_num 67) dirty exists 2023-01-25T06:42:38.571 INFO:tasks.rados.rados.0.smithi085.stdout:68: left oid 68 (ObjNum 67 snap 0 seq_num 67) 2023-01-25T06:42:38.571 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 1 to smithi085112113-69 2023-01-25T06:42:38.571 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 2 to smithi085112113-69 2023-01-25T06:42:38.571 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 3 to smithi085112113-69 2023-01-25T06:42:38.572 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 4 to smithi085112113-69 2023-01-25T06:42:38.572 INFO:tasks.rados.rados.0.smithi085.stdout:69: finishing write tid 5 to smithi085112113-69 2023-01-25T06:42:38.572 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 updating version 0 to 43 2023-01-25T06:42:38.572 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 version 43 is already newer than 25 2023-01-25T06:42:38.572 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 updating version 43 to 44 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:69: oid 69 version 44 is already newer than 42 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 69 v 44 (ObjNum 68 snap 0 seq_num 68) dirty exists 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:69: left oid 69 (ObjNum 68 snap 0 seq_num 68) 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 1 to smithi085112113-70 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 2 to smithi085112113-70 2023-01-25T06:42:38.573 INFO:tasks.rados.rados.0.smithi085.stdout:68: done (15 left) 2023-01-25T06:42:38.574 INFO:tasks.rados.rados.0.smithi085.stdout:69: done (14 left) 2023-01-25T06:42:38.574 INFO:tasks.rados.rados.0.smithi085.stdout:84: write initial oid 84 2023-01-25T06:42:38.574 INFO:tasks.rados.rados.0.smithi085.stdout:84: seq_num 83 ranges {594981=609197,1974123=745028,3279873=115108} 2023-01-25T06:42:38.575 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112113-84 from 594981 to 1204178 tid 1 2023-01-25T06:42:38.582 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112113-84 from 1974123 to 2719151 tid 2 2023-01-25T06:42:38.586 INFO:tasks.rados.rados.0.smithi085.stdout:84: writing smithi085112113-84 from 3279873 to 3394981 tid 3 2023-01-25T06:42:38.586 INFO:tasks.rados.rados.0.smithi085.stdout:85: write initial oid 85 2023-01-25T06:42:38.587 INFO:tasks.rados.rados.0.smithi085.stdout:85: seq_num 84 ranges {611788=400799,1748958=488686,2907296=504492} 2023-01-25T06:42:38.592 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112113-85 from 611788 to 1012587 tid 1 2023-01-25T06:42:38.598 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112113-85 from 1748958 to 2237644 tid 2 2023-01-25T06:42:38.606 INFO:tasks.rados.rados.0.smithi085.stdout:85: writing smithi085112113-85 from 2907296 to 3411788 tid 3 2023-01-25T06:42:38.606 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.606 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 3 to smithi085112113-70 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 4 to smithi085112113-70 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: finishing write tid 5 to smithi085112113-70 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 updating version 0 to 32 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 updating version 32 to 34 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 version 34 is already newer than 31 2023-01-25T06:42:38.607 INFO:tasks.rados.rados.0.smithi085.stdout:70: oid 70 version 34 is already newer than 33 2023-01-25T06:42:38.608 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 70 v 34 (ObjNum 69 snap 0 seq_num 69) dirty exists 2023-01-25T06:42:38.608 INFO:tasks.rados.rados.0.smithi085.stdout:70: left oid 70 (ObjNum 69 snap 0 seq_num 69) 2023-01-25T06:42:38.608 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 1 to smithi085112113-71 2023-01-25T06:42:38.608 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 2 to smithi085112113-71 2023-01-25T06:42:38.609 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 3 to smithi085112113-71 2023-01-25T06:42:38.609 INFO:tasks.rados.rados.0.smithi085.stdout:71: finishing write tid 4 to smithi085112113-71 2023-01-25T06:42:38.609 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 updating version 0 to 35 2023-01-25T06:42:38.609 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 updating version 35 to 37 2023-01-25T06:42:38.609 INFO:tasks.rados.rados.0.smithi085.stdout:71: oid 71 version 37 is already newer than 36 2023-01-25T06:42:38.610 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 71 v 37 (ObjNum 70 snap 0 seq_num 70) dirty exists 2023-01-25T06:42:38.610 INFO:tasks.rados.rados.0.smithi085.stdout:71: left oid 71 (ObjNum 70 snap 0 seq_num 70) 2023-01-25T06:42:38.610 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 1 to smithi085112113-72 2023-01-25T06:42:38.610 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 2 to smithi085112113-72 2023-01-25T06:42:38.610 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 3 to smithi085112113-72 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:72: finishing write tid 4 to smithi085112113-72 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 0 to 13 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 13 to 14 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:72: oid 72 updating version 14 to 15 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 72 v 15 (ObjNum 71 snap 0 seq_num 71) dirty exists 2023-01-25T06:42:38.611 INFO:tasks.rados.rados.0.smithi085.stdout:72: left oid 72 (ObjNum 71 snap 0 seq_num 71) 2023-01-25T06:42:38.612 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 1 to smithi085112113-73 2023-01-25T06:42:38.612 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 2 to smithi085112113-73 2023-01-25T06:42:38.612 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 3 to smithi085112113-73 2023-01-25T06:42:38.612 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 4 to smithi085112113-73 2023-01-25T06:42:38.612 INFO:tasks.rados.rados.0.smithi085.stdout:70: done (15 left) 2023-01-25T06:42:38.613 INFO:tasks.rados.rados.0.smithi085.stdout:71: done (14 left) 2023-01-25T06:42:38.613 INFO:tasks.rados.rados.0.smithi085.stdout:72: done (13 left) 2023-01-25T06:42:38.613 INFO:tasks.rados.rados.0.smithi085.stdout:86: write initial oid 86 2023-01-25T06:42:38.613 INFO:tasks.rados.rados.0.smithi085.stdout:86: seq_num 85 ranges {628595=476048,1807440=632344,2934719=452474} 2023-01-25T06:42:38.614 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112113-86 from 628595 to 1104643 tid 1 2023-01-25T06:42:38.618 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112113-86 from 1807440 to 2439784 tid 2 2023-01-25T06:42:38.624 INFO:tasks.rados.rados.0.smithi085.stdout:86: writing smithi085112113-86 from 2934719 to 3387193 tid 3 2023-01-25T06:42:38.624 INFO:tasks.rados.rados.0.smithi085.stdout:87: write initial oid 87 2023-01-25T06:42:38.624 INFO:tasks.rados.rados.0.smithi085.stdout:87: seq_num 86 ranges {645402=551297,1749569=492355,2845789=599613} 2023-01-25T06:42:38.630 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112113-87 from 645402 to 1196699 tid 1 2023-01-25T06:42:38.636 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112113-87 from 1749569 to 2241924 tid 2 2023-01-25T06:42:38.643 INFO:tasks.rados.rados.0.smithi085.stdout:87: writing smithi085112113-87 from 2845789 to 3445402 tid 3 2023-01-25T06:42:38.643 INFO:tasks.rados.rados.0.smithi085.stdout:88: write initial oid 88 2023-01-25T06:42:38.644 INFO:tasks.rados.rados.0.smithi085.stdout:88: seq_num 87 ranges {662209=626546,1808051=636013,2873212=588997} 2023-01-25T06:42:38.650 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112113-88 from 662209 to 1288755 tid 1 2023-01-25T06:42:38.656 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112113-88 from 1808051 to 2444064 tid 2 2023-01-25T06:42:38.662 INFO:tasks.rados.rados.0.smithi085.stdout:88: writing smithi085112113-88 from 2873212 to 3462209 tid 3 2023-01-25T06:42:38.663 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.663 INFO:tasks.rados.rados.0.smithi085.stdout:73: finishing write tid 5 to smithi085112113-73 2023-01-25T06:42:38.663 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 0 to 28 2023-01-25T06:42:38.663 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 version 28 is already newer than 27 2023-01-25T06:42:38.663 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 version 28 is already newer than 26 2023-01-25T06:42:38.664 INFO:tasks.rados.rados.0.smithi085.stdout:73: oid 73 updating version 28 to 29 2023-01-25T06:42:38.664 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 73 v 29 (ObjNum 72 snap 0 seq_num 72) dirty exists 2023-01-25T06:42:38.664 INFO:tasks.rados.rados.0.smithi085.stdout:73: left oid 73 (ObjNum 72 snap 0 seq_num 72) 2023-01-25T06:42:38.664 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 1 to smithi085112113-74 2023-01-25T06:42:38.665 INFO:tasks.rados.rados.0.smithi085.stdout:73: done (15 left) 2023-01-25T06:42:38.665 INFO:tasks.rados.rados.0.smithi085.stdout:89: write initial oid 89 2023-01-25T06:42:38.665 INFO:tasks.rados.rados.0.smithi085.stdout:89: seq_num 88 ranges {679016=701795,1866533=496024,2900635=402643} 2023-01-25T06:42:38.669 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112113-89 from 679016 to 1380811 tid 1 2023-01-25T06:42:38.676 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112113-89 from 1866533 to 2362557 tid 2 2023-01-25T06:42:38.680 INFO:tasks.rados.rados.0.smithi085.stdout:89: writing smithi085112113-89 from 2900635 to 3303278 tid 3 2023-01-25T06:42:38.680 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.681 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 2 to smithi085112113-74 2023-01-25T06:42:38.681 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 1 to smithi085112113-75 2023-01-25T06:42:38.681 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 2 to smithi085112113-75 2023-01-25T06:42:38.681 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 3 to smithi085112113-74 2023-01-25T06:42:38.682 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 4 to smithi085112113-74 2023-01-25T06:42:38.682 INFO:tasks.rados.rados.0.smithi085.stdout:74: finishing write tid 5 to smithi085112113-74 2023-01-25T06:42:38.682 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 updating version 0 to 53 2023-01-25T06:42:38.682 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 version 53 is already newer than 49 2023-01-25T06:42:38.682 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 updating version 53 to 54 2023-01-25T06:42:38.683 INFO:tasks.rados.rados.0.smithi085.stdout:74: oid 74 version 54 is already newer than 48 2023-01-25T06:42:38.683 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 74 v 54 (ObjNum 73 snap 0 seq_num 73) dirty exists 2023-01-25T06:42:38.683 INFO:tasks.rados.rados.0.smithi085.stdout:74: left oid 74 (ObjNum 73 snap 0 seq_num 73) 2023-01-25T06:42:38.683 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 3 to smithi085112113-75 2023-01-25T06:42:38.683 INFO:tasks.rados.rados.0.smithi085.stdout:74: done (15 left) 2023-01-25T06:42:38.684 INFO:tasks.rados.rados.0.smithi085.stdout:90: write initial oid 90 2023-01-25T06:42:38.684 INFO:tasks.rados.rados.0.smithi085.stdout:90: seq_num 89 ranges {695823=777044,1925015=639682,3328058=167765} 2023-01-25T06:42:38.688 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112113-90 from 695823 to 1472867 tid 1 2023-01-25T06:42:38.694 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112113-90 from 1925015 to 2564697 tid 2 2023-01-25T06:42:38.700 INFO:tasks.rados.rados.0.smithi085.stdout:90: writing smithi085112113-90 from 3328058 to 3495823 tid 3 2023-01-25T06:42:38.700 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.700 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 4 to smithi085112113-75 2023-01-25T06:42:38.701 INFO:tasks.rados.rados.0.smithi085.stdout:75: finishing write tid 5 to smithi085112113-75 2023-01-25T06:42:38.701 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 updating version 0 to 17 2023-01-25T06:42:38.701 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 updating version 17 to 19 2023-01-25T06:42:38.701 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 version 19 is already newer than 18 2023-01-25T06:42:38.701 INFO:tasks.rados.rados.0.smithi085.stdout:75: oid 75 version 19 is already newer than 16 2023-01-25T06:42:38.702 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 75 v 19 (ObjNum 74 snap 0 seq_num 74) dirty exists 2023-01-25T06:42:38.702 INFO:tasks.rados.rados.0.smithi085.stdout:75: left oid 75 (ObjNum 74 snap 0 seq_num 74) 2023-01-25T06:42:38.702 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 1 to smithi085112113-76 2023-01-25T06:42:38.702 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 2 to smithi085112113-76 2023-01-25T06:42:38.702 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 3 to smithi085112113-76 2023-01-25T06:42:38.703 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 4 to smithi085112113-76 2023-01-25T06:42:38.703 INFO:tasks.rados.rados.0.smithi085.stdout:76: finishing write tid 5 to smithi085112113-76 2023-01-25T06:42:38.704 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 updating version 0 to 41 2023-01-25T06:42:38.704 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 version 41 is already newer than 38 2023-01-25T06:42:38.704 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 version 41 is already newer than 39 2023-01-25T06:42:38.704 INFO:tasks.rados.rados.0.smithi085.stdout:76: oid 76 version 41 is already newer than 40 2023-01-25T06:42:38.705 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 76 v 41 (ObjNum 75 snap 0 seq_num 75) dirty exists 2023-01-25T06:42:38.705 INFO:tasks.rados.rados.0.smithi085.stdout:76: left oid 76 (ObjNum 75 snap 0 seq_num 75) 2023-01-25T06:42:38.705 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 1 to smithi085112113-77 2023-01-25T06:42:38.705 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 2 to smithi085112113-77 2023-01-25T06:42:38.705 INFO:tasks.rados.rados.0.smithi085.stdout:75: done (15 left) 2023-01-25T06:42:38.706 INFO:tasks.rados.rados.0.smithi085.stdout:76: done (14 left) 2023-01-25T06:42:38.706 INFO:tasks.rados.rados.0.smithi085.stdout:91: write initial oid 91 2023-01-25T06:42:38.706 INFO:tasks.rados.rados.0.smithi085.stdout:91: seq_num 90 ranges {712630=452293,1583497=499693,2555481=425187} 2023-01-25T06:42:38.707 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112113-91 from 712630 to 1164923 tid 1 2023-01-25T06:42:38.711 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112113-91 from 1583497 to 2083190 tid 2 2023-01-25T06:42:38.716 INFO:tasks.rados.rados.0.smithi085.stdout:91: writing smithi085112113-91 from 2555481 to 2980668 tid 3 2023-01-25T06:42:38.716 INFO:tasks.rados.rados.0.smithi085.stdout:92: write initial oid 92 2023-01-25T06:42:38.717 INFO:tasks.rados.rados.0.smithi085.stdout:92: seq_num 91 ranges {729437=527542,1925626=643351,3266551=262886} 2023-01-25T06:42:38.722 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112113-92 from 729437 to 1256979 tid 1 2023-01-25T06:42:38.729 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112113-92 from 1925626 to 2568977 tid 2 2023-01-25T06:42:38.737 INFO:tasks.rados.rados.0.smithi085.stdout:92: writing smithi085112113-92 from 3266551 to 3529437 tid 3 2023-01-25T06:42:38.737 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.737 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 3 to smithi085112113-77 2023-01-25T06:42:38.738 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 4 to smithi085112113-77 2023-01-25T06:42:38.738 INFO:tasks.rados.rados.0.smithi085.stdout:77: finishing write tid 5 to smithi085112113-77 2023-01-25T06:42:38.738 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 updating version 0 to 53 2023-01-25T06:42:38.738 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 version 53 is already newer than 51 2023-01-25T06:42:38.738 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 version 53 is already newer than 50 2023-01-25T06:42:38.739 INFO:tasks.rados.rados.0.smithi085.stdout:77: oid 77 version 53 is already newer than 52 2023-01-25T06:42:38.739 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 77 v 53 (ObjNum 76 snap 0 seq_num 76) dirty exists 2023-01-25T06:42:38.739 INFO:tasks.rados.rados.0.smithi085.stdout:77: left oid 77 (ObjNum 76 snap 0 seq_num 76) 2023-01-25T06:42:38.739 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 1 to smithi085112113-78 2023-01-25T06:42:38.740 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 2 to smithi085112113-78 2023-01-25T06:42:38.740 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 3 to smithi085112113-78 2023-01-25T06:42:38.741 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 4 to smithi085112113-78 2023-01-25T06:42:38.741 INFO:tasks.rados.rados.0.smithi085.stdout:78: finishing write tid 5 to smithi085112113-78 2023-01-25T06:42:38.741 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 0 to 54 2023-01-25T06:42:38.741 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 54 to 56 2023-01-25T06:42:38.742 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 version 56 is already newer than 55 2023-01-25T06:42:38.742 INFO:tasks.rados.rados.0.smithi085.stdout:78: oid 78 updating version 56 to 57 2023-01-25T06:42:38.742 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 78 v 57 (ObjNum 77 snap 0 seq_num 77) dirty exists 2023-01-25T06:42:38.742 INFO:tasks.rados.rados.0.smithi085.stdout:78: left oid 78 (ObjNum 77 snap 0 seq_num 77) 2023-01-25T06:42:38.742 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 1 to smithi085112113-79 2023-01-25T06:42:38.743 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 2 to smithi085112113-79 2023-01-25T06:42:38.743 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 3 to smithi085112113-79 2023-01-25T06:42:38.743 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 4 to smithi085112113-79 2023-01-25T06:42:38.743 INFO:tasks.rados.rados.0.smithi085.stdout:79: finishing write tid 5 to smithi085112113-79 2023-01-25T06:42:38.743 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 updating version 0 to 60 2023-01-25T06:42:38.744 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 version 60 is already newer than 58 2023-01-25T06:42:38.744 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 version 60 is already newer than 59 2023-01-25T06:42:38.744 INFO:tasks.rados.rados.0.smithi085.stdout:79: oid 79 updating version 60 to 61 2023-01-25T06:42:38.744 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 79 v 61 (ObjNum 78 snap 0 seq_num 78) dirty exists 2023-01-25T06:42:38.744 INFO:tasks.rados.rados.0.smithi085.stdout:79: left oid 79 (ObjNum 78 snap 0 seq_num 78) 2023-01-25T06:42:38.745 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 1 to smithi085112113-80 2023-01-25T06:42:38.745 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 2 to smithi085112113-80 2023-01-25T06:42:38.745 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 3 to smithi085112113-80 2023-01-25T06:42:38.745 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 4 to smithi085112113-80 2023-01-25T06:42:38.745 INFO:tasks.rados.rados.0.smithi085.stdout:80: finishing write tid 5 to smithi085112113-80 2023-01-25T06:42:38.746 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 updating version 0 to 20 2023-01-25T06:42:38.746 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 updating version 20 to 22 2023-01-25T06:42:38.746 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 updating version 22 to 23 2023-01-25T06:42:38.746 INFO:tasks.rados.rados.0.smithi085.stdout:80: oid 80 version 23 is already newer than 21 2023-01-25T06:42:38.746 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 80 v 23 (ObjNum 79 snap 0 seq_num 79) dirty exists 2023-01-25T06:42:38.747 INFO:tasks.rados.rados.0.smithi085.stdout:80: left oid 80 (ObjNum 79 snap 0 seq_num 79) 2023-01-25T06:42:38.747 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 1 to smithi085112113-81 2023-01-25T06:42:38.747 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 2 to smithi085112113-81 2023-01-25T06:42:38.747 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 3 to smithi085112113-81 2023-01-25T06:42:38.747 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 4 to smithi085112113-81 2023-01-25T06:42:38.748 INFO:tasks.rados.rados.0.smithi085.stdout:81: finishing write tid 5 to smithi085112113-81 2023-01-25T06:42:38.748 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 updating version 0 to 33 2023-01-25T06:42:38.748 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 version 33 is already newer than 32 2023-01-25T06:42:38.748 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 version 33 is already newer than 31 2023-01-25T06:42:38.748 INFO:tasks.rados.rados.0.smithi085.stdout:81: oid 81 version 33 is already newer than 30 2023-01-25T06:42:38.749 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 81 v 33 (ObjNum 80 snap 0 seq_num 80) dirty exists 2023-01-25T06:42:38.749 INFO:tasks.rados.rados.0.smithi085.stdout:81: left oid 81 (ObjNum 80 snap 0 seq_num 80) 2023-01-25T06:42:38.749 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 1 to smithi085112113-82 2023-01-25T06:42:38.749 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 2 to smithi085112113-82 2023-01-25T06:42:38.749 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 3 to smithi085112113-82 2023-01-25T06:42:38.750 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 4 to smithi085112113-82 2023-01-25T06:42:38.750 INFO:tasks.rados.rados.0.smithi085.stdout:77: done (15 left) 2023-01-25T06:42:38.750 INFO:tasks.rados.rados.0.smithi085.stdout:78: done (14 left) 2023-01-25T06:42:38.750 INFO:tasks.rados.rados.0.smithi085.stdout:79: done (13 left) 2023-01-25T06:42:38.750 INFO:tasks.rados.rados.0.smithi085.stdout:80: done (12 left) 2023-01-25T06:42:38.751 INFO:tasks.rados.rados.0.smithi085.stdout:81: done (11 left) 2023-01-25T06:42:38.751 INFO:tasks.rados.rados.0.smithi085.stdout:93: write initial oid 93 2023-01-25T06:42:38.751 INFO:tasks.rados.rados.0.smithi085.stdout:93: seq_num 92 ranges {746244=719144,2100461=503362,3126680=419564} 2023-01-25T06:42:38.752 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112113-93 from 746244 to 1465388 tid 1 2023-01-25T06:42:38.752 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112113-93 from 2100461 to 2603823 tid 2 2023-01-25T06:42:38.755 INFO:tasks.rados.rados.0.smithi085.stdout:93: writing smithi085112113-93 from 3126680 to 3546244 tid 3 2023-01-25T06:42:38.755 INFO:tasks.rados.rados.0.smithi085.stdout:94: write initial oid 94 2023-01-25T06:42:38.755 INFO:tasks.rados.rados.0.smithi085.stdout:94: seq_num 93 ranges {763051=794393,2158943=647020,3437750=125301} 2023-01-25T06:42:38.763 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112113-94 from 763051 to 1557444 tid 1 2023-01-25T06:42:38.770 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112113-94 from 2158943 to 2805963 tid 2 2023-01-25T06:42:38.774 INFO:tasks.rados.rados.0.smithi085.stdout:94: writing smithi085112113-94 from 3437750 to 3563051 tid 3 2023-01-25T06:42:38.775 INFO:tasks.rados.rados.0.smithi085.stdout:95: write initial oid 95 2023-01-25T06:42:38.775 INFO:tasks.rados.rados.0.smithi085.stdout:95: seq_num 94 ranges {779858=469642,1817425=507031,2781526=586628} 2023-01-25T06:42:38.781 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112113-95 from 779858 to 1249500 tid 1 2023-01-25T06:42:38.786 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112113-95 from 1817425 to 2324456 tid 2 2023-01-25T06:42:38.793 INFO:tasks.rados.rados.0.smithi085.stdout:95: writing smithi085112113-95 from 2781526 to 3368154 tid 3 2023-01-25T06:42:38.793 INFO:tasks.rados.rados.0.smithi085.stdout:96: write initial oid 96 2023-01-25T06:42:38.793 INFO:tasks.rados.rados.0.smithi085.stdout:82: finishing write tid 5 to smithi085112113-82 2023-01-25T06:42:38.794 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 updating version 0 to 63 2023-01-25T06:42:38.794 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 version 63 is already newer than 62 2023-01-25T06:42:38.794 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 updating version 63 to 64 2023-01-25T06:42:38.794 INFO:tasks.rados.rados.0.smithi085.stdout:82: oid 82 updating version 64 to 65 2023-01-25T06:42:38.794 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 82 v 65 (ObjNum 81 snap 0 seq_num 81) dirty exists 2023-01-25T06:42:38.795 INFO:tasks.rados.rados.0.smithi085.stdout:82: left oid 82 (ObjNum 81 snap 0 seq_num 81) 2023-01-25T06:42:38.795 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 1 to smithi085112113-83 2023-01-25T06:42:38.795 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 2 to smithi085112113-83 2023-01-25T06:42:38.795 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 3 to smithi085112113-83 2023-01-25T06:42:38.795 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 4 to smithi085112113-83 2023-01-25T06:42:38.796 INFO:tasks.rados.rados.0.smithi085.stdout:83: finishing write tid 5 to smithi085112113-83 2023-01-25T06:42:38.796 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 updating version 0 to 42 2023-01-25T06:42:38.796 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 updating version 42 to 43 2023-01-25T06:42:38.796 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 updating version 43 to 45 2023-01-25T06:42:38.796 INFO:tasks.rados.rados.0.smithi085.stdout:83: oid 83 version 45 is already newer than 44 2023-01-25T06:42:38.797 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 83 v 45 (ObjNum 82 snap 0 seq_num 82) dirty exists 2023-01-25T06:42:38.797 INFO:tasks.rados.rados.0.smithi085.stdout:83: left oid 83 (ObjNum 82 snap 0 seq_num 82) 2023-01-25T06:42:38.797 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 1 to smithi085112113-84 2023-01-25T06:42:38.797 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 2 to smithi085112113-84 2023-01-25T06:42:38.797 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 3 to smithi085112113-84 2023-01-25T06:42:38.798 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 4 to smithi085112113-84 2023-01-25T06:42:38.798 INFO:tasks.rados.rados.0.smithi085.stdout:96: seq_num 95 ranges {796665=544891,1759554=650689,2976243=620422} 2023-01-25T06:42:38.800 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112113-96 from 796665 to 1341556 tid 1 2023-01-25T06:42:38.806 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112113-96 from 1759554 to 2410243 tid 2 2023-01-25T06:42:38.813 INFO:tasks.rados.rados.0.smithi085.stdout:96: writing smithi085112113-96 from 2976243 to 3596665 tid 3 2023-01-25T06:42:38.813 INFO:tasks.rados.rados.0.smithi085.stdout:82: done (14 left) 2023-01-25T06:42:38.813 INFO:tasks.rados.rados.0.smithi085.stdout:83: done (13 left) 2023-01-25T06:42:38.813 INFO:tasks.rados.rados.0.smithi085.stdout:97: write initial oid 97 2023-01-25T06:42:38.814 INFO:tasks.rados.rados.0.smithi085.stdout:97: seq_num 96 ranges {413472=620140,1818036=510700,3120019=493453} 2023-01-25T06:42:38.818 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112113-97 from 413472 to 1033612 tid 1 2023-01-25T06:42:38.825 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112113-97 from 1818036 to 2328736 tid 2 2023-01-25T06:42:38.833 INFO:tasks.rados.rados.0.smithi085.stdout:97: writing smithi085112113-97 from 3120019 to 3613472 tid 3 2023-01-25T06:42:38.833 INFO:tasks.rados.rados.0.smithi085.stdout:98: write initial oid 98 2023-01-25T06:42:38.833 INFO:tasks.rados.rados.0.smithi085.stdout:84: finishing write tid 5 to smithi085112113-84 2023-01-25T06:42:38.834 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 updating version 0 to 49 2023-01-25T06:42:38.834 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 version 49 is already newer than 47 2023-01-25T06:42:38.834 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 version 49 is already newer than 46 2023-01-25T06:42:38.834 INFO:tasks.rados.rados.0.smithi085.stdout:84: oid 84 version 49 is already newer than 48 2023-01-25T06:42:38.834 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 84 v 49 (ObjNum 83 snap 0 seq_num 83) dirty exists 2023-01-25T06:42:38.835 INFO:tasks.rados.rados.0.smithi085.stdout:84: left oid 84 (ObjNum 83 snap 0 seq_num 83) 2023-01-25T06:42:38.835 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 1 to smithi085112113-85 2023-01-25T06:42:38.835 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 2 to smithi085112113-85 2023-01-25T06:42:38.835 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 3 to smithi085112113-85 2023-01-25T06:42:38.835 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 4 to smithi085112113-85 2023-01-25T06:42:38.836 INFO:tasks.rados.rados.0.smithi085.stdout:85: finishing write tid 5 to smithi085112113-85 2023-01-25T06:42:38.836 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 0 to 35 2023-01-25T06:42:38.836 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 35 to 36 2023-01-25T06:42:38.836 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 updating version 36 to 37 2023-01-25T06:42:38.836 INFO:tasks.rados.rados.0.smithi085.stdout:85: oid 85 version 37 is already newer than 34 2023-01-25T06:42:38.837 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 85 v 37 (ObjNum 84 snap 0 seq_num 84) dirty exists 2023-01-25T06:42:38.837 INFO:tasks.rados.rados.0.smithi085.stdout:85: left oid 85 (ObjNum 84 snap 0 seq_num 84) 2023-01-25T06:42:38.837 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 1 to smithi085112113-86 2023-01-25T06:42:38.837 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 2 to smithi085112113-86 2023-01-25T06:42:38.837 INFO:tasks.rados.rados.0.smithi085.stdout:98: seq_num 97 ranges {430279=695389,1876518=654358,3031089=536797} 2023-01-25T06:42:38.839 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112113-98 from 430279 to 1125668 tid 1 2023-01-25T06:42:38.847 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112113-98 from 1876518 to 2530876 tid 2 2023-01-25T06:42:38.853 INFO:tasks.rados.rados.0.smithi085.stdout:98: writing smithi085112113-98 from 3031089 to 3567886 tid 3 2023-01-25T06:42:38.853 INFO:tasks.rados.rados.0.smithi085.stdout:84: done (14 left) 2023-01-25T06:42:38.853 INFO:tasks.rados.rados.0.smithi085.stdout:85: done (13 left) 2023-01-25T06:42:38.853 INFO:tasks.rados.rados.0.smithi085.stdout:99: write initial oid 99 2023-01-25T06:42:38.853 INFO:tasks.rados.rados.0.smithi085.stdout:99: seq_num 98 ranges {447086=770638,1935000=798016,3458512=188574} 2023-01-25T06:42:38.859 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112113-99 from 447086 to 1217724 tid 1 2023-01-25T06:42:38.868 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112113-99 from 1935000 to 2733016 tid 2 2023-01-25T06:42:38.873 INFO:tasks.rados.rados.0.smithi085.stdout:99: writing smithi085112113-99 from 3458512 to 3647086 tid 3 2023-01-25T06:42:38.873 INFO:tasks.rados.rados.0.smithi085.stdout:100: write initial oid 100 2023-01-25T06:42:38.873 INFO:tasks.rados.rados.0.smithi085.stdout:100: seq_num 99 ranges {463893=562240,1593482=658027,2685935=559341} 2023-01-25T06:42:38.878 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112113-100 from 463893 to 1026133 tid 1 2023-01-25T06:42:38.885 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112113-100 from 1593482 to 2251509 tid 2 2023-01-25T06:42:38.891 INFO:tasks.rados.rados.0.smithi085.stdout:100: writing smithi085112113-100 from 2685935 to 3245276 tid 3 2023-01-25T06:42:38.891 INFO:tasks.rados.rados.0.smithi085.stdout:101: write initial oid 101 2023-01-25T06:42:38.891 INFO:tasks.rados.rados.0.smithi085.stdout:101: seq_num 100 ranges {480700=637489,1651964=401685,2713358=770613} 2023-01-25T06:42:38.897 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112113-101 from 480700 to 1118189 tid 1 2023-01-25T06:42:38.902 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112113-101 from 1651964 to 2053649 tid 2 2023-01-25T06:42:38.911 INFO:tasks.rados.rados.0.smithi085.stdout:101: writing smithi085112113-101 from 2713358 to 3483971 tid 3 2023-01-25T06:42:38.911 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.911 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 3 to smithi085112113-86 2023-01-25T06:42:38.911 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 4 to smithi085112113-86 2023-01-25T06:42:38.912 INFO:tasks.rados.rados.0.smithi085.stdout:86: finishing write tid 5 to smithi085112113-86 2023-01-25T06:42:38.912 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 0 to 67 2023-01-25T06:42:38.912 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 67 to 68 2023-01-25T06:42:38.912 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 version 68 is already newer than 66 2023-01-25T06:42:38.912 INFO:tasks.rados.rados.0.smithi085.stdout:86: oid 86 updating version 68 to 69 2023-01-25T06:42:38.913 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 86 v 69 (ObjNum 85 snap 0 seq_num 85) dirty exists 2023-01-25T06:42:38.913 INFO:tasks.rados.rados.0.smithi085.stdout:86: left oid 86 (ObjNum 85 snap 0 seq_num 85) 2023-01-25T06:42:38.913 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 1 to smithi085112113-87 2023-01-25T06:42:38.913 INFO:tasks.rados.rados.0.smithi085.stdout:86: done (15 left) 2023-01-25T06:42:38.913 INFO:tasks.rados.rados.0.smithi085.stdout:102: write initial oid 102 2023-01-25T06:42:38.914 INFO:tasks.rados.rados.0.smithi085.stdout:102: seq_num 101 ranges {497507=712738,1710446=661696,3140781=556726} 2023-01-25T06:42:38.917 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112113-102 from 497507 to 1210245 tid 1 2023-01-25T06:42:38.924 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112113-102 from 1710446 to 2372142 tid 2 2023-01-25T06:42:38.932 INFO:tasks.rados.rados.0.smithi085.stdout:102: writing smithi085112113-102 from 3140781 to 3697507 tid 3 2023-01-25T06:42:38.932 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.932 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 2 to smithi085112113-87 2023-01-25T06:42:38.932 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 3 to smithi085112113-87 2023-01-25T06:42:38.933 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 4 to smithi085112113-87 2023-01-25T06:42:38.933 INFO:tasks.rados.rados.0.smithi085.stdout:87: finishing write tid 5 to smithi085112113-87 2023-01-25T06:42:38.933 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 0 to 50 2023-01-25T06:42:38.933 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 50 to 51 2023-01-25T06:42:38.933 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 51 to 52 2023-01-25T06:42:38.934 INFO:tasks.rados.rados.0.smithi085.stdout:87: oid 87 updating version 52 to 53 2023-01-25T06:42:38.934 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 87 v 53 (ObjNum 86 snap 0 seq_num 86) dirty exists 2023-01-25T06:42:38.934 INFO:tasks.rados.rados.0.smithi085.stdout:87: left oid 87 (ObjNum 86 snap 0 seq_num 86) 2023-01-25T06:42:38.934 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 1 to smithi085112113-88 2023-01-25T06:42:38.934 INFO:tasks.rados.rados.0.smithi085.stdout:87: done (15 left) 2023-01-25T06:42:38.935 INFO:tasks.rados.rados.0.smithi085.stdout:103: write initial oid 103 2023-01-25T06:42:38.935 INFO:tasks.rados.rados.0.smithi085.stdout:103: seq_num 102 ranges {514314=787987,1768928=405354,2768204=509510} 2023-01-25T06:42:38.939 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112113-103 from 514314 to 1302301 tid 1 2023-01-25T06:42:38.944 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112113-103 from 1768928 to 2174282 tid 2 2023-01-25T06:42:38.950 INFO:tasks.rados.rados.0.smithi085.stdout:103: writing smithi085112113-103 from 2768204 to 3277714 tid 3 2023-01-25T06:42:38.951 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.951 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 2 to smithi085112113-88 2023-01-25T06:42:38.951 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 3 to smithi085112113-88 2023-01-25T06:42:38.951 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 4 to smithi085112113-88 2023-01-25T06:42:38.952 INFO:tasks.rados.rados.0.smithi085.stdout:88: finishing write tid 5 to smithi085112113-88 2023-01-25T06:42:38.952 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 updating version 0 to 26 2023-01-25T06:42:38.952 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 version 26 is already newer than 25 2023-01-25T06:42:38.952 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 updating version 26 to 27 2023-01-25T06:42:38.952 INFO:tasks.rados.rados.0.smithi085.stdout:88: oid 88 version 27 is already newer than 24 2023-01-25T06:42:38.953 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 88 v 27 (ObjNum 87 snap 0 seq_num 87) dirty exists 2023-01-25T06:42:38.953 INFO:tasks.rados.rados.0.smithi085.stdout:88: left oid 88 (ObjNum 87 snap 0 seq_num 87) 2023-01-25T06:42:38.953 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 1 to smithi085112113-89 2023-01-25T06:42:38.953 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 2 to smithi085112113-89 2023-01-25T06:42:38.953 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 3 to smithi085112113-89 2023-01-25T06:42:38.954 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 4 to smithi085112113-89 2023-01-25T06:42:38.954 INFO:tasks.rados.rados.0.smithi085.stdout:89: finishing write tid 5 to smithi085112113-89 2023-01-25T06:42:38.954 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 updating version 0 to 57 2023-01-25T06:42:38.954 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 version 57 is already newer than 55 2023-01-25T06:42:38.954 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 version 57 is already newer than 54 2023-01-25T06:42:38.955 INFO:tasks.rados.rados.0.smithi085.stdout:89: oid 89 version 57 is already newer than 56 2023-01-25T06:42:38.955 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 89 v 57 (ObjNum 88 snap 0 seq_num 88) dirty exists 2023-01-25T06:42:38.955 INFO:tasks.rados.rados.0.smithi085.stdout:89: left oid 89 (ObjNum 88 snap 0 seq_num 88) 2023-01-25T06:42:38.955 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 1 to smithi085112113-90 2023-01-25T06:42:38.955 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 2 to smithi085112113-90 2023-01-25T06:42:38.956 INFO:tasks.rados.rados.0.smithi085.stdout:88: done (15 left) 2023-01-25T06:42:38.956 INFO:tasks.rados.rados.0.smithi085.stdout:89: done (14 left) 2023-01-25T06:42:38.956 INFO:tasks.rados.rados.0.smithi085.stdout:104: write initial oid 104 2023-01-25T06:42:38.956 INFO:tasks.rados.rados.0.smithi085.stdout:104: seq_num 103 ranges {531121=463236,1711057=665365,3079274=651847} 2023-01-25T06:42:38.957 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112113-104 from 531121 to 994357 tid 1 2023-01-25T06:42:38.963 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112113-104 from 1711057 to 2376422 tid 2 2023-01-25T06:42:38.971 INFO:tasks.rados.rados.0.smithi085.stdout:104: writing smithi085112113-104 from 3079274 to 3731121 tid 3 2023-01-25T06:42:38.971 INFO:tasks.rados.rados.0.smithi085.stdout:105: write initial oid 105 2023-01-25T06:42:38.971 INFO:tasks.rados.rados.0.smithi085.stdout:105: seq_num 104 ranges {547928=538485,1769539=409023,2706697=532054} 2023-01-25T06:42:38.977 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112113-105 from 547928 to 1086413 tid 1 2023-01-25T06:42:38.983 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112113-105 from 1769539 to 2178562 tid 2 2023-01-25T06:42:38.991 INFO:tasks.rados.rados.0.smithi085.stdout:105: writing smithi085112113-105 from 2706697 to 3238751 tid 3 2023-01-25T06:42:38.991 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:38.992 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 3 to smithi085112113-90 2023-01-25T06:42:38.992 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 4 to smithi085112113-90 2023-01-25T06:42:38.992 INFO:tasks.rados.rados.0.smithi085.stdout:90: finishing write tid 5 to smithi085112113-90 2023-01-25T06:42:38.993 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 updating version 0 to 59 2023-01-25T06:42:38.993 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 updating version 59 to 60 2023-01-25T06:42:38.993 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 updating version 60 to 61 2023-01-25T06:42:38.993 INFO:tasks.rados.rados.0.smithi085.stdout:90: oid 90 version 61 is already newer than 58 2023-01-25T06:42:38.993 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 90 v 61 (ObjNum 89 snap 0 seq_num 89) dirty exists 2023-01-25T06:42:38.994 INFO:tasks.rados.rados.0.smithi085.stdout:90: left oid 90 (ObjNum 89 snap 0 seq_num 89) 2023-01-25T06:42:38.994 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 1 to smithi085112113-91 2023-01-25T06:42:38.994 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 2 to smithi085112113-91 2023-01-25T06:42:38.994 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 3 to smithi085112113-91 2023-01-25T06:42:38.994 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 4 to smithi085112113-91 2023-01-25T06:42:38.995 INFO:tasks.rados.rados.0.smithi085.stdout:91: finishing write tid 5 to smithi085112113-91 2023-01-25T06:42:38.995 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 updating version 0 to 31 2023-01-25T06:42:38.995 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 31 is already newer than 30 2023-01-25T06:42:38.995 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 31 is already newer than 28 2023-01-25T06:42:38.995 INFO:tasks.rados.rados.0.smithi085.stdout:91: oid 91 version 31 is already newer than 29 2023-01-25T06:42:38.996 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 91 v 31 (ObjNum 90 snap 0 seq_num 90) dirty exists 2023-01-25T06:42:38.996 INFO:tasks.rados.rados.0.smithi085.stdout:91: left oid 91 (ObjNum 90 snap 0 seq_num 90) 2023-01-25T06:42:38.996 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 1 to smithi085112113-92 2023-01-25T06:42:38.996 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 2 to smithi085112113-92 2023-01-25T06:42:38.996 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 3 to smithi085112113-92 2023-01-25T06:42:38.997 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 4 to smithi085112113-92 2023-01-25T06:42:38.997 INFO:tasks.rados.rados.0.smithi085.stdout:92: finishing write tid 5 to smithi085112113-92 2023-01-25T06:42:38.997 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 updating version 0 to 32 2023-01-25T06:42:38.997 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 updating version 32 to 35 2023-01-25T06:42:38.997 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 version 35 is already newer than 34 2023-01-25T06:42:38.998 INFO:tasks.rados.rados.0.smithi085.stdout:92: oid 92 version 35 is already newer than 33 2023-01-25T06:42:38.998 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 92 v 35 (ObjNum 91 snap 0 seq_num 91) dirty exists 2023-01-25T06:42:38.998 INFO:tasks.rados.rados.0.smithi085.stdout:92: left oid 92 (ObjNum 91 snap 0 seq_num 91) 2023-01-25T06:42:38.998 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 1 to smithi085112113-93 2023-01-25T06:42:38.998 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 2 to smithi085112113-93 2023-01-25T06:42:38.999 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 3 to smithi085112113-93 2023-01-25T06:42:38.999 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 4 to smithi085112113-93 2023-01-25T06:42:38.999 INFO:tasks.rados.rados.0.smithi085.stdout:93: finishing write tid 5 to smithi085112113-93 2023-01-25T06:42:38.999 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 updating version 0 to 37 2023-01-25T06:42:38.999 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 version 37 is already newer than 36 2023-01-25T06:42:39.000 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 updating version 37 to 38 2023-01-25T06:42:39.000 INFO:tasks.rados.rados.0.smithi085.stdout:93: oid 93 updating version 38 to 39 2023-01-25T06:42:39.000 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 93 v 39 (ObjNum 92 snap 0 seq_num 92) dirty exists 2023-01-25T06:42:39.000 INFO:tasks.rados.rados.0.smithi085.stdout:93: left oid 93 (ObjNum 92 snap 0 seq_num 92) 2023-01-25T06:42:39.000 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 1 to smithi085112113-94 2023-01-25T06:42:39.001 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 2 to smithi085112113-94 2023-01-25T06:42:39.001 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 3 to smithi085112113-94 2023-01-25T06:42:39.001 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 4 to smithi085112113-94 2023-01-25T06:42:39.001 INFO:tasks.rados.rados.0.smithi085.stdout:94: finishing write tid 5 to smithi085112113-94 2023-01-25T06:42:39.001 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 updating version 0 to 41 2023-01-25T06:42:39.002 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 updating version 41 to 43 2023-01-25T06:42:39.002 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 version 43 is already newer than 40 2023-01-25T06:42:39.002 INFO:tasks.rados.rados.0.smithi085.stdout:94: oid 94 version 43 is already newer than 42 2023-01-25T06:42:39.002 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 94 v 43 (ObjNum 93 snap 0 seq_num 93) dirty exists 2023-01-25T06:42:39.002 INFO:tasks.rados.rados.0.smithi085.stdout:94: left oid 94 (ObjNum 93 snap 0 seq_num 93) 2023-01-25T06:42:39.003 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 1 to smithi085112113-95 2023-01-25T06:42:39.003 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 2 to smithi085112113-95 2023-01-25T06:42:39.003 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 3 to smithi085112113-95 2023-01-25T06:42:39.003 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 4 to smithi085112113-95 2023-01-25T06:42:39.003 INFO:tasks.rados.rados.0.smithi085.stdout:95: finishing write tid 5 to smithi085112113-95 2023-01-25T06:42:39.004 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 updating version 0 to 72 2023-01-25T06:42:39.004 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 version 72 is already newer than 70 2023-01-25T06:42:39.004 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 updating version 72 to 73 2023-01-25T06:42:39.004 INFO:tasks.rados.rados.0.smithi085.stdout:95: oid 95 version 73 is already newer than 71 2023-01-25T06:42:39.004 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 95 v 73 (ObjNum 94 snap 0 seq_num 94) dirty exists 2023-01-25T06:42:39.005 INFO:tasks.rados.rados.0.smithi085.stdout:95: left oid 95 (ObjNum 94 snap 0 seq_num 94) 2023-01-25T06:42:39.005 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 1 to smithi085112113-96 2023-01-25T06:42:39.005 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 2 to smithi085112113-96 2023-01-25T06:42:39.005 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 3 to smithi085112113-96 2023-01-25T06:42:39.005 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 4 to smithi085112113-96 2023-01-25T06:42:39.006 INFO:tasks.rados.rados.0.smithi085.stdout:96: finishing write tid 5 to smithi085112113-96 2023-01-25T06:42:39.006 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 updating version 0 to 75 2023-01-25T06:42:39.006 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 updating version 75 to 77 2023-01-25T06:42:39.006 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 version 77 is already newer than 74 2023-01-25T06:42:39.006 INFO:tasks.rados.rados.0.smithi085.stdout:96: oid 96 version 77 is already newer than 76 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 96 v 77 (ObjNum 95 snap 0 seq_num 95) dirty exists 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:96: left oid 96 (ObjNum 95 snap 0 seq_num 95) 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 1 to smithi085112113-97 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 2 to smithi085112113-97 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 3 to smithi085112113-97 2023-01-25T06:42:39.007 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 4 to smithi085112113-97 2023-01-25T06:42:39.008 INFO:tasks.rados.rados.0.smithi085.stdout:97: finishing write tid 5 to smithi085112113-97 2023-01-25T06:42:39.008 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 0 to 62 2023-01-25T06:42:39.008 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 62 to 63 2023-01-25T06:42:39.008 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 63 to 64 2023-01-25T06:42:39.008 INFO:tasks.rados.rados.0.smithi085.stdout:97: oid 97 updating version 64 to 65 2023-01-25T06:42:39.009 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 97 v 65 (ObjNum 96 snap 0 seq_num 96) dirty exists 2023-01-25T06:42:39.009 INFO:tasks.rados.rados.0.smithi085.stdout:97: left oid 97 (ObjNum 96 snap 0 seq_num 96) 2023-01-25T06:42:39.009 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 1 to smithi085112113-98 2023-01-25T06:42:39.009 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 2 to smithi085112113-98 2023-01-25T06:42:39.009 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 3 to smithi085112113-98 2023-01-25T06:42:39.010 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 4 to smithi085112113-98 2023-01-25T06:42:39.010 INFO:tasks.rados.rados.0.smithi085.stdout:98: finishing write tid 5 to smithi085112113-98 2023-01-25T06:42:39.010 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 updating version 0 to 44 2023-01-25T06:42:39.010 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 updating version 44 to 47 2023-01-25T06:42:39.010 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 version 47 is already newer than 46 2023-01-25T06:42:39.011 INFO:tasks.rados.rados.0.smithi085.stdout:98: oid 98 version 47 is already newer than 45 2023-01-25T06:42:39.011 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 98 v 47 (ObjNum 97 snap 0 seq_num 97) dirty exists 2023-01-25T06:42:39.011 INFO:tasks.rados.rados.0.smithi085.stdout:98: left oid 98 (ObjNum 97 snap 0 seq_num 97) 2023-01-25T06:42:39.011 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 1 to smithi085112113-99 2023-01-25T06:42:39.012 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 2 to smithi085112113-99 2023-01-25T06:42:39.012 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 3 to smithi085112113-99 2023-01-25T06:42:39.012 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 4 to smithi085112113-99 2023-01-25T06:42:39.012 INFO:tasks.rados.rados.0.smithi085.stdout:99: finishing write tid 5 to smithi085112113-99 2023-01-25T06:42:39.012 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 0 to 66 2023-01-25T06:42:39.013 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 66 to 68 2023-01-25T06:42:39.013 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 updating version 68 to 69 2023-01-25T06:42:39.013 INFO:tasks.rados.rados.0.smithi085.stdout:99: oid 99 version 69 is already newer than 67 2023-01-25T06:42:39.013 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 99 v 69 (ObjNum 98 snap 0 seq_num 98) dirty exists 2023-01-25T06:42:39.013 INFO:tasks.rados.rados.0.smithi085.stdout:99: left oid 99 (ObjNum 98 snap 0 seq_num 98) 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 1 to smithi085112113-100 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 2 to smithi085112113-100 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 3 to smithi085112113-100 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 4 to smithi085112113-100 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:90: done (15 left) 2023-01-25T06:42:39.014 INFO:tasks.rados.rados.0.smithi085.stdout:91: done (14 left) 2023-01-25T06:42:39.015 INFO:tasks.rados.rados.0.smithi085.stdout:92: done (13 left) 2023-01-25T06:42:39.015 INFO:tasks.rados.rados.0.smithi085.stdout:93: done (12 left) 2023-01-25T06:42:39.015 INFO:tasks.rados.rados.0.smithi085.stdout:94: done (11 left) 2023-01-25T06:42:39.015 INFO:tasks.rados.rados.0.smithi085.stdout:95: done (10 left) 2023-01-25T06:42:39.015 INFO:tasks.rados.rados.0.smithi085.stdout:96: done (9 left) 2023-01-25T06:42:39.016 INFO:tasks.rados.rados.0.smithi085.stdout:97: done (8 left) 2023-01-25T06:42:39.016 INFO:tasks.rados.rados.0.smithi085.stdout:98: done (7 left) 2023-01-25T06:42:39.016 INFO:tasks.rados.rados.0.smithi085.stdout:99: done (6 left) 2023-01-25T06:42:39.016 INFO:tasks.rados.rados.0.smithi085.stdout:106: write initial oid 106 2023-01-25T06:42:39.016 INFO:tasks.rados.rados.0.smithi085.stdout:106: seq_num 105 ranges {564735=613734,1828021=669034,3134120=630615} 2023-01-25T06:42:39.018 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112113-106 from 564735 to 1178469 tid 1 2023-01-25T06:42:39.018 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112113-106 from 1828021 to 2497055 tid 2 2023-01-25T06:42:39.018 INFO:tasks.rados.rados.0.smithi085.stdout:106: writing smithi085112113-106 from 3134120 to 3764735 tid 3 2023-01-25T06:42:39.018 INFO:tasks.rados.rados.0.smithi085.stdout:107: write initial oid 107 2023-01-25T06:42:39.018 INFO:tasks.rados.rados.0.smithi085.stdout:107: seq_num 106 ranges {581542=688983,1886503=412692,2761543=670951} 2023-01-25T06:42:39.019 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112113-107 from 581542 to 1270525 tid 1 2023-01-25T06:42:39.022 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112113-107 from 1886503 to 2299195 tid 2 2023-01-25T06:42:39.028 INFO:tasks.rados.rados.0.smithi085.stdout:107: writing smithi085112113-107 from 2761543 to 3432494 tid 3 2023-01-25T06:42:39.029 INFO:tasks.rados.rados.0.smithi085.stdout:108: write initial oid 108 2023-01-25T06:42:39.029 INFO:tasks.rados.rados.0.smithi085.stdout:108: seq_num 107 ranges {598349=480585,1544985=672703,2905319=482223} 2023-01-25T06:42:39.034 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112113-108 from 598349 to 1078934 tid 1 2023-01-25T06:42:39.041 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112113-108 from 1544985 to 2217688 tid 2 2023-01-25T06:42:39.047 INFO:tasks.rados.rados.0.smithi085.stdout:108: writing smithi085112113-108 from 2905319 to 3387542 tid 3 2023-01-25T06:42:39.047 INFO:tasks.rados.rados.0.smithi085.stdout:109: write initial oid 109 2023-01-25T06:42:39.048 INFO:tasks.rados.rados.0.smithi085.stdout:109: seq_num 108 ranges {615156=555834,1603467=416361,2816389=693495} 2023-01-25T06:42:39.054 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112113-109 from 615156 to 1170990 tid 1 2023-01-25T06:42:39.058 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112113-109 from 1603467 to 2019828 tid 2 2023-01-25T06:42:39.067 INFO:tasks.rados.rados.0.smithi085.stdout:109: writing smithi085112113-109 from 2816389 to 3509884 tid 3 2023-01-25T06:42:39.067 INFO:tasks.rados.rados.0.smithi085.stdout:110: write initial oid 110 2023-01-25T06:42:39.068 INFO:tasks.rados.rados.0.smithi085.stdout:110: seq_num 109 ranges {631963=631083,2061949=560019,3243812=504767} 2023-01-25T06:42:39.074 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112113-110 from 631963 to 1263046 tid 1 2023-01-25T06:42:39.082 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112113-110 from 2061949 to 2621968 tid 2 2023-01-25T06:42:39.089 INFO:tasks.rados.rados.0.smithi085.stdout:110: writing smithi085112113-110 from 3243812 to 3748579 tid 3 2023-01-25T06:42:39.090 INFO:tasks.rados.rados.0.smithi085.stdout:111: write initial oid 111 2023-01-25T06:42:39.090 INFO:tasks.rados.rados.0.smithi085.stdout:111: seq_num 110 ranges {648770=706332,2120431=420030,3271235=432392} 2023-01-25T06:42:39.095 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112113-111 from 648770 to 1355102 tid 1 2023-01-25T06:42:39.102 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112113-111 from 2120431 to 2540461 tid 2 2023-01-25T06:42:39.108 INFO:tasks.rados.rados.0.smithi085.stdout:111: writing smithi085112113-111 from 3271235 to 3703627 tid 3 2023-01-25T06:42:39.109 INFO:tasks.rados.rados.0.smithi085.stdout:112: write initial oid 112 2023-01-25T06:42:39.109 INFO:tasks.rados.rados.0.smithi085.stdout:112: seq_num 111 ranges {665577=781581,2062560=563688,3182305=643664} 2023-01-25T06:42:39.116 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112113-112 from 665577 to 1447158 tid 1 2023-01-25T06:42:39.123 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112113-112 from 2062560 to 2626248 tid 2 2023-01-25T06:42:39.130 INFO:tasks.rados.rados.0.smithi085.stdout:112: writing smithi085112113-112 from 3182305 to 3825969 tid 3 2023-01-25T06:42:39.130 INFO:tasks.rados.rados.0.smithi085.stdout:113: write initial oid 113 2023-01-25T06:42:39.130 INFO:tasks.rados.rados.0.smithi085.stdout:113: seq_num 112 ranges {682384=456830,1721042=423699,2809728=454936,3731357=151027} 2023-01-25T06:42:39.136 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112113-113 from 682384 to 1139214 tid 1 2023-01-25T06:42:39.142 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112113-113 from 1721042 to 2144741 tid 2 2023-01-25T06:42:39.148 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112113-113 from 2809728 to 3264664 tid 3 2023-01-25T06:42:39.152 INFO:tasks.rados.rados.0.smithi085.stdout:113: writing smithi085112113-113 from 3731357 to 3882384 tid 4 2023-01-25T06:42:39.152 INFO:tasks.rados.rados.0.smithi085.stdout:114: write initial oid 114 2023-01-25T06:42:39.153 INFO:tasks.rados.rados.0.smithi085.stdout:114: seq_num 113 ranges {699191=532079,1779524=567357,2837151=666208} 2023-01-25T06:42:39.158 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112113-114 from 699191 to 1231270 tid 1 2023-01-25T06:42:39.164 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112113-114 from 1779524 to 2346881 tid 2 2023-01-25T06:42:39.171 INFO:tasks.rados.rados.0.smithi085.stdout:114: writing smithi085112113-114 from 2837151 to 3503359 tid 3 2023-01-25T06:42:39.171 INFO:tasks.rados.rados.0.smithi085.stdout:115: write initial oid 115 2023-01-25T06:42:39.171 INFO:tasks.rados.rados.0.smithi085.stdout:115: seq_num 114 ranges {715998=607328,1838006=427368,2864574=477480,3863835=52163} 2023-01-25T06:42:39.178 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112113-115 from 715998 to 1323326 tid 1 2023-01-25T06:42:39.183 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112113-115 from 1838006 to 2265374 tid 2 2023-01-25T06:42:39.189 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112113-115 from 2864574 to 3342054 tid 3 2023-01-25T06:42:39.193 INFO:tasks.rados.rados.0.smithi085.stdout:115: writing smithi085112113-115 from 3863835 to 3915998 tid 4 2023-01-25T06:42:39.193 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.193 INFO:tasks.rados.rados.0.smithi085.stdout:100: finishing write tid 5 to smithi085112113-100 2023-01-25T06:42:39.193 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 updating version 0 to 70 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 updating version 70 to 73 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 version 73 is already newer than 71 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:100: oid 100 version 73 is already newer than 72 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 100 v 73 (ObjNum 99 snap 0 seq_num 99) dirty exists 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:100: left oid 100 (ObjNum 99 snap 0 seq_num 99) 2023-01-25T06:42:39.194 INFO:tasks.rados.rados.0.smithi085.stdout:100: done (15 left) 2023-01-25T06:42:39.195 INFO:tasks.rados.rados.0.smithi085.stdout:116: write initial oid 116 2023-01-25T06:42:39.195 INFO:tasks.rados.rados.0.smithi085.stdout:116: seq_num 115 ranges {732805=798930,2296488=571026,3291997=405105} 2023-01-25T06:42:39.201 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112113-116 from 732805 to 1531735 tid 1 2023-01-25T06:42:39.208 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112113-116 from 2296488 to 2867514 tid 2 2023-01-25T06:42:39.217 INFO:tasks.rados.rados.0.smithi085.stdout:116: writing smithi085112113-116 from 3291997 to 3697102 tid 3 2023-01-25T06:42:39.217 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.217 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 1 to smithi085112113-101 2023-01-25T06:42:39.218 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 2 to smithi085112113-101 2023-01-25T06:42:39.218 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 3 to smithi085112113-101 2023-01-25T06:42:39.218 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 4 to smithi085112113-101 2023-01-25T06:42:39.218 INFO:tasks.rados.rados.0.smithi085.stdout:101: finishing write tid 5 to smithi085112113-101 2023-01-25T06:42:39.218 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 updating version 0 to 41 2023-01-25T06:42:39.219 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 41 is already newer than 38 2023-01-25T06:42:39.219 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 41 is already newer than 40 2023-01-25T06:42:39.219 INFO:tasks.rados.rados.0.smithi085.stdout:101: oid 101 version 41 is already newer than 39 2023-01-25T06:42:39.219 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 101 v 41 (ObjNum 100 snap 0 seq_num 100) dirty exists 2023-01-25T06:42:39.219 INFO:tasks.rados.rados.0.smithi085.stdout:101: left oid 101 (ObjNum 100 snap 0 seq_num 100) 2023-01-25T06:42:39.220 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 1 to smithi085112113-102 2023-01-25T06:42:39.220 INFO:tasks.rados.rados.0.smithi085.stdout:101: done (15 left) 2023-01-25T06:42:39.220 INFO:tasks.rados.rados.0.smithi085.stdout:117: write initial oid 117 2023-01-25T06:42:39.220 INFO:tasks.rados.rados.0.smithi085.stdout:117: seq_num 116 ranges {749612=474179,1954970=431037,2919420=616377} 2023-01-25T06:42:39.221 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112113-117 from 749612 to 1223791 tid 1 2023-01-25T06:42:39.226 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112113-117 from 1954970 to 2386007 tid 2 2023-01-25T06:42:39.233 INFO:tasks.rados.rados.0.smithi085.stdout:117: writing smithi085112113-117 from 2919420 to 3535797 tid 3 2023-01-25T06:42:39.233 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.234 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 2 to smithi085112113-102 2023-01-25T06:42:39.234 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 3 to smithi085112113-102 2023-01-25T06:42:39.234 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 4 to smithi085112113-102 2023-01-25T06:42:39.234 INFO:tasks.rados.rados.0.smithi085.stdout:102: finishing write tid 5 to smithi085112113-102 2023-01-25T06:42:39.234 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 updating version 0 to 80 2023-01-25T06:42:39.235 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 version 80 is already newer than 78 2023-01-25T06:42:39.235 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 updating version 80 to 81 2023-01-25T06:42:39.235 INFO:tasks.rados.rados.0.smithi085.stdout:102: oid 102 version 81 is already newer than 79 2023-01-25T06:42:39.235 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 102 v 81 (ObjNum 101 snap 0 seq_num 101) dirty exists 2023-01-25T06:42:39.235 INFO:tasks.rados.rados.0.smithi085.stdout:102: left oid 102 (ObjNum 101 snap 0 seq_num 101) 2023-01-25T06:42:39.236 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 1 to smithi085112113-103 2023-01-25T06:42:39.236 INFO:tasks.rados.rados.0.smithi085.stdout:102: done (15 left) 2023-01-25T06:42:39.236 INFO:tasks.rados.rados.0.smithi085.stdout:118: write initial oid 118 2023-01-25T06:42:39.236 INFO:tasks.rados.rados.0.smithi085.stdout:118: seq_num 117 ranges {766419=549428,2013452=574695,3346843=427649} 2023-01-25T06:42:39.240 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112113-118 from 766419 to 1315847 tid 1 2023-01-25T06:42:39.247 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112113-118 from 2013452 to 2588147 tid 2 2023-01-25T06:42:39.254 INFO:tasks.rados.rados.0.smithi085.stdout:118: writing smithi085112113-118 from 3346843 to 3774492 tid 3 2023-01-25T06:42:39.254 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.254 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 2 to smithi085112113-103 2023-01-25T06:42:39.255 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 3 to smithi085112113-103 2023-01-25T06:42:39.255 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 4 to smithi085112113-103 2023-01-25T06:42:39.255 INFO:tasks.rados.rados.0.smithi085.stdout:103: finishing write tid 5 to smithi085112113-103 2023-01-25T06:42:39.255 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 updating version 0 to 82 2023-01-25T06:42:39.255 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 updating version 82 to 84 2023-01-25T06:42:39.256 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 updating version 84 to 85 2023-01-25T06:42:39.256 INFO:tasks.rados.rados.0.smithi085.stdout:103: oid 103 version 85 is already newer than 83 2023-01-25T06:42:39.257 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 103 v 85 (ObjNum 102 snap 0 seq_num 102) dirty exists 2023-01-25T06:42:39.257 INFO:tasks.rados.rados.0.smithi085.stdout:103: left oid 103 (ObjNum 102 snap 0 seq_num 102) 2023-01-25T06:42:39.257 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 1 to smithi085112113-104 2023-01-25T06:42:39.257 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 2 to smithi085112113-104 2023-01-25T06:42:39.257 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 3 to smithi085112113-104 2023-01-25T06:42:39.258 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 4 to smithi085112113-104 2023-01-25T06:42:39.258 INFO:tasks.rados.rados.0.smithi085.stdout:103: done (15 left) 2023-01-25T06:42:39.258 INFO:tasks.rados.rados.0.smithi085.stdout:119: write initial oid 119 2023-01-25T06:42:39.259 INFO:tasks.rados.rados.0.smithi085.stdout:119: seq_num 118 ranges {783226=624677,2071934=434706,2974266=638921} 2023-01-25T06:42:39.261 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112113-119 from 783226 to 1407903 tid 1 2023-01-25T06:42:39.268 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112113-119 from 2071934 to 2506640 tid 2 2023-01-25T06:42:39.275 INFO:tasks.rados.rados.0.smithi085.stdout:119: writing smithi085112113-119 from 2974266 to 3613187 tid 3 2023-01-25T06:42:39.275 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.275 INFO:tasks.rados.rados.0.smithi085.stdout:104: finishing write tid 5 to smithi085112113-104 2023-01-25T06:42:39.276 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 0 to 86 2023-01-25T06:42:39.276 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 86 to 88 2023-01-25T06:42:39.277 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 updating version 88 to 89 2023-01-25T06:42:39.277 INFO:tasks.rados.rados.0.smithi085.stdout:104: oid 104 version 89 is already newer than 87 2023-01-25T06:42:39.277 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 104 v 89 (ObjNum 103 snap 0 seq_num 103) dirty exists 2023-01-25T06:42:39.277 INFO:tasks.rados.rados.0.smithi085.stdout:104: left oid 104 (ObjNum 103 snap 0 seq_num 103) 2023-01-25T06:42:39.277 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 1 to smithi085112113-105 2023-01-25T06:42:39.278 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 2 to smithi085112113-105 2023-01-25T06:42:39.278 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 3 to smithi085112113-105 2023-01-25T06:42:39.278 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 4 to smithi085112113-105 2023-01-25T06:42:39.278 INFO:tasks.rados.rados.0.smithi085.stdout:105: finishing write tid 5 to smithi085112113-105 2023-01-25T06:42:39.279 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 0 to 74 2023-01-25T06:42:39.279 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 74 to 75 2023-01-25T06:42:39.279 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 updating version 75 to 77 2023-01-25T06:42:39.280 INFO:tasks.rados.rados.0.smithi085.stdout:105: oid 105 version 77 is already newer than 76 2023-01-25T06:42:39.280 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 105 v 77 (ObjNum 104 snap 0 seq_num 104) dirty exists 2023-01-25T06:42:39.280 INFO:tasks.rados.rados.0.smithi085.stdout:105: left oid 105 (ObjNum 104 snap 0 seq_num 104) 2023-01-25T06:42:39.280 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 1 to smithi085112113-106 2023-01-25T06:42:39.280 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 2 to smithi085112113-106 2023-01-25T06:42:39.281 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 3 to smithi085112113-106 2023-01-25T06:42:39.281 INFO:tasks.rados.rados.0.smithi085.stdout:104: done (15 left) 2023-01-25T06:42:39.281 INFO:tasks.rados.rados.0.smithi085.stdout:105: done (14 left) 2023-01-25T06:42:39.281 INFO:tasks.rados.rados.0.smithi085.stdout:120: write initial oid 120 2023-01-25T06:42:39.281 INFO:tasks.rados.rados.0.smithi085.stdout:120: seq_num 119 ranges {400033=699926,1614063=385970} 2023-01-25T06:42:39.282 INFO:tasks.rados.rados.0.smithi085.stdout:120: writing smithi085112113-120 from 400033 to 1099959 tid 1 2023-01-25T06:42:39.286 INFO:tasks.rados.rados.0.smithi085.stdout:120: writing smithi085112113-120 from 1614063 to 2000033 tid 2 2023-01-25T06:42:39.286 INFO:tasks.rados.rados.0.smithi085.stdout:121: write initial oid 121 2023-01-25T06:42:39.286 INFO:tasks.rados.rados.0.smithi085.stdout:121: seq_num 120 ranges {416840=775175,1672545=344295} 2023-01-25T06:42:39.292 INFO:tasks.rados.rados.0.smithi085.stdout:121: writing smithi085112113-121 from 416840 to 1192015 tid 1 2023-01-25T06:42:39.297 INFO:tasks.rados.rados.0.smithi085.stdout:121: writing smithi085112113-121 from 1672545 to 2016840 tid 2 2023-01-25T06:42:39.298 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.298 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 4 to smithi085112113-106 2023-01-25T06:42:39.298 INFO:tasks.rados.rados.0.smithi085.stdout:106: finishing write tid 5 to smithi085112113-106 2023-01-25T06:42:39.298 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 0 to 45 2023-01-25T06:42:39.299 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 45 to 48 2023-01-25T06:42:39.299 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 updating version 48 to 50 2023-01-25T06:42:39.300 INFO:tasks.rados.rados.0.smithi085.stdout:106: oid 106 version 50 is already newer than 49 2023-01-25T06:42:39.300 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 106 v 50 (ObjNum 105 snap 0 seq_num 105) dirty exists 2023-01-25T06:42:39.300 INFO:tasks.rados.rados.0.smithi085.stdout:106: left oid 106 (ObjNum 105 snap 0 seq_num 105) 2023-01-25T06:42:39.300 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 1 to smithi085112113-107 2023-01-25T06:42:39.300 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 2 to smithi085112113-107 2023-01-25T06:42:39.301 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 3 to smithi085112113-107 2023-01-25T06:42:39.301 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 4 to smithi085112113-107 2023-01-25T06:42:39.301 INFO:tasks.rados.rados.0.smithi085.stdout:106: done (15 left) 2023-01-25T06:42:39.301 INFO:tasks.rados.rados.0.smithi085.stdout:122: write initial oid 122 2023-01-25T06:42:39.301 INFO:tasks.rados.rados.0.smithi085.stdout:122: seq_num 121 ranges {433647=450424,1331027=582033} 2023-01-25T06:42:39.302 INFO:tasks.rados.rados.0.smithi085.stdout:122: writing smithi085112113-122 from 433647 to 884071 tid 1 2023-01-25T06:42:39.308 INFO:tasks.rados.rados.0.smithi085.stdout:122: writing smithi085112113-122 from 1331027 to 1913060 tid 2 2023-01-25T06:42:39.309 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.309 INFO:tasks.rados.rados.0.smithi085.stdout:107: finishing write tid 5 to smithi085112113-107 2023-01-25T06:42:39.309 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 updating version 0 to 92 2023-01-25T06:42:39.309 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 version 92 is already newer than 90 2023-01-25T06:42:39.309 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 updating version 92 to 93 2023-01-25T06:42:39.310 INFO:tasks.rados.rados.0.smithi085.stdout:107: oid 107 version 93 is already newer than 91 2023-01-25T06:42:39.310 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 107 v 93 (ObjNum 106 snap 0 seq_num 106) dirty exists 2023-01-25T06:42:39.310 INFO:tasks.rados.rados.0.smithi085.stdout:107: left oid 107 (ObjNum 106 snap 0 seq_num 106) 2023-01-25T06:42:39.311 INFO:tasks.rados.rados.0.smithi085.stdout:107: done (15 left) 2023-01-25T06:42:39.311 INFO:tasks.rados.rados.0.smithi085.stdout:123: write initial oid 123 2023-01-25T06:42:39.311 INFO:tasks.rados.rados.0.smithi085.stdout:123: seq_num 122 ranges {450454=642026,1505862=544592} 2023-01-25T06:42:39.314 INFO:tasks.rados.rados.0.smithi085.stdout:123: writing smithi085112113-123 from 450454 to 1092480 tid 1 2023-01-25T06:42:39.321 INFO:tasks.rados.rados.0.smithi085.stdout:123: writing smithi085112113-123 from 1505862 to 2050454 tid 2 2023-01-25T06:42:39.321 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.322 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 1 to smithi085112113-108 2023-01-25T06:42:39.322 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 2 to smithi085112113-108 2023-01-25T06:42:39.322 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 3 to smithi085112113-108 2023-01-25T06:42:39.322 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 4 to smithi085112113-108 2023-01-25T06:42:39.322 INFO:tasks.rados.rados.0.smithi085.stdout:108: finishing write tid 5 to smithi085112113-108 2023-01-25T06:42:39.323 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 updating version 0 to 45 2023-01-25T06:42:39.323 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 version 45 is already newer than 43 2023-01-25T06:42:39.323 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 version 45 is already newer than 42 2023-01-25T06:42:39.323 INFO:tasks.rados.rados.0.smithi085.stdout:108: oid 108 version 45 is already newer than 44 2023-01-25T06:42:39.324 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 108 v 45 (ObjNum 107 snap 0 seq_num 107) dirty exists 2023-01-25T06:42:39.324 INFO:tasks.rados.rados.0.smithi085.stdout:108: left oid 108 (ObjNum 107 snap 0 seq_num 107) 2023-01-25T06:42:39.324 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 1 to smithi085112113-109 2023-01-25T06:42:39.324 INFO:tasks.rados.rados.0.smithi085.stdout:108: done (15 left) 2023-01-25T06:42:39.324 INFO:tasks.rados.rados.0.smithi085.stdout:124: write initial oid 124 2023-01-25T06:42:39.325 INFO:tasks.rados.rados.0.smithi085.stdout:124: seq_num 123 ranges {467261=717275,1847991=219270} 2023-01-25T06:42:39.326 INFO:tasks.rados.rados.0.smithi085.stdout:124: writing smithi085112113-124 from 467261 to 1184536 tid 1 2023-01-25T06:42:39.332 INFO:tasks.rados.rados.0.smithi085.stdout:124: writing smithi085112113-124 from 1847991 to 2067261 tid 2 2023-01-25T06:42:39.332 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.332 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 2 to smithi085112113-109 2023-01-25T06:42:39.332 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 3 to smithi085112113-109 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 4 to smithi085112113-109 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: finishing write tid 5 to smithi085112113-109 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 updating version 0 to 51 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 version 51 is already newer than 46 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 updating version 51 to 53 2023-01-25T06:42:39.333 INFO:tasks.rados.rados.0.smithi085.stdout:109: oid 109 version 53 is already newer than 52 2023-01-25T06:42:39.334 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 109 v 53 (ObjNum 108 snap 0 seq_num 108) dirty exists 2023-01-25T06:42:39.334 INFO:tasks.rados.rados.0.smithi085.stdout:109: left oid 109 (ObjNum 108 snap 0 seq_num 108) 2023-01-25T06:42:39.334 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 1 to smithi085112113-110 2023-01-25T06:42:39.334 INFO:tasks.rados.rados.0.smithi085.stdout:109: done (15 left) 2023-01-25T06:42:39.334 INFO:tasks.rados.rados.0.smithi085.stdout:125: write initial oid 125 2023-01-25T06:42:39.335 INFO:tasks.rados.rados.0.smithi085.stdout:125: seq_num 124 ranges {484068=792524,1906473=177595} 2023-01-25T06:42:39.338 INFO:tasks.rados.rados.0.smithi085.stdout:125: writing smithi085112113-125 from 484068 to 1276592 tid 1 2023-01-25T06:42:39.344 INFO:tasks.rados.rados.0.smithi085.stdout:125: writing smithi085112113-125 from 1906473 to 2084068 tid 2 2023-01-25T06:42:39.344 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.344 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 2 to smithi085112113-110 2023-01-25T06:42:39.345 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 1 to smithi085112113-111 2023-01-25T06:42:39.345 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 3 to smithi085112113-110 2023-01-25T06:42:39.345 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 4 to smithi085112113-110 2023-01-25T06:42:39.345 INFO:tasks.rados.rados.0.smithi085.stdout:110: finishing write tid 5 to smithi085112113-110 2023-01-25T06:42:39.345 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 updating version 0 to 96 2023-01-25T06:42:39.346 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 updating version 96 to 97 2023-01-25T06:42:39.346 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 version 97 is already newer than 95 2023-01-25T06:42:39.346 INFO:tasks.rados.rados.0.smithi085.stdout:110: oid 110 version 97 is already newer than 94 2023-01-25T06:42:39.346 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 110 v 97 (ObjNum 109 snap 0 seq_num 109) dirty exists 2023-01-25T06:42:39.346 INFO:tasks.rados.rados.0.smithi085.stdout:110: left oid 110 (ObjNum 109 snap 0 seq_num 109) 2023-01-25T06:42:39.347 INFO:tasks.rados.rados.0.smithi085.stdout:110: done (15 left) 2023-01-25T06:42:39.347 INFO:tasks.rados.rados.0.smithi085.stdout:126: write initial oid 126 2023-01-25T06:42:39.347 INFO:tasks.rados.rados.0.smithi085.stdout:126: seq_num 125 ranges {500875=467773,1564955=535920} 2023-01-25T06:42:39.348 INFO:tasks.rados.rados.0.smithi085.stdout:126: writing smithi085112113-126 from 500875 to 968648 tid 1 2023-01-25T06:42:39.355 INFO:tasks.rados.rados.0.smithi085.stdout:126: writing smithi085112113-126 from 1564955 to 2100875 tid 2 2023-01-25T06:42:39.356 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.356 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 2 to smithi085112113-111 2023-01-25T06:42:39.356 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 3 to smithi085112113-111 2023-01-25T06:42:39.356 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 4 to smithi085112113-111 2023-01-25T06:42:39.357 INFO:tasks.rados.rados.0.smithi085.stdout:111: finishing write tid 5 to smithi085112113-111 2023-01-25T06:42:39.357 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 updating version 0 to 81 2023-01-25T06:42:39.357 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 version 81 is already newer than 79 2023-01-25T06:42:39.357 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 version 81 is already newer than 80 2023-01-25T06:42:39.357 INFO:tasks.rados.rados.0.smithi085.stdout:111: oid 111 version 81 is already newer than 78 2023-01-25T06:42:39.358 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 111 v 81 (ObjNum 110 snap 0 seq_num 110) dirty exists 2023-01-25T06:42:39.358 INFO:tasks.rados.rados.0.smithi085.stdout:111: left oid 111 (ObjNum 110 snap 0 seq_num 110) 2023-01-25T06:42:39.358 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 1 to smithi085112113-112 2023-01-25T06:42:39.358 INFO:tasks.rados.rados.0.smithi085.stdout:111: done (15 left) 2023-01-25T06:42:39.358 INFO:tasks.rados.rados.0.smithi085.stdout:127: write initial oid 127 2023-01-25T06:42:39.359 INFO:tasks.rados.rados.0.smithi085.stdout:127: seq_num 126 ranges {517682=543022,1623437=494245} 2023-01-25T06:42:39.361 INFO:tasks.rados.rados.0.smithi085.stdout:127: writing smithi085112113-127 from 517682 to 1060704 tid 1 2023-01-25T06:42:39.368 INFO:tasks.rados.rados.0.smithi085.stdout:127: writing smithi085112113-127 from 1623437 to 2117682 tid 2 2023-01-25T06:42:39.368 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.368 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 2 to smithi085112113-112 2023-01-25T06:42:39.368 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 3 to smithi085112113-112 2023-01-25T06:42:39.369 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 4 to smithi085112113-112 2023-01-25T06:42:39.369 INFO:tasks.rados.rados.0.smithi085.stdout:112: finishing write tid 5 to smithi085112113-112 2023-01-25T06:42:39.369 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 updating version 0 to 48 2023-01-25T06:42:39.369 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 updating version 48 to 54 2023-01-25T06:42:39.369 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 updating version 54 to 55 2023-01-25T06:42:39.370 INFO:tasks.rados.rados.0.smithi085.stdout:112: oid 112 version 55 is already newer than 47 2023-01-25T06:42:39.370 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 112 v 55 (ObjNum 111 snap 0 seq_num 111) dirty exists 2023-01-25T06:42:39.370 INFO:tasks.rados.rados.0.smithi085.stdout:112: left oid 112 (ObjNum 111 snap 0 seq_num 111) 2023-01-25T06:42:39.370 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 1 to smithi085112113-113 2023-01-25T06:42:39.371 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 2 to smithi085112113-113 2023-01-25T06:42:39.371 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 3 to smithi085112113-113 2023-01-25T06:42:39.371 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 4 to smithi085112113-113 2023-01-25T06:42:39.371 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 5 to smithi085112113-113 2023-01-25T06:42:39.372 INFO:tasks.rados.rados.0.smithi085.stdout:113: finishing write tid 6 to smithi085112113-113 2023-01-25T06:42:39.372 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 0 to 83 2023-01-25T06:42:39.372 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 83 to 84 2023-01-25T06:42:39.373 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 updating version 84 to 85 2023-01-25T06:42:39.373 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 version 85 is already newer than 80 2023-01-25T06:42:39.373 INFO:tasks.rados.rados.0.smithi085.stdout:113: oid 113 version 85 is already newer than 82 2023-01-25T06:42:39.373 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 113 v 85 (ObjNum 112 snap 0 seq_num 112) dirty exists 2023-01-25T06:42:39.373 INFO:tasks.rados.rados.0.smithi085.stdout:113: left oid 113 (ObjNum 112 snap 0 seq_num 112) 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 1 to smithi085112113-114 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 2 to smithi085112113-114 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 3 to smithi085112113-114 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 4 to smithi085112113-114 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: finishing write tid 5 to smithi085112113-114 2023-01-25T06:42:39.374 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 updating version 0 to 98 2023-01-25T06:42:39.375 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 updating version 98 to 100 2023-01-25T06:42:39.375 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 version 100 is already newer than 99 2023-01-25T06:42:39.375 INFO:tasks.rados.rados.0.smithi085.stdout:114: oid 114 version 100 is already newer than 96 2023-01-25T06:42:39.375 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 114 v 100 (ObjNum 113 snap 0 seq_num 113) dirty exists 2023-01-25T06:42:39.375 INFO:tasks.rados.rados.0.smithi085.stdout:114: left oid 114 (ObjNum 113 snap 0 seq_num 113) 2023-01-25T06:42:39.376 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 1 to smithi085112113-115 2023-01-25T06:42:39.376 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 2 to smithi085112113-115 2023-01-25T06:42:39.376 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 3 to smithi085112113-115 2023-01-25T06:42:39.376 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 4 to smithi085112113-115 2023-01-25T06:42:39.376 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 5 to smithi085112113-115 2023-01-25T06:42:39.377 INFO:tasks.rados.rados.0.smithi085.stdout:115: finishing write tid 6 to smithi085112113-115 2023-01-25T06:42:39.377 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 updating version 0 to 53 2023-01-25T06:42:39.377 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 53 is already newer than 51 2023-01-25T06:42:39.377 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 53 is already newer than 52 2023-01-25T06:42:39.377 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 53 is already newer than 50 2023-01-25T06:42:39.378 INFO:tasks.rados.rados.0.smithi085.stdout:115: oid 115 version 53 is already newer than 49 2023-01-25T06:42:39.378 INFO:tasks.rados.rados.0.smithi085.stdout:update_object_version oid 115 v 53 (ObjNum 114 snap 0 seq_num 114) dirty exists 2023-01-25T06:42:39.378 INFO:tasks.rados.rados.0.smithi085.stdout:115: left oid 115 (ObjNum 114 snap 0 seq_num 114) 2023-01-25T06:42:39.378 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 1 to smithi085112113-116 2023-01-25T06:42:39.378 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 2 to smithi085112113-116 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 3 to smithi085112113-116 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:112: done (15 left) 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:113: done (14 left) 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:114: done (13 left) 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:115: done (12 left) 2023-01-25T06:42:39.379 INFO:tasks.rados.rados.0.smithi085.stdout:128: write initial oid 128 2023-01-25T06:42:39.380 INFO:tasks.rados.rados.0.smithi085.stdout:128: seq_num 127 ranges {534489=618271,1565566=568923} 2023-01-25T06:42:39.381 INFO:tasks.rados.rados.0.smithi085.stdout:128: writing smithi085112113-128 from 534489 to 1152760 tid 1 2023-01-25T06:42:39.381 INFO:tasks.rados.rados.0.smithi085.stdout:128: writing smithi085112113-128 from 1565566 to 2134489 tid 2 2023-01-25T06:42:39.381 INFO:tasks.rados.rados.0.smithi085.stdout:129: write initial oid 129 2023-01-25T06:42:39.381 INFO:tasks.rados.rados.0.smithi085.stdout:129: seq_num 128 ranges {551296=693520,2024048=127248} 2023-01-25T06:42:39.386 INFO:tasks.rados.rados.0.smithi085.stdout:129: writing smithi085112113-129 from 551296 to 1244816 tid 1 2023-01-25T06:42:39.391 INFO:tasks.rados.rados.0.smithi085.stdout:129: writing smithi085112113-129 from 2024048 to 2151296 tid 2 2023-01-25T06:42:39.391 INFO:tasks.rados.rados.0.smithi085.stdout:130: write initial oid 130 2023-01-25T06:42:39.392 INFO:tasks.rados.rados.0.smithi085.stdout:130: seq_num 129 ranges {568103=768769,2082530=85573} 2023-01-25T06:42:39.398 INFO:tasks.rados.rados.0.smithi085.stdout:130: writing smithi085112113-130 from 568103 to 1336872 tid 1 2023-01-25T06:42:39.403 INFO:tasks.rados.rados.0.smithi085.stdout:130: writing smithi085112113-130 from 2082530 to 2168103 tid 2 2023-01-25T06:42:39.404 INFO:tasks.rados.rados.0.smithi085.stdout:131: write initial oid 131 2023-01-25T06:42:39.404 INFO:tasks.rados.rados.0.smithi085.stdout:131: seq_num 130 ranges {584910=560371,1857365=327545} 2023-01-25T06:42:39.409 INFO:tasks.rados.rados.0.smithi085.stdout:131: writing smithi085112113-131 from 584910 to 1145281 tid 1 2023-01-25T06:42:39.416 INFO:tasks.rados.rados.0.smithi085.stdout:131: writing smithi085112113-131 from 1857365 to 2184910 tid 2 2023-01-25T06:42:39.416 INFO:tasks.rados.rados.0.smithi085.stdout: waiting on 16 2023-01-25T06:42:39.416 INFO:tasks.rados.rados.0.smithi085.stdout:116: finishing write tid 4 to smithi085112113-116 2023-01-25T06:42:39.416 INFO:tasks.rados.rados.0.smithi085.stdout:116: