2023-10-11T20:38:53.923 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-11T20:38:53.924 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi --verbose --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} --archive /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/orig.config.yaml 2023-10-11T20:38:53.960 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-11T20:38:54.040 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575 branch: wip-yuri11-testing-2023-10-10-1226-reef description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} email: yweinste@redhat.com first_in_suite: false job_id: '7421575' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri11-testing-2023-10-10-1226-reef ceph: conf: global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async osd heartbeat grace: 80 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 50 mon osd crush smoke test: false mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub interval: 300 paxos service trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 1 debug bluestore: 1 debug monc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd fast shutdown: false osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd memory target: 1610612736 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd shutdown pgref assert: true osd_class_default_list: '*' osd_class_load_list: '*' flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(SLOW_OPS\) - slow request mon_bind_msgr2: false sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: debuginfo: true flavor: default sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri11-testing-2023-10-10-1226-reef sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 5878 sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri11-testing-2023-10-10-1226-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAp7mZpaoVc/wuaJlSHU0ll0diFnPGt20rhRfEYYWdVm5wW7TZ4LnHFD/MwjXgKIfuQwcR7CmEVYQ7ZJJf4EByA= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOu3Q7wkHByOetS2rapqah+piqG0kpJ/U/dBkCnPFXLG2lDN3jixV41sWEJ7UHaYSLW+RZK1k1kSVcV1fq/4s8= tasks: - install: null - ceph: null - workunit: clients: client.0: - cls teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-11_14:08:36 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-11T20:38:54.040 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa; will attempt to use it 2023-10-11T20:38:54.041 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks 2023-10-11T20:38:54.041 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-11T20:38:54.043 INFO:teuthology.task.internal:Checking packages... 2023-10-11T20:38:54.064 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e62d759a6de3042e046d7d9889d2209cbc674fbd' 2023-10-11T20:38:54.065 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-11T20:38:54.065 INFO:teuthology.packaging:ref: None 2023-10-11T20:38:54.065 INFO:teuthology.packaging:tag: None 2023-10-11T20:38:54.066 INFO:teuthology.packaging:branch: wip-yuri11-testing-2023-10-10-1226-reef 2023-10-11T20:38:54.066 INFO:teuthology.packaging:sha1: e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:38:54.066 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri11-testing-2023-10-10-1226-reef 2023-10-11T20:38:54.305 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-669.ge62d759a 2023-10-11T20:38:54.305 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-11T20:38:54.314 INFO:teuthology.task.internal:no buildpackages task found 2023-10-11T20:38:54.315 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-11T20:38:54.334 INFO:teuthology.task.internal:Saving configuration 2023-10-11T20:38:54.348 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-11T20:38:54.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-11T20:38:54.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 20:33:54.763149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAp7mZpaoVc/wuaJlSHU0ll0diFnPGt20rhRfEYYWdVm5wW7TZ4LnHFD/MwjXgKIfuQwcR7CmEVYQ7ZJJf4EByA='} 2023-10-11T20:38:54.406 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 20:33:54.760857', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOu3Q7wkHByOetS2rapqah+piqG0kpJ/U/dBkCnPFXLG2lDN3jixV41sWEJ7UHaYSLW+RZK1k1kSVcV1fq/4s8='} 2023-10-11T20:38:54.406 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-11T20:38:54.418 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-10-11T20:38:54.418 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-10-11T20:38:54.418 INFO:teuthology.run_tasks:Running task console_log... 2023-10-11T20:38:54.500 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdac44a2a60>, signals=[15]) 2023-10-11T20:38:54.501 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-11T20:38:54.513 INFO:teuthology.task.internal:Opening connections... 2023-10-11T20:38:54.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:38:54.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:38:54.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:38:54.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:38:54.699 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-11T20:38:54.707 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2023-10-11T20:38:54.726 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2023-10-11T20:38:54.726 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2023-10-11T20:38:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2023-10-11T20:38:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2023-10-11T20:38:54.783 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2023-10-11T20:38:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2023-10-11T20:38:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2023-10-11T20:38:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2023-10-11T20:38:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-11T20:38:54.784 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2023-10-11T20:38:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2023-10-11T20:38:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-11T20:38:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2023-10-11T20:38:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-11T20:38:54.785 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-11T20:38:54.786 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-11T20:38:54.786 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2023-10-11T20:38:54.809 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2023-10-11T20:38:54.826 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2023-10-11T20:38:54.826 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2023-10-11T20:38:54.882 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2023-10-11T20:38:54.882 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2023-10-11T20:38:54.883 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2023-10-11T20:38:54.883 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2023-10-11T20:38:54.883 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2023-10-11T20:38:54.884 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2023-10-11T20:38:54.884 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-11T20:38:54.884 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2023-10-11T20:38:54.884 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2023-10-11T20:38:54.884 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-11T20:38:54.885 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2023-10-11T20:38:54.885 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-11T20:38:54.885 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-11T20:38:54.885 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-11T20:38:54.886 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2023-10-11T20:38:54.909 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-11T20:38:54.923 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-11T20:38:54.936 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-11T20:38:54.937 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2023-10-11T20:38:54.940 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2023-10-11T20:38:54.955 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-11T20:38:54.966 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-11T20:38:54.966 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2023-10-11T20:38:54.997 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2023-10-11T20:38:55.111 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-11T20:38:55.173 INFO:teuthology.run_tasks:Running task kernel... 2023-10-11T20:38:55.192 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-11T20:38:55.193 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-11T20:38:55.193 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-11T20:38:55.194 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-11T20:38:55.211 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T20:38:55.211 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-10-11T20:38:55.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T20:38:55.213 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-10-11T20:38:55.269 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-361.el9.x86_64 2023-10-11T20:38:55.270 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-361.el9.x86_64 2023-10-11T20:38:55.270 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2023-10-11T20:38:55.271 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-361.el9.x86_64 2023-10-11T20:38:55.271 INFO:teuthology.task.kernel:Running kernel on smithi183: 5.14.0-361.el9.x86_64 2023-10-11T20:38:55.272 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum install -y kernel 2023-10-11T20:38:58.802 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 3.3 MB/s | 6.3 MB 00:01 2023-10-11T20:38:59.242 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 2.6 MB/s | 6.3 MB 00:02 2023-10-11T20:39:00.402 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2023-10-11T20:39:00.842 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2023-10-11T20:39:02.016 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 7.9 MB 00:00 2023-10-11T20:39:02.434 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 7.9 MB 00:01 2023-10-11T20:39:04.810 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 18 MB 00:01 2023-10-11T20:39:07.334 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 18 MB 00:03 2023-10-11T20:39:09.620 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 5.7 MB 00:01 2023-10-11T20:39:10.926 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 14 kB 00:00 2023-10-11T20:39:12.197 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.7 MB 00:01 2023-10-11T20:39:12.702 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 11 MB/s | 19 MB 00:01 2023-10-11T20:39:14.452 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 14 kB 00:01 2023-10-11T20:39:15.446 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 22 MB/s | 19 MB 00:00 2023-10-11T20:39:17.210 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-10-11T20:39:19.201 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-11T20:39:19.202 INFO:teuthology.orchestra.run.smithi183.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-11T20:39:19.294 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:39:19.305 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:39:19.305 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:39:19.305 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:39:19.305 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:39:19.306 INFO:teuthology.orchestra.run.smithi183.stdout: kernel x86_64 5.14.0-375.el9 CentOS-BaseOS 5.3 M 2023-10-11T20:39:19.306 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:39:19.306 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core x86_64 5.14.0-375.el9 CentOS-BaseOS 20 M 2023-10-11T20:39:19.306 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules x86_64 5.14.0-375.el9 CentOS-BaseOS 37 M 2023-10-11T20:39:19.307 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core x86_64 5.14.0-375.el9 CentOS-BaseOS 32 M 2023-10-11T20:39:19.307 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:39:19.307 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:39:19.307 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:39:19.307 INFO:teuthology.orchestra.run.smithi183.stdout:Install 4 Packages 2023-10-11T20:39:19.308 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:39:19.308 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 95 M 2023-10-11T20:39:19.309 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 120 M 2023-10-11T20:39:19.309 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:39:19.611 INFO:teuthology.orchestra.run.smithi183.stdout:(1/4): kernel-5.14.0-375.el9.x86_64.rpm 17 MB/s | 5.3 MB 00:00 2023-10-11T20:39:20.070 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-11T20:39:20.112 INFO:teuthology.orchestra.run.smithi183.stdout:(2/4): kernel-core-5.14.0-375.el9.x86_64.rpm 25 MB/s | 20 MB 00:00 2023-10-11T20:39:20.645 INFO:teuthology.orchestra.run.smithi183.stdout:(3/4): kernel-modules-core-5.14.0-375.el9.x86_6 31 MB/s | 32 MB 00:01 2023-10-11T20:39:21.104 INFO:teuthology.orchestra.run.smithi183.stdout:(4/4): kernel-modules-5.14.0-375.el9.x86_64.rpm 21 MB/s | 37 MB 00:01 2023-10-11T20:39:21.107 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:39:21.107 INFO:teuthology.orchestra.run.smithi183.stdout:Total 53 MB/s | 95 MB 00:01 2023-10-11T20:39:21.108 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:39:21.487 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:39:21.487 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:39:22.186 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-10-11T20:39:22.186 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-10-11T20:39:22.281 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:39:22.292 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:39:22.293 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:39:22.293 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:39:22.293 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:39:22.293 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-375.el9 CentOS-BaseOS 5.3 M 2023-10-11T20:39:22.293 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:39:22.294 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 5.14.0-375.el9 CentOS-BaseOS 20 M 2023-10-11T20:39:22.294 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 5.14.0-375.el9 CentOS-BaseOS 37 M 2023-10-11T20:39:22.294 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core x86_64 5.14.0-375.el9 CentOS-BaseOS 32 M 2023-10-11T20:39:22.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:39:22.294 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:39:22.295 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:39:22.295 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2023-10-11T20:39:22.295 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:39:22.296 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 95 M 2023-10-11T20:39:22.296 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 120 M 2023-10-11T20:39:22.296 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:39:22.491 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:39:22.491 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:39:22.622 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): kernel-5.14.0-375.el9.x86_64.rpm 16 MB/s | 5.3 MB 00:00 2023-10-11T20:39:23.105 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): kernel-core-5.14.0-375.el9.x86_64.rpm 25 MB/s | 20 MB 00:00 2023-10-11T20:39:23.681 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): kernel-modules-core-5.14.0-375.el9.x86_6 30 MB/s | 32 MB 00:01 2023-10-11T20:39:24.264 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): kernel-modules-5.14.0-375.el9.x86_64.rpm 19 MB/s | 37 MB 00:01 2023-10-11T20:39:24.267 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:39:24.268 INFO:teuthology.orchestra.run.smithi022.stdout:Total 48 MB/s | 95 MB 00:01 2023-10-11T20:39:24.268 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:39:24.694 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:39:24.695 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:39:24.869 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:39:25.485 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-core-5.14.0-375.el9.x86_64 1/4 2023-10-11T20:39:25.603 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:39:25.712 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:39:25.712 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:39:28.240 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:39:28.340 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:39:28.514 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:39:28.896 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-core-5.14.0-375.el9.x86_64 1/4 2023-10-11T20:39:29.031 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:39:31.896 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:39:32.076 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:39:33.102 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:39:33.273 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : kernel-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:39:37.010 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:39:37.113 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:39:37.873 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:39:42.071 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:06.911 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:06.955 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-modules-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:07.322 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: kernel-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:07.323 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-5.14.0-375.el9.x86_64 1/4 2023-10-11T20:40:07.323 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:40:07.323 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:40:07.744 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : kernel-modules-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:07.744 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:40:07.744 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:40:07.744 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:07.745 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-core-5.14.0-375.el9.x86_64 2023-10-11T20:40:07.745 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-5.14.0-375.el9.x86_64 2023-10-11T20:40:07.745 INFO:teuthology.orchestra.run.smithi183.stdout: kernel-modules-core-5.14.0-375.el9.x86_64 2023-10-11T20:40:07.745 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:40:07.745 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:40:08.233 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T20:40:08.361 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:08.362 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-375.el9.x86_64 2023-10-11T20:40:08.362 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-375.el9.x86_64 2023-10-11T20:40:08.362 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-11T20:40:08.363 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-11T20:40:08.363 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-11T20:40:08.363 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi183.front.sepia.ceph.com, path=None, version=distro) 2023-10-11T20:40:08.363 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T20:40:08.468 INFO:teuthology.orchestra.run.smithi183.stdout:kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:08.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-375.el9.x86_64 2023-10-11T20:40:08.469 DEBUG:teuthology.orchestra.run.smithi183:> sudo rpm -qi grub2-tools 2023-10-11T20:40:08.508 INFO:teuthology.orchestra.run.smithi183.stdout:Name : grub2-tools 2023-10-11T20:40:08.508 INFO:teuthology.orchestra.run.smithi183.stdout:Epoch : 1 2023-10-11T20:40:08.508 INFO:teuthology.orchestra.run.smithi183.stdout:Version : 2.06 2023-10-11T20:40:08.508 INFO:teuthology.orchestra.run.smithi183.stdout:Release : 68.el9 2023-10-11T20:40:08.509 INFO:teuthology.orchestra.run.smithi183.stdout:Architecture: x86_64 2023-10-11T20:40:08.509 INFO:teuthology.orchestra.run.smithi183.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-11T20:40:08.509 INFO:teuthology.orchestra.run.smithi183.stdout:Group : Unspecified 2023-10-11T20:40:08.509 INFO:teuthology.orchestra.run.smithi183.stdout:Size : 8264254 2023-10-11T20:40:08.510 INFO:teuthology.orchestra.run.smithi183.stdout:License : GPLv3+ 2023-10-11T20:40:08.510 INFO:teuthology.orchestra.run.smithi183.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-11T20:40:08.510 INFO:teuthology.orchestra.run.smithi183.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-11T20:40:08.510 INFO:teuthology.orchestra.run.smithi183.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-11T20:40:08.510 INFO:teuthology.orchestra.run.smithi183.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-11T20:40:08.511 INFO:teuthology.orchestra.run.smithi183.stdout:Packager : builder@centos.org 2023-10-11T20:40:08.511 INFO:teuthology.orchestra.run.smithi183.stdout:Vendor : CentOS 2023-10-11T20:40:08.511 INFO:teuthology.orchestra.run.smithi183.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-11T20:40:08.511 INFO:teuthology.orchestra.run.smithi183.stdout:Summary : Support tools for GRUB. 2023-10-11T20:40:08.512 INFO:teuthology.orchestra.run.smithi183.stdout:Description : 2023-10-11T20:40:08.512 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:40:08.512 INFO:teuthology.orchestra.run.smithi183.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-11T20:40:08.512 INFO:teuthology.orchestra.run.smithi183.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-11T20:40:08.513 INFO:teuthology.orchestra.run.smithi183.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-11T20:40:08.513 INFO:teuthology.orchestra.run.smithi183.stdout:hardware devices. 2023-10-11T20:40:08.513 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:40:08.513 INFO:teuthology.orchestra.run.smithi183.stdout:This subpackage provides tools for support of all platforms. 2023-10-11T20:40:08.514 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-11T20:40:08.514 INFO:teuthology.task.kernel:Updating grub on smithi183 to boot 5.14.0-375.el9.x86_64 2023-10-11T20:40:08.515 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-11T20:40:09.111 INFO:teuthology.orchestra.run.smithi183.stderr:Generating grub configuration file ... 2023-10-11T20:40:10.538 INFO:teuthology.orchestra.run.smithi183.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-11T20:40:10.570 INFO:teuthology.orchestra.run.smithi183.stderr:done 2023-10-11T20:40:10.573 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-10-11T20:40:10.588 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.HibLf4LljA 2023-10-11T20:40:10.589 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HibLf4LljA 2023-10-11T20:40:10.655 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.HibLf4LljA 2023-10-11T20:40:10.797 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.HibLf4LljA is 6KB 2023-10-11T20:40:10.847 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.HibLf4LljA 2023-10-11T20:40:10.861 DEBUG:teuthology.orchestra.run.smithi183:> sudo /bin/ls /boot/loader/entries || true 2023-10-11T20:40:10.927 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-11T20:40:10.927 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-11T20:40:10.927 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-11T20:40:10.927 INFO:teuthology.orchestra.run.smithi183.stdout:15949e3c88704300882482eddfd7baae-5.14.0-375.el9.x86_64.conf 2023-10-11T20:40:10.928 DEBUG:teuthology.orchestra.run.smithi183:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-375.el9.x86_64 2023-10-11T20:40:11.102 DEBUG:teuthology.orchestra.run.smithi183:> sudo shutdown -r now 2023-10-11T20:40:12.514 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:12.560 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:12.949 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:12.949 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-375.el9.x86_64 1/4 2023-10-11T20:40:12.949 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-5.14.0-375.el9.x86_64 2/4 2023-10-11T20:40:12.949 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-5.14.0-375.el9.x86_64 3/4 2023-10-11T20:40:13.335 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-core-5.14.0-375.el9.x86_64 4/4 2023-10-11T20:40:13.337 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:40:13.337 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:40:13.338 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:13.338 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core-5.14.0-375.el9.x86_64 2023-10-11T20:40:13.338 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-5.14.0-375.el9.x86_64 2023-10-11T20:40:13.338 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core-5.14.0-375.el9.x86_64 2023-10-11T20:40:13.339 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:40:13.339 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:40:13.822 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T20:40:13.977 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:13.977 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-375.el9.x86_64 2023-10-11T20:40:13.977 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-375.el9.x86_64 2023-10-11T20:40:13.978 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-11T20:40:13.978 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-11T20:40:13.978 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-11T20:40:13.978 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2023-10-11T20:40:13.979 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2023-10-11T20:40:14.087 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-375.el9.x86_64 2023-10-11T20:40:14.088 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-375.el9.x86_64 2023-10-11T20:40:14.088 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2023-10-11T20:40:14.135 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2023-10-11T20:40:14.136 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2023-10-11T20:40:14.136 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2023-10-11T20:40:14.137 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 68.el9 2023-10-11T20:40:14.137 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2023-10-11T20:40:14.137 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-11T20:40:14.138 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2023-10-11T20:40:14.138 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8264254 2023-10-11T20:40:14.138 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2023-10-11T20:40:14.138 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-11T20:40:14.139 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-11T20:40:14.139 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-11T20:40:14.139 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-11T20:40:14.140 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2023-10-11T20:40:14.140 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2023-10-11T20:40:14.140 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-11T20:40:14.140 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2023-10-11T20:40:14.141 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2023-10-11T20:40:14.141 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:40:14.141 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-11T20:40:14.141 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-11T20:40:14.142 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-11T20:40:14.142 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2023-10-11T20:40:14.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:40:14.142 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2023-10-11T20:40:14.143 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-11T20:40:14.144 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 5.14.0-375.el9.x86_64 2023-10-11T20:40:14.144 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-11T20:40:14.699 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2023-10-11T20:40:16.038 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-11T20:40:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:done 2023-10-11T20:40:16.079 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-10-11T20:40:16.099 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.9UNr34NERl 2023-10-11T20:40:16.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9UNr34NERl 2023-10-11T20:40:16.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.9UNr34NERl 2023-10-11T20:40:16.315 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.9UNr34NERl is 6KB 2023-10-11T20:40:16.363 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.9UNr34NERl 2023-10-11T20:40:16.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2023-10-11T20:40:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-11T20:40:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-11T20:40:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-11T20:40:16.448 INFO:teuthology.orchestra.run.smithi022.stdout:15949e3c88704300882482eddfd7baae-5.14.0-375.el9.x86_64.conf 2023-10-11T20:40:16.449 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-375.el9.x86_64 2023-10-11T20:40:16.600 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2023-10-11T20:40:41.126 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-11T20:40:41.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-11T20:40:41.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:40:46.606 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-11T20:40:46.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-11T20:40:46.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:41:41.182 DEBUG:teuthology.orchestra.remote:timed out 2023-10-11T20:41:46.614 DEBUG:teuthology.orchestra.remote:timed out 2023-10-11T20:41:50.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-11T20:41:50.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:41:50.577 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-11T20:41:51.084 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-11T20:41:51.084 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-375.el9.x86_64"... 2023-10-11T20:41:51.085 DEBUG:teuthology.orchestra.run.smithi183:> uname -r 2023-10-11T20:41:51.099 INFO:teuthology.orchestra.run.smithi183.stdout:5.14.0-375.el9.x86_64 2023-10-11T20:41:51.099 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-375.el9.x86_64 vs 5.14.0-375.el9.x86_64 2023-10-11T20:41:51.099 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-11T20:41:51.100 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-11T20:41:52.100 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-11T20:41:52.101 DEBUG:teuthology.orchestra.run.smithi183:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-11T20:41:52.230 INFO:teuthology.orchestra.run.smithi183.stdout:ttyS1 2023-10-11T20:41:52.278 DEBUG:teuthology.parallel:result is None 2023-10-11T20:41:55.616 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-11T20:41:55.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:41:56.009 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-10-11T20:41:56.400 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-11T20:41:56.400 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-375.el9.x86_64"... 2023-10-11T20:41:56.401 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2023-10-11T20:41:56.415 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-375.el9.x86_64 2023-10-11T20:41:56.415 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-375.el9.x86_64 vs 5.14.0-375.el9.x86_64 2023-10-11T20:41:56.415 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-11T20:41:56.416 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-11T20:41:57.417 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-11T20:41:57.417 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-11T20:41:57.525 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2023-10-11T20:41:57.567 DEBUG:teuthology.parallel:result is None 2023-10-11T20:41:57.568 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-11T20:41:57.578 INFO:teuthology.task.internal:Creating test directory... 2023-10-11T20:41:57.578 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-11T20:41:57.580 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-11T20:41:57.607 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-11T20:41:57.614 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-11T20:41:57.624 INFO:teuthology.task.internal:Creating archive directory... 2023-10-11T20:41:57.624 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-11T20:41:57.640 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-11T20:41:57.676 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-11T20:41:57.683 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-11T20:41:57.683 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-11T20:41:57.718 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-11T20:41:57.745 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T20:41:57.751 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T20:41:57.762 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T20:41:57.764 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-11T20:41:57.766 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-11T20:41:57.773 INFO:teuthology.task.internal:Configuring sudo... 2023-10-11T20:41:57.773 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-11T20:41:57.809 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-11T20:41:57.839 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-11T20:41:57.847 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-11T20:41:57.848 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-11T20:41:57.884 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-11T20:41:57.900 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T20:41:57.987 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T20:41:58.045 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T20:41:58.130 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T20:41:58.180 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:41:58.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-11T20:41:58.254 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T20:41:58.299 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-11T20:41:58.344 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T20:41:58.426 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-11T20:41:58.465 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:41:58.466 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-11T20:41:58.528 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2023-10-11T20:41:58.531 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2023-10-11T20:41:58.582 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T20:41:58.619 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-11T20:41:59.082 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-11T20:41:59.091 INFO:teuthology.task.internal:Starting timer... 2023-10-11T20:41:59.091 INFO:teuthology.run_tasks:Running task pcp... 2023-10-11T20:41:59.101 INFO:teuthology.run_tasks:Running task selinux... 2023-10-11T20:41:59.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2023-10-11T20:41:59.214 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2023-10-11T20:41:59.219 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2023-10-11T20:41:59.270 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2023-10-11T20:41:59.272 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-11T20:41:59.272 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2023-10-11T20:41:59.313 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2023-10-11T20:41:59.314 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2023-10-11T20:41:59.346 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2023-10-11T20:41:59.347 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2023-10-11T20:41:59.348 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T20:41:59.405 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T20:41:59.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-11T20:41:59.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T20:41:59.434 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-11T20:41:59.434 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2023-10-11T20:41:59.614 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2023-10-11T20:41:59.648 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-11T20:41:59.657 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-11T20:41:59.663 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-11T20:41:59.797 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-11T20:41:59.816 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-11T20:41:59.817 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-11T20:47:30.875 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2023-10-11T20:47:30.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-11T20:47:30.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:47:30.975 DEBUG:teuthology.orchestra.run.smithi022:> true 2023-10-11T20:47:31.045 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2023-10-11T20:47:31.046 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-11T20:47:31.047 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-11T20:47:31.132 DEBUG:teuthology.orchestra.run.smithi183:> true 2023-10-11T20:47:31.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2023-10-11T20:47:31.205 INFO:teuthology.run_tasks:Running task clock... 2023-10-11T20:47:31.216 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-11T20:47:31.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-11T20:47:31.218 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T20:47:31.221 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-11T20:47:31.221 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-11T20:47:31.255 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-11T20:47:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-11T20:47:31.279 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-11T20:47:31.297 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-11T20:47:31.313 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2023-10-11T20:47:31.329 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2023-10-11T20:47:31.330 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2023-10-11T20:47:31.343 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2023-10-11T20:47:31.350 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-11T20:47:31.360 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-11T20:47:31.369 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-11T20:47:31.378 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-11T20:47:31.417 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2023-10-11T20:47:31.420 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T20:47:31.421 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-10-11T20:47:31.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.421 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.422 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.422 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-10-11T20:47:31.423 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-11T20:47:31.423 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-10-11T20:47:31.423 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.424 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.424 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.424 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-11T20:47:31.425 INFO:teuthology.run_tasks:Running task install... 2023-10-11T20:47:31.434 DEBUG:teuthology.task.install:project ceph 2023-10-11T20:47:31.434 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd'}} 2023-10-11T20:47:31.435 DEBUG:teuthology.task.install:config {'debuginfo': True, 'flavor': 'default', 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd'} 2023-10-11T20:47:31.435 INFO:teuthology.task.install:Using flavor: default 2023-10-11T20:47:31.441 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2023-10-11T20:47:31.441 INFO:teuthology.task.install:extra packages: [] 2023-10-11T20:47:31.442 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd', 'tag': None, 'wait_for_package': False} 2023-10-11T20:47:31.443 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:47:31.445 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': True, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd', 'tag': None, 'wait_for_package': False} 2023-10-11T20:47:31.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:47:31.589 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/ 2023-10-11T20:47:31.590 INFO:teuthology.task.install.rpm:Package version is 18.2.0-669.ge62d759a 2023-10-11T20:47:31.661 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/ 2023-10-11T20:47:31.661 INFO:teuthology.task.install.rpm:Package version is 18.2.0-669.ge62d759a 2023-10-11T20:47:31.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-11T20:47:31.701 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:47:31.701 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-11T20:47:31.729 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-10-11T20:47:31.729 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e62d759a6de3042e046d7d9889d2209cbc674fbd/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-11T20:47:31.770 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri11-testing-2023-10-10-1226-reef/e62d759a6de3042e046d7d9889d2209cbc674fbd/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-11T20:47:31.770 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:47:31.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-11T20:47:31.798 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-11T20:47:31.805 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, ceph-base-debuginfo, ceph-common-debuginfo, ceph-immutable-object-cache-debuginfo, ceph-radosgw-debuginfo, ceph-test-debuginfo, ceph-base-debuginfo, ceph-mgr-debuginfo, ceph-mds-debuginfo, ceph-mon-debuginfo, ceph-osd-debuginfo, ceph-fuse-debuginfo, librados-devel-debuginfo, libcephfs2-debuginfo, librados2-debuginfo, librbd1-debuginfo, python3-cephfs-debuginfo, python3-rados-debuginfo, python3-rbd-debuginfo, python3-rgw-debuginfo, rbd-fuse-debuginfo, rbd-mirror-debuginfo, rbd-nbd-debuginfo on remote rpm x86_64 2023-10-11T20:47:31.805 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e62d759a6de3042e046d7d9889d2209cbc674fbd/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-11T20:47:31.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-11T20:47:31.878 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-11T20:47:31.944 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2023-10-11T20:47:31.945 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2023-10-11T20:47:31.966 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-11T20:47:31.996 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2023-10-11T20:47:31.998 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2023-10-11T20:47:32.189 INFO:teuthology.orchestra.run.smithi183.stdout:70 files removed 2023-10-11T20:47:32.215 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw 2023-10-11T20:47:32.243 INFO:teuthology.orchestra.run.smithi022.stdout:70 files removed 2023-10-11T20:47:32.271 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw 2023-10-11T20:47:33.001 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 164 kB/s | 77 kB 00:00 2023-10-11T20:47:33.059 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 169 kB/s | 77 kB 00:00 2023-10-11T20:47:33.427 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 25 kB/s | 9.4 kB 00:00 2023-10-11T20:47:33.427 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 30 kB/s | 9.4 kB 00:00 2023-10-11T20:47:33.777 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 6.0 kB/s | 1.9 kB 00:00 2023-10-11T20:47:33.778 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2023-10-11T20:47:34.288 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - AppStream 13 MB/s | 6.3 MB 00:00 2023-10-11T20:47:34.380 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - AppStream 11 MB/s | 6.3 MB 00:00 2023-10-11T20:47:35.730 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS-9 - BaseOS 5.0 MB/s | 2.0 MB 00:00 2023-10-11T20:47:35.821 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS-9 - BaseOS 6.0 MB/s | 2.0 MB 00:00 2023-10-11T20:47:36.704 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 7.9 MB 00:00 2023-10-11T20:47:37.793 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 7.9 MB 00:01 2023-10-11T20:47:39.589 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 24 MB/s | 18 MB 00:00 2023-10-11T20:47:43.722 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 5.7 MB 00:00 2023-10-11T20:47:44.705 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 18 MB 00:06 2023-10-11T20:47:45.157 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 47 kB/s | 14 kB 00:00 2023-10-11T20:47:48.825 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 5.4 MB/s | 19 MB 00:03 2023-10-11T20:47:52.621 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 1.3 MB/s | 5.7 MB 00:04 2023-10-11T20:47:53.532 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2023-10-11T20:47:54.164 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 14 kB 00:00 2023-10-11T20:47:54.982 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 27 MB/s | 19 MB 00:00 2023-10-11T20:47:55.944 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:47:55.951 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:47:55.951 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:47:55.951 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:47:55.951 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:47:55.951 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:18.2.0-669.ge62d759a.el9 ceph 7.7 M 2023-10-11T20:47:55.952 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2023-10-11T20:47:55.952 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.3 M 2023-10-11T20:47:55.952 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.0 M 2023-10-11T20:47:55.952 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:47:55.952 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-11T20:47:55.953 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:18.2.0-669.ge62d759a.el9 ceph 5.2 M 2023-10-11T20:47:55.953 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:18.2.0-669.ge62d759a.el9 ceph 18 M 2023-10-11T20:47:55.953 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:18.2.0-669.ge62d759a.el9 ceph 24 k 2023-10-11T20:47:55.953 INFO:teuthology.orchestra.run.smithi022.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-11T20:47:55.953 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-11T20:47:55.954 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-11T20:47:55.954 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-11T20:47:55.954 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 654 k 2023-10-11T20:47:55.954 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-11T20:47:55.954 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-11T20:47:55.955 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-11T20:47:55.955 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 474 k 2023-10-11T20:47:55.955 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-11T20:47:55.955 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.4 M 2023-10-11T20:47:55.955 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-11T20:47:55.956 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-11T20:47:55.956 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-11T20:47:55.956 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 45 k 2023-10-11T20:47:55.956 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:18.2.0-669.ge62d759a.el9 ceph 124 k 2023-10-11T20:47:55.956 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:18.2.0-669.ge62d759a.el9 ceph 156 k 2023-10-11T20:47:55.957 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-11T20:47:55.957 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:18.2.0-669.ge62d759a.el9 ceph 320 k 2023-10-11T20:47:55.957 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 298 k 2023-10-11T20:47:55.957 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:18.2.0-669.ge62d759a.el9 ceph 99 k 2023-10-11T20:47:55.957 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout:Install 28 Packages 2023-10-11T20:47:55.958 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 2 Packages 2023-10-11T20:47:55.959 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:47:55.959 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 53 M 2023-10-11T20:47:55.960 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:47:57.392 INFO:teuthology.orchestra.run.smithi022.stdout:(1/30): ceph-radosgw-18.2.0-669.ge62d759a.el9.x 7.6 MB/s | 7.7 MB 00:01 2023-10-11T20:47:57.442 INFO:teuthology.orchestra.run.smithi022.stdout:(2/30): ceph-selinux-18.2.0-669.ge62d759a.el9.x 485 kB/s | 24 kB 00:00 2023-10-11T20:47:57.559 INFO:teuthology.orchestra.run.smithi022.stdout:(3/30): libcephfs2-18.2.0-669.ge62d759a.el9.x86 5.5 MB/s | 654 kB 00:00 2023-10-11T20:47:57.643 INFO:teuthology.orchestra.run.smithi022.stdout:(4/30): libradosstriper1-18.2.0-669.ge62d759a.e 5.6 MB/s | 474 kB 00:00 2023-10-11T20:47:57.801 INFO:teuthology.orchestra.run.smithi022.stdout:(5/30): ceph-base-18.2.0-669.ge62d759a.el9.x86_ 3.6 MB/s | 5.2 MB 00:01 2023-10-11T20:47:57.893 INFO:teuthology.orchestra.run.smithi022.stdout:(6/30): python3-ceph-argparse-18.2.0-669.ge62d7 492 kB/s | 45 kB 00:00 2023-10-11T20:47:58.110 INFO:teuthology.orchestra.run.smithi022.stdout:(7/30): ceph-common-18.2.0-669.ge62d759a.el9.x8 11 MB/s | 18 MB 00:01 2023-10-11T20:47:58.136 INFO:teuthology.orchestra.run.smithi022.stdout:(8/30): python3-ceph-common-18.2.0-669.ge62d759 514 kB/s | 124 kB 00:00 2023-10-11T20:47:58.161 INFO:teuthology.orchestra.run.smithi022.stdout:(9/30): python3-cephfs-18.2.0-669.ge62d759a.el9 3.1 MB/s | 156 kB 00:00 2023-10-11T20:47:58.236 INFO:teuthology.orchestra.run.smithi022.stdout:(10/30): librgw2-18.2.0-669.ge62d759a.el9.x86_6 7.5 MB/s | 4.4 MB 00:00 2023-10-11T20:47:58.261 INFO:teuthology.orchestra.run.smithi022.stdout:(11/30): python3-rbd-18.2.0-669.ge62d759a.el9.x 2.9 MB/s | 298 kB 00:00 2023-10-11T20:47:58.287 INFO:teuthology.orchestra.run.smithi022.stdout:(12/30): python3-rados-18.2.0-669.ge62d759a.el9 2.1 MB/s | 320 kB 00:00 2023-10-11T20:47:58.320 INFO:teuthology.orchestra.run.smithi022.stdout:(13/30): python3-rgw-18.2.0-669.ge62d759a.el9.x 1.2 MB/s | 99 kB 00:00 2023-10-11T20:47:58.446 INFO:teuthology.orchestra.run.smithi022.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 576 kB/s | 106 kB 00:00 2023-10-11T20:47:58.471 INFO:teuthology.orchestra.run.smithi022.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 867 kB/s | 159 kB 00:00 2023-10-11T20:47:58.496 INFO:teuthology.orchestra.run.smithi022.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2023-10-11T20:47:58.521 INFO:teuthology.orchestra.run.smithi022.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 827 kB/s | 41 kB 00:00 2023-10-11T20:47:58.555 INFO:teuthology.orchestra.run.smithi022.stdout:(18/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 661 kB 00:00 2023-10-11T20:47:58.647 INFO:teuthology.orchestra.run.smithi022.stdout:(19/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2023-10-11T20:47:58.672 INFO:teuthology.orchestra.run.smithi022.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 738 kB/s | 111 kB 00:00 2023-10-11T20:47:58.722 INFO:teuthology.orchestra.run.smithi022.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 488 kB/s | 24 kB 00:00 2023-10-11T20:47:58.748 INFO:teuthology.orchestra.run.smithi022.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.6 MB/s | 309 kB 00:00 2023-10-11T20:47:58.773 INFO:teuthology.orchestra.run.smithi022.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2023-10-11T20:47:58.798 INFO:teuthology.orchestra.run.smithi022.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-10-11T20:47:58.890 INFO:teuthology.orchestra.run.smithi022.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2023-10-11T20:47:59.040 INFO:teuthology.orchestra.run.smithi022.stdout:(26/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.1 MB/s | 837 kB 00:00 2023-10-11T20:47:59.424 INFO:teuthology.orchestra.run.smithi022.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 3.0 MB/s | 1.6 MB 00:00 2023-10-11T20:47:59.448 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2023-10-11T20:47:59.507 INFO:teuthology.orchestra.run.smithi022.stdout:(28/30): libarrow-9.0.0-9.el9.x86_64.rpm 5.1 MB/s | 4.4 MB 00:00 2023-10-11T20:47:59.582 INFO:teuthology.orchestra.run.smithi022.stdout:(29/30): librados2-18.2.0-669.ge62d759a.el9.x86 6.0 MB/s | 3.3 MB 00:00 2023-10-11T20:47:59.699 INFO:teuthology.orchestra.run.smithi022.stdout:(30/30): librbd1-18.2.0-669.ge62d759a.el9.x86_6 11 MB/s | 3.0 MB 00:00 2023-10-11T20:47:59.703 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:47:59.704 INFO:teuthology.orchestra.run.smithi022.stdout:Total 14 MB/s | 53 MB 00:03 2023-10-11T20:47:59.715 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:47:59.754 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:47:59.755 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:00.309 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:00.309 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:01.686 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:01.754 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-11T20:48:01.798 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:01.804 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-10-11T20:48:01.846 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:01.846 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:01.846 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:01.846 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:01.847 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:18.2.0-669.ge62d759a.el9 ceph 7.7 M 2023-10-11T20:48:01.847 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2023-10-11T20:48:01.847 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.3 M 2023-10-11T20:48:01.847 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.0 M 2023-10-11T20:48:01.847 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:18.2.0-669.ge62d759a.el9 ceph 5.2 M 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:18.2.0-669.ge62d759a.el9 ceph 18 M 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:18.2.0-669.ge62d759a.el9 ceph 24 k 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-11T20:48:01.848 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-11T20:48:01.849 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-11T20:48:01.849 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-11T20:48:01.849 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 654 k 2023-10-11T20:48:01.849 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-11T20:48:01.849 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-11T20:48:01.850 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-11T20:48:01.850 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 474 k 2023-10-11T20:48:01.850 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-11T20:48:01.850 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.4 M 2023-10-11T20:48:01.850 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 45 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:18.2.0-669.ge62d759a.el9 ceph 124 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:18.2.0-669.ge62d759a.el9 ceph 156 k 2023-10-11T20:48:01.851 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-11T20:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:18.2.0-669.ge62d759a.el9 ceph 320 k 2023-10-11T20:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 298 k 2023-10-11T20:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:18.2.0-669.ge62d759a.el9 ceph 99 k 2023-10-11T20:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-11T20:48:01.852 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-11T20:48:01.853 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:01.853 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:01.853 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:01.853 INFO:teuthology.orchestra.run.smithi183.stdout:Install 28 Packages 2023-10-11T20:48:01.853 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 2 Packages 2023-10-11T20:48:01.854 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:01.854 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 53 M 2023-10-11T20:48:01.854 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:01.873 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-10-11T20:48:02.204 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-10-11T20:48:02.253 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:02.338 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:02.419 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 6/32 2023-10-11T20:48:02.446 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:02.492 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:02.521 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-10-11T20:48:02.564 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x 9/32 2023-10-11T20:48:02.632 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 10/32 2023-10-11T20:48:02.656 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:02.726 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:02.832 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-11T20:48:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-11T20:48:02.905 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-11T20:48:02.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-11T20:48:02.964 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-11T20:48:02.991 INFO:teuthology.orchestra.run.smithi183.stdout:(1/30): ceph-radosgw-18.2.0-669.ge62d759a.el9.x 9.5 MB/s | 7.7 MB 00:00 2023-10-11T20:48:03.000 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-11T20:48:03.033 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T20:48:03.049 INFO:teuthology.orchestra.run.smithi183.stdout:(2/30): ceph-selinux-18.2.0-669.ge62d759a.el9.x 414 kB/s | 24 kB 00:00 2023-10-11T20:48:03.166 INFO:teuthology.orchestra.run.smithi183.stdout:(3/30): libcephfs2-18.2.0-669.ge62d759a.el9.x86 5.5 MB/s | 654 kB 00:00 2023-10-11T20:48:03.233 INFO:teuthology.orchestra.run.smithi183.stdout:(4/30): ceph-base-18.2.0-669.ge62d759a.el9.x86_ 4.9 MB/s | 5.2 MB 00:01 2023-10-11T20:48:03.259 INFO:teuthology.orchestra.run.smithi183.stdout:(5/30): libradosstriper1-18.2.0-669.ge62d759a.e 5.0 MB/s | 474 kB 00:00 2023-10-11T20:48:03.309 INFO:teuthology.orchestra.run.smithi183.stdout:(6/30): python3-ceph-argparse-18.2.0-669.ge62d7 903 kB/s | 45 kB 00:00 2023-10-11T20:48:03.349 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-11T20:48:03.376 INFO:teuthology.orchestra.run.smithi183.stdout:(7/30): python3-ceph-common-18.2.0-669.ge62d759 1.8 MB/s | 124 kB 00:00 2023-10-11T20:48:03.387 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 20/32 2023-10-11T20:48:03.434 INFO:teuthology.orchestra.run.smithi183.stdout:(8/30): python3-cephfs-18.2.0-669.ge62d759a.el9 2.6 MB/s | 156 kB 00:00 2023-10-11T20:48:03.470 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 20/32 2023-10-11T20:48:03.500 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 21/32 2023-10-11T20:48:03.518 INFO:teuthology.orchestra.run.smithi183.stdout:(9/30): python3-rados-18.2.0-669.ge62d759a.el9. 3.8 MB/s | 320 kB 00:00 2023-10-11T20:48:03.537 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-11T20:48:03.585 INFO:teuthology.orchestra.run.smithi183.stdout:(10/30): python3-rbd-18.2.0-669.ge62d759a.el9.x 4.4 MB/s | 298 kB 00:00 2023-10-11T20:48:03.652 INFO:teuthology.orchestra.run.smithi183.stdout:(11/30): python3-rgw-18.2.0-669.ge62d759a.el9.x 1.5 MB/s | 99 kB 00:00 2023-10-11T20:48:03.752 INFO:teuthology.orchestra.run.smithi183.stdout:(12/30): librgw2-18.2.0-669.ge62d759a.el9.x86_6 8.6 MB/s | 4.4 MB 00:00 2023-10-11T20:48:03.811 INFO:teuthology.orchestra.run.smithi183.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 666 kB/s | 106 kB 00:00 2023-10-11T20:48:03.827 INFO:teuthology.orchestra.run.smithi183.stdout:(14/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-10-11T20:48:03.870 INFO:teuthology.orchestra.run.smithi183.stdout:(15/30): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-10-11T20:48:03.895 INFO:teuthology.orchestra.run.smithi183.stdout:(16/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.1 MB/s | 282 kB 00:00 2023-10-11T20:48:03.912 INFO:teuthology.orchestra.run.smithi183.stdout:(17/30): python3-prettytable-0.7.2-27.el9.noarc 995 kB/s | 41 kB 00:00 2023-10-11T20:48:03.959 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-11T20:48:03.989 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 24/32 2023-10-11T20:48:04.004 INFO:teuthology.orchestra.run.smithi183.stdout:(18/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2023-10-11T20:48:04.061 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 24/32 2023-10-11T20:48:04.139 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 25/32 2023-10-11T20:48:04.167 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86 26/32 2023-10-11T20:48:04.262 INFO:teuthology.orchestra.run.smithi183.stdout:(19/30): ceph-common-18.2.0-669.ge62d759a.el9.x 8.8 MB/s | 18 MB 00:02 2023-10-11T20:48:04.388 INFO:teuthology.orchestra.run.smithi183.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 233 kB/s | 111 kB 00:00 2023-10-11T20:48:04.463 INFO:teuthology.orchestra.run.smithi183.stdout:(21/30): libarrow-doc-9.0.0-9.el9.noarch.rpm 329 kB/s | 24 kB 00:00 2023-10-11T20:48:04.546 INFO:teuthology.orchestra.run.smithi183.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 584 kB/s | 49 kB 00:00 2023-10-11T20:48:04.571 INFO:teuthology.orchestra.run.smithi183.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 544 kB/s | 309 kB 00:00 2023-10-11T20:48:04.648 INFO:teuthology.orchestra.run.smithi183.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2023-10-11T20:48:04.747 INFO:teuthology.orchestra.run.smithi183.stdout:(25/30): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.7 MB/s | 837 kB 00:00 2023-10-11T20:48:04.797 INFO:teuthology.orchestra.run.smithi183.stdout:(26/30): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2023-10-11T20:48:04.898 INFO:teuthology.orchestra.run.smithi183.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-10-11T20:48:04.956 INFO:teuthology.orchestra.run.smithi183.stdout:(28/30): libarrow-9.0.0-9.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2023-10-11T20:48:05.314 INFO:teuthology.orchestra.run.smithi183.stdout:(29/30): librbd1-18.2.0-669.ge62d759a.el9.x86_6 7.2 MB/s | 3.0 MB 00:00 2023-10-11T20:48:05.365 INFO:teuthology.orchestra.run.smithi183.stdout:(30/30): librados2-18.2.0-669.ge62d759a.el9.x86 5.8 MB/s | 3.3 MB 00:00 2023-10-11T20:48:05.371 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:05.371 INFO:teuthology.orchestra.run.smithi183.stdout:Total 15 MB/s | 53 MB 00:03 2023-10-11T20:48:05.383 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:05.417 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:05.418 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:05.927 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:05.928 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:06.251 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:06.290 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:06.877 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:06.910 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 28/32 2023-10-11T20:48:06.981 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 28/32 2023-10-11T20:48:06.981 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-11T20:48:06.981 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-11T20:48:06.982 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:07.094 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:07.370 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:07.436 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2023-10-11T20:48:07.482 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/32 2023-10-11T20:48:07.536 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/32 2023-10-11T20:48:07.904 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2023-10-11T20:48:07.935 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:08.027 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:08.107 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 6/32 2023-10-11T20:48:08.136 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:08.199 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:08.227 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2023-10-11T20:48:08.271 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x 9/32 2023-10-11T20:48:08.338 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 10/32 2023-10-11T20:48:08.364 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:08.420 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:08.527 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2023-10-11T20:48:08.563 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 13/32 2023-10-11T20:48:08.603 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2023-10-11T20:48:08.652 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2023-10-11T20:48:08.679 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 16/32 2023-10-11T20:48:08.706 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2023-10-11T20:48:08.739 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T20:48:09.053 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2023-10-11T20:48:09.086 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 20/32 2023-10-11T20:48:09.176 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 20/32 2023-10-11T20:48:09.207 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 21/32 2023-10-11T20:48:09.243 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2023-10-11T20:48:09.645 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 23/32 2023-10-11T20:48:09.672 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 24/32 2023-10-11T20:48:09.743 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 24/32 2023-10-11T20:48:09.818 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 25/32 2023-10-11T20:48:09.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86 26/32 2023-10-11T20:48:11.912 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:11.952 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:12.512 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 27/32 2023-10-11T20:48:12.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 28/32 2023-10-11T20:48:12.640 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 28/32 2023-10-11T20:48:12.640 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-11T20:48:12.641 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-11T20:48:12.641 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:12.673 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:17.109 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:17.109 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2023-10-11T20:48:17.109 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2023-10-11T20:48:17.110 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2023-10-11T20:48:17.110 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2023-10-11T20:48:17.110 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2023-10-11T20:48:17.110 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2023-10-11T20:48:17.111 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2023-10-11T20:48:17.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:17.882 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 30/32 2023-10-11T20:48:17.908 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 30/32 2023-10-11T20:48:17.908 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-11T20:48:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T20:48:17.909 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T20:48:17.909 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:17.910 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T20:48:17.985 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T20:48:17.986 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:19.128 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:19.128 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 1/32 2023-10-11T20:48:19.129 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2/32 2023-10-11T20:48:19.129 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 3/32 2023-10-11T20:48:19.129 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 4/32 2023-10-11T20:48:19.129 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:19.129 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 6/32 2023-10-11T20:48:19.130 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:19.130 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x 8/32 2023-10-11T20:48:19.130 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86 9/32 2023-10-11T20:48:19.130 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 10/32 2023-10-11T20:48:19.130 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:19.131 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 12/32 2023-10-11T20:48:19.131 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 13/32 2023-10-11T20:48:19.131 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-11T20:48:19.131 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-11T20:48:19.131 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-11T20:48:19.132 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-11T20:48:19.133 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-11T20:48:19.133 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-11T20:48:19.133 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-11T20:48:19.133 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-11T20:48:19.133 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-11T20:48:19.134 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-11T20:48:19.134 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:19.134 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-11T20:48:19.134 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 31/32 2023-10-11T20:48:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:20.142 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2023-10-11T20:48:20.142 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-11T20:48:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.143 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-11T20:48:20.144 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-11T20:48:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-11T20:48:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-11T20:48:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-11T20:48:20.145 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-11T20:48:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-11T20:48:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-11T20:48:20.146 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-11T20:48:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-11T20:48:20.147 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-3.el9.x86_64 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:20.148 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:20.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test 2023-10-11T20:48:21.092 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:28 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:21.236 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:21.236 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:21.236 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:48:21.237 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:21.237 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:21.237 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:18.2.0-669.ge62d759a.el9 ceph 40 M 2023-10-11T20:48:21.237 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:48:21.238 INFO:teuthology.orchestra.run.smithi022.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-11T20:48:21.238 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:18.2.0-669.ge62d759a.el9 ceph 161 k 2023-10-11T20:48:21.238 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-11T20:48:21.238 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-11T20:48:21.238 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-11T20:48:21.239 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:21.239 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:21.239 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:21.239 INFO:teuthology.orchestra.run.smithi022.stdout:Install 6 Packages 2023-10-11T20:48:21.239 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:21.240 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 40 M 2023-10-11T20:48:21.240 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 167 M 2023-10-11T20:48:21.240 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:21.475 INFO:teuthology.orchestra.run.smithi022.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.3 MB/s | 217 kB 00:00 2023-10-11T20:48:21.525 INFO:teuthology.orchestra.run.smithi022.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 300 kB 00:00 2023-10-11T20:48:21.551 INFO:teuthology.orchestra.run.smithi022.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 63 kB 00:00 2023-10-11T20:48:21.659 INFO:teuthology.orchestra.run.smithi022.stdout:(4/6): libcephsqlite-18.2.0-669.ge62d759a.el9.x 459 kB/s | 161 kB 00:00 2023-10-11T20:48:21.684 INFO:teuthology.orchestra.run.smithi022.stdout:(5/6): jq-1.6-15.el9.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-11T20:48:22.188 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:22.188 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2023-10-11T20:48:22.188 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2023-10-11T20:48:22.189 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2023-10-11T20:48:22.189 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2023-10-11T20:48:22.189 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2023-10-11T20:48:22.189 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2023-10-11T20:48:22.189 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2023-10-11T20:48:22.190 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:22.929 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 30/32 2023-10-11T20:48:22.954 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 30/32 2023-10-11T20:48:22.955 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:22.955 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-11T20:48:22.955 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T20:48:22.955 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-11T20:48:22.955 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:22.957 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T20:48:23.040 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2023-10-11T20:48:23.041 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:23.326 INFO:teuthology.orchestra.run.smithi022.stdout:(6/6): ceph-test-18.2.0-669.ge62d759a.el9.x86_6 20 MB/s | 40 MB 00:02 2023-10-11T20:48:23.329 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:23.330 INFO:teuthology.orchestra.run.smithi022.stdout:Total 19 MB/s | 40 MB 00:02 2023-10-11T20:48:23.344 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:23.367 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:23.368 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:23.727 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:23.728 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:24.235 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:24.235 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 1/32 2023-10-11T20:48:24.235 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2/32 2023-10-11T20:48:24.235 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 3/32 2023-10-11T20:48:24.236 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 4/32 2023-10-11T20:48:24.236 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 5/32 2023-10-11T20:48:24.236 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 6/32 2023-10-11T20:48:24.236 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 7/32 2023-10-11T20:48:24.236 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x 8/32 2023-10-11T20:48:24.237 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86 9/32 2023-10-11T20:48:24.237 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 10/32 2023-10-11T20:48:24.237 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 11/32 2023-10-11T20:48:24.237 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 12/32 2023-10-11T20:48:24.237 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 13/32 2023-10-11T20:48:24.238 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2023-10-11T20:48:24.238 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2023-10-11T20:48:24.238 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/32 2023-10-11T20:48:24.238 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/32 2023-10-11T20:48:24.238 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/32 2023-10-11T20:48:24.239 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/32 2023-10-11T20:48:24.239 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2023-10-11T20:48:24.239 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2023-10-11T20:48:24.239 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 22/32 2023-10-11T20:48:24.239 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 23/32 2023-10-11T20:48:24.240 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2023-10-11T20:48:24.240 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2023-10-11T20:48:24.241 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 26/32 2023-10-11T20:48:24.241 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2023-10-11T20:48:24.242 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2023-10-11T20:48:24.242 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:18.2.0-669.ge62d759a.el9.x86_64 29/32 2023-10-11T20:48:24.242 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2023-10-11T20:48:24.243 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 31/32 2023-10-11T20:48:24.309 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:24.409 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-10-11T20:48:24.462 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-10-11T20:48:24.493 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-10-11T20:48:24.536 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-10-11T20:48:24.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 5/6 2023-10-11T20:48:25.282 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2023-10-11T20:48:25.282 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:25.283 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2023-10-11T20:48:25.283 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.283 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.283 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:25.283 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-11T20:48:25.284 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.284 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.284 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.284 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.284 INFO:teuthology.orchestra.run.smithi183.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-11T20:48:25.285 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-11T20:48:25.285 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-11T20:48:25.285 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-11T20:48:25.285 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.285 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-11T20:48:25.286 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-11T20:48:25.286 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-11T20:48:25.286 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.286 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-11T20:48:25.286 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.287 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-11T20:48:25.287 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-11T20:48:25.287 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-11T20:48:25.287 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.287 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.288 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.288 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-11T20:48:25.288 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.288 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.289 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:25.289 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-3.el9.x86_64 2023-10-11T20:48:25.289 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-11T20:48:25.289 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:25.289 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:25.603 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-test 2023-10-11T20:48:26.178 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:27 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:26.314 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:26.315 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:26.315 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:26.316 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:26.316 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:26.316 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:18.2.0-669.ge62d759a.el9 ceph 40 M 2023-10-11T20:48:26.316 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:48:26.316 INFO:teuthology.orchestra.run.smithi183.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:18.2.0-669.ge62d759a.el9 ceph 161 k 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:26.317 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:26.318 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:26.318 INFO:teuthology.orchestra.run.smithi183.stdout:Install 6 Packages 2023-10-11T20:48:26.318 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:26.319 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 40 M 2023-10-11T20:48:26.319 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 167 M 2023-10-11T20:48:26.320 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:26.646 INFO:teuthology.orchestra.run.smithi183.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.4 MB/s | 217 kB 00:00 2023-10-11T20:48:26.704 INFO:teuthology.orchestra.run.smithi183.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 300 kB 00:00 2023-10-11T20:48:26.729 INFO:teuthology.orchestra.run.smithi183.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2023-10-11T20:48:26.988 INFO:teuthology.orchestra.run.smithi183.stdout:(4/6): jq-1.6-15.el9.x86_64.rpm 723 kB/s | 187 kB 00:00 2023-10-11T20:48:27.013 INFO:teuthology.orchestra.run.smithi183.stdout:(5/6): libcephsqlite-18.2.0-669.ge62d759a.el9.x 309 kB/s | 161 kB 00:00 2023-10-11T20:48:28.472 INFO:teuthology.orchestra.run.smithi183.stdout:(6/6): ceph-test-18.2.0-669.ge62d759a.el9.x86_6 20 MB/s | 40 MB 00:01 2023-10-11T20:48:28.474 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:28.475 INFO:teuthology.orchestra.run.smithi183.stdout:Total 19 MB/s | 40 MB 00:02 2023-10-11T20:48:28.489 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:28.509 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:28.509 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:28.520 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 5/6 2023-10-11T20:48:28.605 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 6/6 2023-10-11T20:48:28.845 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:28.845 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:29.369 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:29.439 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2023-10-11T20:48:29.478 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2023-10-11T20:48:29.514 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-10-11T20:48:29.556 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : jq-1.6-15.el9.x86_64 4/6 2023-10-11T20:48:29.583 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 5/6 2023-10-11T20:48:30.635 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 6/6 2023-10-11T20:48:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 1/6 2023-10-11T20:48:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 2/6 2023-10-11T20:48:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-10-11T20:48:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-10-11T20:48:30.636 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-10-11T20:48:31.036 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-10-11T20:48:31.037 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:31.037 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:31.037 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:31.037 INFO:teuthology.orchestra.run.smithi022.stdout: jq-1.6-15.el9.x86_64 2023-10-11T20:48:31.037 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:31.038 INFO:teuthology.orchestra.run.smithi022.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-11T20:48:31.038 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-11T20:48:31.038 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-11T20:48:31.038 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:31.038 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:31.339 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph 2023-10-11T20:48:31.938 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:38 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:32.084 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:32.086 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================== 2023-10-11T20:48:32.086 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:48:32.087 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================== 2023-10-11T20:48:32.087 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:32.088 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:18.2.0-669.ge62d759a.el9 ceph 6.5 k 2023-10-11T20:48:32.088 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:48:32.088 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:18.2.0-669.ge62d759a.el9 ceph 2.1 M 2023-10-11T20:48:32.088 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.4 M 2023-10-11T20:48:32.089 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 242 k 2023-10-11T20:48:32.089 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.4 M 2023-10-11T20:48:32.089 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 18 M 2023-10-11T20:48:32.089 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-11T20:48:32.089 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-11T20:48:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-11T20:48:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-11T20:48:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-11T20:48:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-11T20:48:32.090 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-11T20:48:32.091 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-11T20:48:32.091 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-11T20:48:32.091 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-11T20:48:32.091 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-11T20:48:32.091 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-11T20:48:32.092 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-11T20:48:32.092 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-11T20:48:32.092 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-11T20:48:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-11T20:48:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-11T20:48:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-11T20:48:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-11T20:48:32.093 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-11T20:48:32.094 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-11T20:48:32.094 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-11T20:48:32.094 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-11T20:48:32.094 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-11T20:48:32.094 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-11T20:48:32.095 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-11T20:48:32.095 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-11T20:48:32.095 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:32.095 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:32.095 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================== 2023-10-11T20:48:32.096 INFO:teuthology.orchestra.run.smithi022.stdout:Install 33 Packages 2023-10-11T20:48:32.096 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:32.096 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 30 M 2023-10-11T20:48:32.097 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 110 M 2023-10-11T20:48:32.097 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:32.678 INFO:teuthology.orchestra.run.smithi022.stdout:(1/33): ceph-18.2.0-669.ge62d759a.el9.x86_64.rp 39 kB/s | 6.5 kB 00:00 2023-10-11T20:48:33.087 INFO:teuthology.orchestra.run.smithi022.stdout:(2/33): ceph-mon-18.2.0-669.ge62d759a.el9.x86_6 11 MB/s | 4.4 MB 00:00 2023-10-11T20:48:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:(3/33): ceph-mgr-18.2.0-669.ge62d759a.el9.x86_6 2.3 MB/s | 1.4 MB 00:00 2023-10-11T20:48:33.195 INFO:teuthology.orchestra.run.smithi022.stdout:(4/33): ceph-mds-18.2.0-669.ge62d759a.el9.x86_6 3.1 MB/s | 2.1 MB 00:00 2023-10-11T20:48:33.254 INFO:teuthology.orchestra.run.smithi022.stdout:(5/33): ceph-mgr-modules-core-18.2.0-669.ge62d7 2.2 MB/s | 242 kB 00:00 2023-10-11T20:48:33.294 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 5/6 2023-10-11T20:48:33.313 INFO:teuthology.orchestra.run.smithi022.stdout:(6/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 144 kB 00:00 2023-10-11T20:48:33.330 INFO:teuthology.orchestra.run.smithi022.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 426 kB/s | 32 kB 00:00 2023-10-11T20:48:33.347 INFO:teuthology.orchestra.run.smithi022.stdout:(8/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-11T20:48:33.366 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 6/6 2023-10-11T20:48:33.373 INFO:teuthology.orchestra.run.smithi022.stdout:(9/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.6 MB/s | 241 kB 00:00 2023-10-11T20:48:33.398 INFO:teuthology.orchestra.run.smithi022.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-10-11T20:48:33.423 INFO:teuthology.orchestra.run.smithi022.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2023-10-11T20:48:33.465 INFO:teuthology.orchestra.run.smithi022.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 1.6 MB/s | 113 kB 00:00 2023-10-11T20:48:33.615 INFO:teuthology.orchestra.run.smithi022.stdout:(13/33): python3-urllib3-1.26.5-3.el9.noarch.rp 981 kB/s | 188 kB 00:00 2023-10-11T20:48:33.899 INFO:teuthology.orchestra.run.smithi022.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2023-10-11T20:48:34.216 INFO:teuthology.orchestra.run.smithi022.stdout:(15/33): ceph-osd-18.2.0-669.ge62d759a.el9.x86_ 16 MB/s | 18 MB 00:01 2023-10-11T20:48:34.232 INFO:teuthology.orchestra.run.smithi022.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 83 kB/s | 51 kB 00:00 2023-10-11T20:48:34.358 INFO:teuthology.orchestra.run.smithi022.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 95 kB/s | 43 kB 00:00 2023-10-11T20:48:34.416 INFO:teuthology.orchestra.run.smithi022.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2023-10-11T20:48:34.467 INFO:teuthology.orchestra.run.smithi022.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 686 kB/s | 172 kB 00:00 2023-10-11T20:48:34.484 INFO:teuthology.orchestra.run.smithi022.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 263 kB/s | 18 kB 00:00 2023-10-11T20:48:34.518 INFO:teuthology.orchestra.run.smithi022.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2023-10-11T20:48:34.542 INFO:teuthology.orchestra.run.smithi022.stdout:(22/33): python3-jaraco-collections-3.0.0-8.el9 306 kB/s | 23 kB 00:00 2023-10-11T20:48:34.568 INFO:teuthology.orchestra.run.smithi022.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 232 kB/s | 19 kB 00:00 2023-10-11T20:48:34.593 INFO:teuthology.orchestra.run.smithi022.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2023-10-11T20:48:34.618 INFO:teuthology.orchestra.run.smithi022.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2023-10-11T20:48:34.660 INFO:teuthology.orchestra.run.smithi022.stdout:(26/33): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2023-10-11T20:48:34.686 INFO:teuthology.orchestra.run.smithi022.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 671 kB/s | 79 kB 00:00 2023-10-11T20:48:34.711 INFO:teuthology.orchestra.run.smithi022.stdout:(28/33): python3-portend-3.1.0-2.el9.noarch.rpm 178 kB/s | 16 kB 00:00 2023-10-11T20:48:34.736 INFO:teuthology.orchestra.run.smithi022.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2023-10-11T20:48:34.778 INFO:teuthology.orchestra.run.smithi022.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 537 kB/s | 36 kB 00:00 2023-10-11T20:48:34.803 INFO:teuthology.orchestra.run.smithi022.stdout:(31/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2023-10-11T20:48:34.828 INFO:teuthology.orchestra.run.smithi022.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2023-10-11T20:48:34.854 INFO:teuthology.orchestra.run.smithi022.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 265 kB/s | 20 kB 00:00 2023-10-11T20:48:34.856 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:34.856 INFO:teuthology.orchestra.run.smithi022.stdout:Total 11 MB/s | 30 MB 00:02 2023-10-11T20:48:34.890 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:34.934 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:34.934 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:35.326 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:35.327 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:35.490 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 6/6 2023-10-11T20:48:35.491 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 1/6 2023-10-11T20:48:35.491 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 2/6 2023-10-11T20:48:35.491 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2023-10-11T20:48:35.491 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2023-10-11T20:48:35.492 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2023-10-11T20:48:35.864 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : jq-1.6-15.el9.x86_64 6/6 2023-10-11T20:48:35.865 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:35.865 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:35.865 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:35.865 INFO:teuthology.orchestra.run.smithi183.stdout: jq-1.6-15.el9.x86_64 2023-10-11T20:48:35.865 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:35.866 INFO:teuthology.orchestra.run.smithi183.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-11T20:48:35.866 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-11T20:48:35.866 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-11T20:48:35.866 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:35.866 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:36.187 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph 2023-10-11T20:48:36.607 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:36.657 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-11T20:48:36.689 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-11T20:48:36.730 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-11T20:48:36.778 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:37 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:36.826 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-11T20:48:36.918 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:36.919 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-11T20:48:36.921 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-10-11T20:48:36.921 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:36.921 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-10-11T20:48:36.921 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:36.922 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:18.2.0-669.ge62d759a.el9 ceph 6.5 k 2023-10-11T20:48:36.922 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:48:36.922 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:18.2.0-669.ge62d759a.el9 ceph 2.1 M 2023-10-11T20:48:36.922 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.4 M 2023-10-11T20:48:36.922 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 242 k 2023-10-11T20:48:36.923 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.4 M 2023-10-11T20:48:36.923 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 18 M 2023-10-11T20:48:36.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-11T20:48:36.923 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-11T20:48:36.925 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-11T20:48:36.925 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-11T20:48:36.925 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-11T20:48:36.925 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-11T20:48:36.926 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-11T20:48:36.926 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-11T20:48:36.926 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-11T20:48:36.926 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-11T20:48:36.926 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-11T20:48:36.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-11T20:48:36.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-11T20:48:36.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-11T20:48:36.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-11T20:48:36.927 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-11T20:48:36.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-11T20:48:36.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-11T20:48:36.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-11T20:48:36.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-11T20:48:36.928 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-11T20:48:36.929 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-11T20:48:36.930 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:36.930 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:36.930 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================== 2023-10-11T20:48:36.930 INFO:teuthology.orchestra.run.smithi183.stdout:Install 33 Packages 2023-10-11T20:48:36.930 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:36.932 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 30 M 2023-10-11T20:48:36.932 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 110 M 2023-10-11T20:48:36.932 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:36.966 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-11T20:48:37.013 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-11T20:48:37.091 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-11T20:48:37.151 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 9/33 2023-10-11T20:48:37.189 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-11T20:48:37.239 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T20:48:37.303 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T20:48:37.509 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-11T20:48:37.552 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-11T20:48:37.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-11T20:48:37.634 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-11T20:48:37.663 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-11T20:48:37.742 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-11T20:48:37.782 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-11T20:48:37.816 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-11T20:48:37.841 INFO:teuthology.orchestra.run.smithi183.stdout:(1/33): ceph-18.2.0-669.ge62d759a.el9.x86_64.rp 30 kB/s | 6.5 kB 00:00 2023-10-11T20:48:37.857 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-11T20:48:37.891 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-11T20:48:37.958 INFO:teuthology.orchestra.run.smithi183.stdout:(2/33): ceph-mgr-18.2.0-669.ge62d759a.el9.x86_6 4.3 MB/s | 1.4 MB 00:00 2023-10-11T20:48:37.985 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-11T20:48:38.031 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-11T20:48:38.106 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-11T20:48:38.248 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-11T20:48:38.370 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T20:48:38.400 INFO:teuthology.orchestra.run.smithi183.stdout:(3/33): ceph-mds-18.2.0-669.ge62d759a.el9.x86_6 2.7 MB/s | 2.1 MB 00:00 2023-10-11T20:48:38.492 INFO:teuthology.orchestra.run.smithi183.stdout:(4/33): ceph-mgr-modules-core-18.2.0-669.ge62d7 2.6 MB/s | 242 kB 00:00 2023-10-11T20:48:38.535 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.n 28/33 2023-10-11T20:48:38.562 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 29/33 2023-10-11T20:48:38.587 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 29/33 2023-10-11T20:48:38.588 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:38.588 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-11T20:48:38.588 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T20:48:38.588 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T20:48:38.589 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:38.609 INFO:teuthology.orchestra.run.smithi183.stdout:(5/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.2 MB/s | 144 kB 00:00 2023-10-11T20:48:38.642 INFO:teuthology.orchestra.run.smithi183.stdout:(6/33): python3-markupsafe-1.1.1-12.el9.x86_64. 952 kB/s | 32 kB 00:00 2023-10-11T20:48:38.676 INFO:teuthology.orchestra.run.smithi183.stdout:(7/33): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2023-10-11T20:48:38.718 INFO:teuthology.orchestra.run.smithi183.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.7 MB/s | 241 kB 00:00 2023-10-11T20:48:38.877 INFO:teuthology.orchestra.run.smithi183.stdout:(9/33): ceph-osd-18.2.0-669.ge62d759a.el9.x86_6 19 MB/s | 18 MB 00:00 2023-10-11T20:48:38.893 INFO:teuthology.orchestra.run.smithi183.stdout:(10/33): python3-ply-3.11-14.el9.noarch.rpm 586 kB/s | 103 kB 00:00 2023-10-11T20:48:38.911 INFO:teuthology.orchestra.run.smithi183.stdout:(11/33): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2023-10-11T20:48:38.936 INFO:teuthology.orchestra.run.smithi183.stdout:(12/33): python3-requests-2.25.1-7.el9.noarch.r 2.6 MB/s | 113 kB 00:00 2023-10-11T20:48:38.953 INFO:teuthology.orchestra.run.smithi183.stdout:(13/33): python3-urllib3-1.26.5-3.el9.noarch.rp 4.4 MB/s | 188 kB 00:00 2023-10-11T20:48:39.061 INFO:teuthology.orchestra.run.smithi183.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2023-10-11T20:48:39.178 INFO:teuthology.orchestra.run.smithi183.stdout:(15/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 373 kB/s | 43 kB 00:00 2023-10-11T20:48:39.270 INFO:teuthology.orchestra.run.smithi183.stdout:(16/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2023-10-11T20:48:39.337 INFO:teuthology.orchestra.run.smithi183.stdout:(17/33): ceph-mon-18.2.0-669.ge62d759a.el9.x86_ 2.9 MB/s | 4.4 MB 00:01 2023-10-11T20:48:39.379 INFO:teuthology.orchestra.run.smithi183.stdout:(18/33): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2023-10-11T20:48:39.421 INFO:teuthology.orchestra.run.smithi183.stdout:(19/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2023-10-11T20:48:39.446 INFO:teuthology.orchestra.run.smithi183.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 264 kB/s | 18 kB 00:00 2023-10-11T20:48:39.472 INFO:teuthology.orchestra.run.smithi183.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2023-10-11T20:48:39.505 INFO:teuthology.orchestra.run.smithi183.stdout:(22/33): python3-cryptography-36.0.1-4.el9.x86_ 2.2 MB/s | 1.2 MB 00:00 2023-10-11T20:48:39.522 INFO:teuthology.orchestra.run.smithi183.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2023-10-11T20:48:39.539 INFO:teuthology.orchestra.run.smithi183.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 292 kB/s | 20 kB 00:00 2023-10-11T20:48:39.565 INFO:teuthology.orchestra.run.smithi183.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2023-10-11T20:48:39.606 INFO:teuthology.orchestra.run.smithi183.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 396 kB/s | 16 kB 00:00 2023-10-11T20:48:39.640 INFO:teuthology.orchestra.run.smithi183.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 672 kB/s | 79 kB 00:00 2023-10-11T20:48:39.665 INFO:teuthology.orchestra.run.smithi183.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2023-10-11T20:48:39.690 INFO:teuthology.orchestra.run.smithi183.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-10-11T20:48:39.707 INFO:teuthology.orchestra.run.smithi183.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 533 kB/s | 36 kB 00:00 2023-10-11T20:48:39.733 INFO:teuthology.orchestra.run.smithi183.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2023-10-11T20:48:39.749 INFO:teuthology.orchestra.run.smithi183.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 478 kB/s | 20 kB 00:00 2023-10-11T20:48:39.775 INFO:teuthology.orchestra.run.smithi183.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2023-10-11T20:48:39.777 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:39.777 INFO:teuthology.orchestra.run.smithi183.stdout:Total 10 MB/s | 30 MB 00:02 2023-10-11T20:48:39.811 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:39.850 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:39.850 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:40.205 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 30/33 2023-10-11T20:48:40.216 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:40.217 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:40.234 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 30/33 2023-10-11T20:48:40.235 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:40.235 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-11T20:48:40.235 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T20:48:40.235 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T20:48:40.236 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:40.705 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 31/33 2023-10-11T20:48:40.730 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 31/33 2023-10-11T20:48:40.731 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:40.731 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-11T20:48:40.732 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T20:48:40.732 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T20:48:40.732 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:40.940 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 32/33 2023-10-11T20:48:40.964 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 32/33 2023-10-11T20:48:40.964 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:40.965 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-11T20:48:40.965 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T20:48:40.965 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T20:48:40.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:41.023 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:18.2.0-669.ge62d759a.el9.x86_64 33/33 2023-10-11T20:48:41.445 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:41.511 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2023-10-11T20:48:41.551 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2023-10-11T20:48:41.584 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2023-10-11T20:48:41.674 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2023-10-11T20:48:41.762 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2023-10-11T20:48:41.804 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2023-10-11T20:48:41.849 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2023-10-11T20:48:41.922 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 8/33 2023-10-11T20:48:41.972 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 9/33 2023-10-11T20:48:42.010 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 10/33 2023-10-11T20:48:42.060 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T20:48:42.115 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T20:48:42.308 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 13/33 2023-10-11T20:48:42.355 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 14/33 2023-10-11T20:48:42.393 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 15/33 2023-10-11T20:48:42.429 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 16/33 2023-10-11T20:48:42.462 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 17/33 2023-10-11T20:48:42.534 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 18/33 2023-10-11T20:48:42.570 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 19/33 2023-10-11T20:48:42.603 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 20/33 2023-10-11T20:48:42.644 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 21/33 2023-10-11T20:48:42.679 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2023-10-11T20:48:42.768 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2023-10-11T20:48:42.782 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-2:18.2.0-669.ge62d759a.el9.x86_64 33/33 2023-10-11T20:48:42.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:18.2.0-669.ge62d759a.el9.x86_64 1/33 2023-10-11T20:48:42.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 2/33 2023-10-11T20:48:42.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 3/33 2023-10-11T20:48:42.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 4/33 2023-10-11T20:48:42.783 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 5/33 2023-10-11T20:48:42.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.n 6/33 2023-10-11T20:48:42.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-11T20:48:42.784 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-11T20:48:42.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-11T20:48:42.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-11T20:48:42.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T20:48:42.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T20:48:42.785 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-11T20:48:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 14/33 2023-10-11T20:48:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-11T20:48:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-11T20:48:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-11T20:48:42.786 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-11T20:48:42.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-11T20:48:42.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-11T20:48:42.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-11T20:48:42.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-11T20:48:42.787 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-11T20:48:42.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-11T20:48:42.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-11T20:48:42.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-11T20:48:42.788 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T20:48:42.789 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-11T20:48:42.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-11T20:48:42.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-11T20:48:42.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-11T20:48:42.790 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-11T20:48:42.816 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2023-10-11T20:48:42.900 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2023-10-11T20:48:43.036 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2023-10-11T20:48:43.161 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T20:48:43.316 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.n 28/33 2023-10-11T20:48:43.341 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 29/33 2023-10-11T20:48:43.366 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 29/33 2023-10-11T20:48:43.366 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:43.366 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-11T20:48:43.366 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T20:48:43.367 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-11T20:48:43.367 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:43.697 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-11T20:48:43.697 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:43.697 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:43.698 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:43.698 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:43.698 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:43.698 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:43.699 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:43.699 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:43.699 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-11T20:48:43.699 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-11T20:48:43.699 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-11T20:48:43.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-11T20:48:43.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-11T20:48:43.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-11T20:48:43.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-11T20:48:43.700 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-11T20:48:43.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-11T20:48:43.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-11T20:48:43.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-11T20:48:43.701 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-11T20:48:43.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-11T20:48:43.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-11T20:48:43.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-11T20:48:43.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2023-10-11T20:48:43.702 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-11T20:48:43.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-11T20:48:43.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-11T20:48:43.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-11T20:48:43.703 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-11T20:48:43.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-11T20:48:43.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-11T20:48:43.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-11T20:48:43.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-11T20:48:43.704 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-11T20:48:43.705 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-11T20:48:43.705 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:43.705 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:44.061 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base 2023-10-11T20:48:44.700 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:44.793 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:48:44.845 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:44.846 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:48:44.846 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:44.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install cephadm 2023-10-11T20:48:44.943 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 30/33 2023-10-11T20:48:44.971 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 30/33 2023-10-11T20:48:44.971 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:44.971 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-11T20:48:44.972 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T20:48:44.972 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-11T20:48:44.972 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:45.427 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 31/33 2023-10-11T20:48:45.450 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 31/33 2023-10-11T20:48:45.451 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:45.451 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-11T20:48:45.451 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T20:48:45.451 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-11T20:48:45.451 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:45.504 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:52 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:45.649 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:45.650 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:45.650 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:48:45.651 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:45.651 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 221 k 2023-10-11T20:48:45.651 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:48:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:45.652 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 221 k 2023-10-11T20:48:45.653 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 213 k 2023-10-11T20:48:45.653 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:45.653 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 32/33 2023-10-11T20:48:45.676 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 32/33 2023-10-11T20:48:45.676 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:45.676 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-11T20:48:45.676 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T20:48:45.677 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-11T20:48:45.677 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:45.741 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:18.2.0-669.ge62d759a.el9.x86_64 33/33 2023-10-11T20:48:46.004 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm-18.2.0-669.ge62d759a.el9.noarch.rpm 626 kB/s | 221 kB 00:00 2023-10-11T20:48:46.006 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:46.006 INFO:teuthology.orchestra.run.smithi022.stdout:Total 624 kB/s | 221 kB 00:00 2023-10-11T20:48:46.006 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:46.011 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:46.011 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:46.013 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:46.014 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:47.316 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:47.316 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:47.316 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:47.316 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:47.317 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:47.317 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:47.475 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-2:18.2.0-669.ge62d759a.el9.x86_64 33/33 2023-10-11T20:48:47.475 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:18.2.0-669.ge62d759a.el9.x86_64 1/33 2023-10-11T20:48:47.475 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 2/33 2023-10-11T20:48:47.476 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 3/33 2023-10-11T20:48:47.477 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 4/33 2023-10-11T20:48:47.477 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 5/33 2023-10-11T20:48:47.477 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.n 6/33 2023-10-11T20:48:47.477 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2023-10-11T20:48:47.477 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 9/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 10/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 11/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 12/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 13/33 2023-10-11T20:48:47.478 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 14/33 2023-10-11T20:48:47.479 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 15/33 2023-10-11T20:48:47.479 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/33 2023-10-11T20:48:47.479 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2023-10-11T20:48:47.479 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2023-10-11T20:48:47.479 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2023-10-11T20:48:47.480 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2023-10-11T20:48:47.480 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2023-10-11T20:48:47.480 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2023-10-11T20:48:47.480 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2023-10-11T20:48:47.480 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2023-10-11T20:48:47.481 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2023-10-11T20:48:47.481 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2023-10-11T20:48:47.481 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2023-10-11T20:48:47.481 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2023-10-11T20:48:47.482 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2023-10-11T20:48:47.482 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2023-10-11T20:48:47.482 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2023-10-11T20:48:47.482 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2023-10-11T20:48:47.526 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-immutable-object-cache 2023-10-11T20:48:48.131 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:55 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:48.276 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:48.277 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:48:48.277 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:48.278 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-669.ge62d759a.el9 ceph 142 k 2023-10-11T20:48:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:48.278 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:48.279 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:48.279 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:48:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:48.279 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 142 k 2023-10-11T20:48:48.279 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 395 k 2023-10-11T20:48:48.280 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:48.485 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-immutable-object-cache-18.2.0-669.ge62d759 688 kB/s | 142 kB 00:00 2023-10-11T20:48:48.486 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:48.486 INFO:teuthology.orchestra.run.smithi022.stdout:Total 683 kB/s | 142 kB 00:00 2023-10-11T20:48:48.486 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:48.497 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:48.497 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:48.541 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2023-10-11T20:48:48.542 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:48.542 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:48.542 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:48.542 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:48.542 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:48.543 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:48.543 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:48.543 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:48.543 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-11T20:48:48.543 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-11T20:48:48.544 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-11T20:48:48.544 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-11T20:48:48.544 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-11T20:48:48.544 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-11T20:48:48.544 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-11T20:48:48.545 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-11T20:48:48.545 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-11T20:48:48.545 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-11T20:48:48.545 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-11T20:48:48.545 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-11T20:48:48.546 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-11T20:48:48.546 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-11T20:48:48.546 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-11T20:48:48.547 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-11T20:48:48.548 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-11T20:48:48.548 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-11T20:48:48.548 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-11T20:48:48.548 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-11T20:48:48.549 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-11T20:48:48.549 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-11T20:48:48.549 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:48.549 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:48.551 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:48.551 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:48.695 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:48.761 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:48.785 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:48.786 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:48.786 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-11T20:48:48.786 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:48.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base 2023-10-11T20:48:49.432 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:50 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:49.520 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-base-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:48:49.567 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:49.568 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:48:49.568 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:49.631 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install cephadm 2023-10-11T20:48:49.755 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:49.755 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:49.756 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:49.756 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:49.756 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:49.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr 2023-10-11T20:48:50.210 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:51 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:50.349 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:50.350 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:50.350 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:50.350 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:50.350 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:50.350 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 221 k 2023-10-11T20:48:50.351 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:50.351 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:50.351 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:50.351 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:48:50.351 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:50.352 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 221 k 2023-10-11T20:48:50.352 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 213 k 2023-10-11T20:48:50.352 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:50.591 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:57 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:50.684 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:48:50.702 INFO:teuthology.orchestra.run.smithi183.stdout:cephadm-18.2.0-669.ge62d759a.el9.noarch.rpm 630 kB/s | 221 kB 00:00 2023-10-11T20:48:50.702 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:50.703 INFO:teuthology.orchestra.run.smithi183.stdout:Total 627 kB/s | 221 kB 00:00 2023-10-11T20:48:50.703 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:50.707 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:50.708 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:50.710 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:50.711 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:50.736 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:50.737 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:48:50.737 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:50.782 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:50.794 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-dashboard 2023-10-11T20:48:51.214 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:51.300 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:51.402 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:00:58 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:51.547 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:51.548 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:51.548 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:48:51.548 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:51.548 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:51.548 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 1.8 M 2023-10-11T20:48:51.549 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:48:51.549 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 23 k 2023-10-11T20:48:51.549 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 15 k 2023-10-11T20:48:51.549 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-11T20:48:51.549 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-11T20:48:51.550 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-11T20:48:51.550 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2023-10-11T20:48:51.550 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-11T20:48:51.550 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:51.550 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:51.551 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:48:51.551 INFO:teuthology.orchestra.run.smithi022.stdout:Install 7 Packages 2023-10-11T20:48:51.551 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:51.552 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.1 M 2023-10-11T20:48:51.552 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 8.6 M 2023-10-11T20:48:51.552 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:51.667 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:51.864 INFO:teuthology.orchestra.run.smithi022.stdout:(1/7): ceph-grafana-dashboards-18.2.0-669.ge62d 88 kB/s | 23 kB 00:00 2023-10-11T20:48:51.922 INFO:teuthology.orchestra.run.smithi022.stdout:(2/7): ceph-prometheus-alerts-18.2.0-669.ge62d7 45 kB/s | 15 kB 00:00 2023-10-11T20:48:51.952 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:48:51.953 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:51.953 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:51.953 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:51.953 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:51.953 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:52.097 INFO:teuthology.orchestra.run.smithi022.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 39 kB/s | 9.0 kB 00:00 2023-10-11T20:48:52.172 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-immutable-object-cache 2023-10-11T20:48:52.198 INFO:teuthology.orchestra.run.smithi022.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 308 kB/s | 31 kB 00:00 2023-10-11T20:48:52.223 INFO:teuthology.orchestra.run.smithi022.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 148 kB/s | 41 kB 00:00 2023-10-11T20:48:52.281 INFO:teuthology.orchestra.run.smithi022.stdout:(6/7): ceph-mgr-dashboard-18.2.0-669.ge62d759a. 2.6 MB/s | 1.8 MB 00:00 2023-10-11T20:48:52.382 INFO:teuthology.orchestra.run.smithi022.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.0 MB/s | 188 kB 00:00 2023-10-11T20:48:52.385 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:52.385 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.5 MB/s | 2.1 MB 00:00 2023-10-11T20:48:52.385 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:52.394 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:52.394 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:52.464 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:52.465 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:52.763 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:52.765 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:53 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:52.825 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-11T20:48:52.860 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-11T20:48:52.902 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:52.903 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:52.903 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:48:52.903 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:52.904 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:52.904 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-669.ge62d759a.el9 ceph 142 k 2023-10-11T20:48:52.904 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:52.904 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:52.904 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:52.905 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:48:52.905 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:52.905 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 142 k 2023-10-11T20:48:52.905 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 395 k 2023-10-11T20:48:52.906 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:52.907 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-11T20:48:52.937 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-11T20:48:52.966 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.no 5/7 2023-10-11T20:48:53.108 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-immutable-object-cache-18.2.0-669.ge62d759 700 kB/s | 142 kB 00:00 2023-10-11T20:48:53.108 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:53.108 INFO:teuthology.orchestra.run.smithi183.stdout:Total 695 kB/s | 142 kB 00:00 2023-10-11T20:48:53.109 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:53.116 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:53.116 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:53.167 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:53.167 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:53.212 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.n 6/7 2023-10-11T20:48:53.243 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 7/7 2023-10-11T20:48:53.306 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:53.367 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:53.392 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:53.392 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:48:53.392 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-11T20:48:53.392 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:53.757 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 7/7 2023-10-11T20:48:53.757 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.n 1/7 2023-10-11T20:48:53.757 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 2/7 2023-10-11T20:48:53.758 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.no 3/7 2023-10-11T20:48:53.758 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-11T20:48:53.758 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-11T20:48:53.758 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-11T20:48:54.083 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-11T20:48:54.083 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:54.083 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:48:54.084 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:54.084 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:54.084 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:54.084 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-11T20:48:54.084 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-11T20:48:54.085 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-11T20:48:54.085 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-11T20:48:54.085 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:54.086 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:48:54.342 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-11T20:48:54.411 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.e 1/1 2023-10-11T20:48:54.412 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:54.412 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:54.412 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:48:54.412 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:54.412 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:54.614 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr 2023-10-11T20:48:54.944 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:01 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:48:55.090 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:48:55.091 INFO:teuthology.orchestra.run.smithi022.stdout:=========================================================================================== 2023-10-11T20:48:55.092 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:48:55.092 INFO:teuthology.orchestra.run.smithi022.stdout:=========================================================================================== 2023-10-11T20:48:55.092 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:48:55.092 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 7.4 M 2023-10-11T20:48:55.093 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:48:55.094 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-11T20:48:55.094 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-11T20:48:55.094 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-11T20:48:55.094 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-11T20:48:55.095 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-11T20:48:55.095 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-11T20:48:55.095 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-11T20:48:55.095 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-11T20:48:55.096 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-11T20:48:55.096 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-11T20:48:55.096 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-11T20:48:55.096 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:55.096 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:48:55.097 INFO:teuthology.orchestra.run.smithi022.stdout:=========================================================================================== 2023-10-11T20:48:55.097 INFO:teuthology.orchestra.run.smithi022.stdout:Install 12 Packages 2023-10-11T20:48:55.097 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:48:55.098 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 37 M 2023-10-11T20:48:55.098 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 209 M 2023-10-11T20:48:55.098 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:48:55.215 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:55.238 INFO:teuthology.orchestra.run.smithi022.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 221 kB/s | 32 kB 00:00 2023-10-11T20:48:55.271 INFO:teuthology.orchestra.run.smithi022.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 532 kB/s | 17 kB 00:00 2023-10-11T20:48:55.305 INFO:teuthology.orchestra.run.smithi022.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-11T20:48:55.306 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-mgr-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:48:55.354 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:55.355 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:48:55.355 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:55.391 INFO:teuthology.orchestra.run.smithi022.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2023-10-11T20:48:55.414 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-dashboard 2023-10-11T20:48:55.472 INFO:teuthology.orchestra.run.smithi022.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 205 kB 00:00 2023-10-11T20:48:55.531 INFO:teuthology.orchestra.run.smithi022.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-10-11T20:48:55.623 INFO:teuthology.orchestra.run.smithi022.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2023-10-11T20:48:55.648 INFO:teuthology.orchestra.run.smithi022.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.9 MB/s | 217 kB 00:00 2023-10-11T20:48:55.823 INFO:teuthology.orchestra.run.smithi022.stdout:(9/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2023-10-11T20:48:55.995 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:00:56 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:55.999 INFO:teuthology.orchestra.run.smithi022.stdout:(10/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2023-10-11T20:48:56.024 INFO:teuthology.orchestra.run.smithi022.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 986 kB/s | 195 kB 00:00 2023-10-11T20:48:56.134 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:56.136 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:56.136 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:56.136 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:56.136 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 1.8 M 2023-10-11T20:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 23 k 2023-10-11T20:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 15 k 2023-10-11T20:48:56.137 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-11T20:48:56.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-11T20:48:56.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-11T20:48:56.138 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2023-10-11T20:48:56.138 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-11T20:48:56.138 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:56.139 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:56.139 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:48:56.139 INFO:teuthology.orchestra.run.smithi183.stdout:Install 7 Packages 2023-10-11T20:48:56.139 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:56.139 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.1 M 2023-10-11T20:48:56.140 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 8.6 M 2023-10-11T20:48:56.140 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:56.616 INFO:teuthology.orchestra.run.smithi022.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.0-6 4.9 MB/s | 7.4 MB 00:01 2023-10-11T20:48:56.618 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:56.619 INFO:teuthology.orchestra.run.smithi022.stdout:Total 24 MB/s | 37 MB 00:01 2023-10-11T20:48:56.619 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:48:56.643 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:48:56.643 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:48:56.686 INFO:teuthology.orchestra.run.smithi183.stdout:(1/7): ceph-grafana-dashboards-18.2.0-669.ge62d 117 kB/s | 23 kB 00:00 2023-10-11T20:48:56.778 INFO:teuthology.orchestra.run.smithi183.stdout:(2/7): ceph-prometheus-alerts-18.2.0-669.ge62d7 50 kB/s | 15 kB 00:00 2023-10-11T20:48:56.803 INFO:teuthology.orchestra.run.smithi183.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 77 kB/s | 9.0 kB 00:00 2023-10-11T20:48:56.870 INFO:teuthology.orchestra.run.smithi183.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 444 kB/s | 41 kB 00:00 2023-10-11T20:48:56.929 INFO:teuthology.orchestra.run.smithi183.stdout:(5/7): ceph-mgr-dashboard-18.2.0-669.ge62d759a. 4.0 MB/s | 1.8 MB 00:00 2023-10-11T20:48:56.946 INFO:teuthology.orchestra.run.smithi183.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 216 kB/s | 31 kB 00:00 2023-10-11T20:48:57.005 INFO:teuthology.orchestra.run.smithi183.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2023-10-11T20:48:57.006 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:48:57.006 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.4 MB/s | 2.1 MB 00:00 2023-10-11T20:48:57.007 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:48:57.014 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:48:57.015 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:48:57.077 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:48:57.077 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:48:57.102 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:48:57.102 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:48:57.371 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:48:57.422 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2023-10-11T20:48:57.449 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2023-10-11T20:48:57.503 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2023-10-11T20:48:57.535 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2023-10-11T20:48:57.566 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.no 5/7 2023-10-11T20:48:57.801 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.n 6/7 2023-10-11T20:48:57.833 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 7/7 2023-10-11T20:48:57.975 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:48:58.059 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-11T20:48:58.087 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-11T20:48:58.184 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-11T20:48:58.215 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-11T20:48:58.363 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 7/7 2023-10-11T20:48:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.n 1/7 2023-10-11T20:48:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 2/7 2023-10-11T20:48:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.no 3/7 2023-10-11T20:48:58.364 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2023-10-11T20:48:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2023-10-11T20:48:58.365 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2023-10-11T20:48:58.404 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T20:48:58.431 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T20:48:58.520 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-11T20:48:58.679 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2023-10-11T20:48:58.680 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:58.680 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:48:58.681 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:58.681 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:58.681 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:48:58.681 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-11T20:48:58.682 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-11T20:48:58.682 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-11T20:48:58.682 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-11T20:48:58.682 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:58.682 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:48:58.926 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-diskprediction-local 2023-10-11T20:48:59.216 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-11T20:48:59.348 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T20:48:59.498 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:00 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:48:59.638 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:48:59.639 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-10-11T20:48:59.640 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:48:59.640 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-10-11T20:48:59.640 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:48:59.640 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 7.4 M 2023-10-11T20:48:59.640 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:48:59.641 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-11T20:48:59.641 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-11T20:48:59.641 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-11T20:48:59.641 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-11T20:48:59.641 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-11T20:48:59.642 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-11T20:48:59.642 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-11T20:48:59.642 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-11T20:48:59.642 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-11T20:48:59.642 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-11T20:48:59.643 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-11T20:48:59.643 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:59.643 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:48:59.643 INFO:teuthology.orchestra.run.smithi183.stdout:=========================================================================================== 2023-10-11T20:48:59.643 INFO:teuthology.orchestra.run.smithi183.stdout:Install 12 Packages 2023-10-11T20:48:59.644 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:48:59.644 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 37 M 2023-10-11T20:48:59.645 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 209 M 2023-10-11T20:48:59.645 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:48:59.778 INFO:teuthology.orchestra.run.smithi183.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 233 kB/s | 32 kB 00:00 2023-10-11T20:48:59.803 INFO:teuthology.orchestra.run.smithi183.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 715 kB/s | 17 kB 00:00 2023-10-11T20:48:59.836 INFO:teuthology.orchestra.run.smithi183.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-10-11T20:48:59.912 INFO:teuthology.orchestra.run.smithi183.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2023-10-11T20:49:00.012 INFO:teuthology.orchestra.run.smithi183.stdout:(5/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.0 MB/s | 205 kB 00:00 2023-10-11T20:49:00.079 INFO:teuthology.orchestra.run.smithi183.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-10-11T20:49:00.171 INFO:teuthology.orchestra.run.smithi183.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 31 MB/s | 4.8 MB 00:00 2023-10-11T20:49:00.196 INFO:teuthology.orchestra.run.smithi183.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.9 MB/s | 217 kB 00:00 2023-10-11T20:49:00.580 INFO:teuthology.orchestra.run.smithi183.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2023-10-11T20:49:00.614 INFO:teuthology.orchestra.run.smithi183.stdout:(10/12): libgfortran-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2023-10-11T20:49:00.638 INFO:teuthology.orchestra.run.smithi183.stdout:(11/12): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2023-10-11T20:49:00.648 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-11T20:49:01.514 INFO:teuthology.orchestra.run.smithi183.stdout:(12/12): ceph-mgr-diskprediction-local-18.2.0-6 3.9 MB/s | 7.4 MB 00:01 2023-10-11T20:49:01.517 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:01.517 INFO:teuthology.orchestra.run.smithi183.stdout:Total 20 MB/s | 37 MB 00:01 2023-10-11T20:49:01.518 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:01.543 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:01.544 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:01.733 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-11T20:49:01.763 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 12/12 2023-10-11T20:49:01.969 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:01.969 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:02.682 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:02.754 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 1/12 2023-10-11T20:49:02.793 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 2/12 2023-10-11T20:49:02.886 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2023-10-11T20:49:02.922 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2023-10-11T20:49:03.097 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T20:49:03.120 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T20:49:03.200 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2023-10-11T20:49:03.847 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2023-10-11T20:49:03.957 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T20:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 12/12 2023-10-11T20:49:04.225 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 1/12 2023-10-11T20:49:04.226 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-11T20:49:04.226 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-11T20:49:04.226 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-11T20:49:04.226 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-11T20:49:04.227 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-11T20:49:04.716 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-11T20:49:04.716 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:04.717 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:04.717 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:04.717 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-11T20:49:04.717 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-11T20:49:04.717 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-11T20:49:04.718 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-11T20:49:04.718 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-11T20:49:04.719 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-11T20:49:04.719 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-11T20:49:04.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-11T20:49:04.719 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-11T20:49:04.720 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-11T20:49:04.720 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-11T20:49:04.720 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:04.720 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:05.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-rook 2023-10-11T20:49:05.188 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2023-10-11T20:49:05.702 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:12 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:05.848 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:05.849 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:05.849 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:49:05.850 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:05.850 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:05.850 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 47 k 2023-10-11T20:49:05.850 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:49:05.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-11T20:49:05.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-11T20:49:05.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-11T20:49:05.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-11T20:49:05.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-11T20:49:05.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-11T20:49:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-11T20:49:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-11T20:49:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-11T20:49:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-11T20:49:05.852 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout:Install 13 Packages 2023-10-11T20:49:05.853 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:05.854 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 2.0 M 2023-10-11T20:49:05.854 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 26 M 2023-10-11T20:49:05.855 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:06.201 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2023-10-11T20:49:06.221 INFO:teuthology.orchestra.run.smithi022.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 185 kB/s | 24 kB 00:00 2023-10-11T20:49:06.228 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 12/12 2023-10-11T20:49:06.238 INFO:teuthology.orchestra.run.smithi022.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 122 kB/s | 18 kB 00:00 2023-10-11T20:49:06.280 INFO:teuthology.orchestra.run.smithi022.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 174 kB 00:00 2023-10-11T20:49:06.305 INFO:teuthology.orchestra.run.smithi022.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2023-10-11T20:49:06.330 INFO:teuthology.orchestra.run.smithi022.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-10-11T20:49:06.356 INFO:teuthology.orchestra.run.smithi022.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 855 kB/s | 43 kB 00:00 2023-10-11T20:49:06.381 INFO:teuthology.orchestra.run.smithi022.stdout:(7/13): ceph-mgr-rook-18.2.0-669.ge62d759a.el9. 163 kB/s | 47 kB 00:00 2023-10-11T20:49:06.573 INFO:teuthology.orchestra.run.smithi022.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 69 kB/s | 15 kB 00:00 2023-10-11T20:49:06.665 INFO:teuthology.orchestra.run.smithi022.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 96 kB/s | 32 kB 00:00 2023-10-11T20:49:06.790 INFO:teuthology.orchestra.run.smithi022.stdout:(10/13): python3-google-auth-2.23.2-1.el9.noarc 481 kB/s | 196 kB 00:00 2023-10-11T20:49:06.815 INFO:teuthology.orchestra.run.smithi022.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 394 kB/s | 59 kB 00:00 2023-10-11T20:49:06.882 INFO:teuthology.orchestra.run.smithi022.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 977 kB/s | 90 kB 00:00 2023-10-11T20:49:06.941 INFO:teuthology.orchestra.run.smithi022.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.8 MB/s | 1.0 MB 00:00 2023-10-11T20:49:06.945 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:06.947 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.9 MB/s | 2.0 MB 00:01 2023-10-11T20:49:06.947 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:06.960 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:06.960 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:07.068 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:07.070 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:07.599 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:07.780 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-11T20:49:07.835 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-11T20:49:07.892 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-11T20:49:07.926 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-11T20:49:07.968 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-11T20:49:08.065 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-11T20:49:08.177 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 7/13 2023-10-11T20:49:08.246 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-11T20:49:08.743 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 12/12 2023-10-11T20:49:08.744 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d75 1/12 2023-10-11T20:49:08.744 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2023-10-11T20:49:08.744 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2023-10-11T20:49:08.744 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2023-10-11T20:49:08.745 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2023-10-11T20:49:08.745 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2023-10-11T20:49:08.745 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 7/12 2023-10-11T20:49:08.745 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 8/12 2023-10-11T20:49:08.745 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 9/12 2023-10-11T20:49:08.746 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 10/12 2023-10-11T20:49:08.746 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 11/12 2023-10-11T20:49:09.006 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-11T20:49:09.058 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-11T20:49:09.092 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-11T20:49:09.138 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-11T20:49:09.161 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 13/13 2023-10-11T20:49:09.201 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 12/12 2023-10-11T20:49:09.201 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:09.201 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:09.202 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:09.202 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-11T20:49:09.202 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-11T20:49:09.202 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-11T20:49:09.202 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-11T20:49:09.203 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-11T20:49:09.203 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-11T20:49:09.203 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-11T20:49:09.203 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-11T20:49:09.204 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-11T20:49:09.204 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-11T20:49:09.204 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-11T20:49:09.204 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:09.204 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:09.570 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-rook 2023-10-11T20:49:09.916 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 13/13 2023-10-11T20:49:09.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 1/13 2023-10-11T20:49:09.916 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-11T20:49:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-11T20:49:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-11T20:49:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-11T20:49:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-11T20:49:09.917 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-11T20:49:09.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-11T20:49:09.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-11T20:49:09.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 10/13 2023-10-11T20:49:09.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-11T20:49:09.918 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-11T20:49:10.150 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:11 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:10.290 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-11T20:49:10.291 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:10.291 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:10.291 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:10.291 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-11T20:49:10.292 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-11T20:49:10.292 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-11T20:49:10.292 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-11T20:49:10.292 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-11T20:49:10.292 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-11T20:49:10.293 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-11T20:49:10.293 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-11T20:49:10.293 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-11T20:49:10.293 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-11T20:49:10.293 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-11T20:49:10.294 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-11T20:49:10.294 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:10.294 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:10.295 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:10.295 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:10.295 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 47 k 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-11T20:49:10.296 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-11T20:49:10.297 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-11T20:49:10.297 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-11T20:49:10.297 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-11T20:49:10.297 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-11T20:49:10.298 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-11T20:49:10.298 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-11T20:49:10.298 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-11T20:49:10.299 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-11T20:49:10.299 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-11T20:49:10.299 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-11T20:49:10.299 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:10.299 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:10.300 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:10.300 INFO:teuthology.orchestra.run.smithi183.stdout:Install 13 Packages 2023-10-11T20:49:10.300 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:10.300 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 2.0 M 2023-10-11T20:49:10.300 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 26 M 2023-10-11T20:49:10.301 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:10.469 INFO:teuthology.orchestra.run.smithi183.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 146 kB/s | 18 kB 00:00 2023-10-11T20:49:10.494 INFO:teuthology.orchestra.run.smithi183.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 164 kB/s | 24 kB 00:00 2023-10-11T20:49:10.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-cephadm 2023-10-11T20:49:10.545 INFO:teuthology.orchestra.run.smithi183.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2023-10-11T20:49:10.570 INFO:teuthology.orchestra.run.smithi183.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-10-11T20:49:10.595 INFO:teuthology.orchestra.run.smithi183.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2023-10-11T20:49:10.621 INFO:teuthology.orchestra.run.smithi183.stdout:(6/13): ceph-mgr-rook-18.2.0-669.ge62d759a.el9. 173 kB/s | 47 kB 00:00 2023-10-11T20:49:10.646 INFO:teuthology.orchestra.run.smithi183.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 570 kB/s | 43 kB 00:00 2023-10-11T20:49:10.904 INFO:teuthology.orchestra.run.smithi183.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 104 kB/s | 32 kB 00:00 2023-10-11T20:49:10.954 INFO:teuthology.orchestra.run.smithi183.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 49 kB/s | 15 kB 00:00 2023-10-11T20:49:11.096 INFO:teuthology.orchestra.run.smithi183.stdout:(10/13): python3-google-auth-2.23.2-1.el9.noarc 436 kB/s | 196 kB 00:00 2023-10-11T20:49:11.113 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:18 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:11.147 INFO:teuthology.orchestra.run.smithi183.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 308 kB/s | 59 kB 00:00 2023-10-11T20:49:11.214 INFO:teuthology.orchestra.run.smithi183.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 766 kB/s | 90 kB 00:00 2023-10-11T20:49:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:11.260 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:11.260 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:49:11.261 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:11.261 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:11.261 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 132 k 2023-10-11T20:49:11.261 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:49:11.261 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-11T20:49:11.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-11T20:49:11.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-11T20:49:11.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-11T20:49:11.262 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-11T20:49:11.262 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:11.263 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:11.263 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:49:11.263 INFO:teuthology.orchestra.run.smithi022.stdout:Install 6 Packages 2023-10-11T20:49:11.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:11.264 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 6.8 M 2023-10-11T20:49:11.264 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 33 M 2023-10-11T20:49:11.264 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:11.406 INFO:teuthology.orchestra.run.smithi183.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.0 MB/s | 1.0 MB 00:00 2023-10-11T20:49:11.408 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:11.408 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2023-10-11T20:49:11.409 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:11.423 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:11.424 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:11.501 INFO:teuthology.orchestra.run.smithi022.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.2 MB/s | 228 kB 00:00 2023-10-11T20:49:11.529 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:11.538 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:11.742 INFO:teuthology.orchestra.run.smithi022.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 5.8 MB 00:00 2023-10-11T20:49:11.776 INFO:teuthology.orchestra.run.smithi022.stdout:(3/6): ceph-mgr-cephadm-18.2.0-669.ge62d759a.el 285 kB/s | 132 kB 00:00 2023-10-11T20:49:12.060 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:12.233 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2023-10-11T20:49:12.285 INFO:teuthology.orchestra.run.smithi022.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 100 kB/s | 51 kB 00:00 2023-10-11T20:49:12.291 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2023-10-11T20:49:12.310 INFO:teuthology.orchestra.run.smithi022.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 102 kB/s | 58 kB 00:00 2023-10-11T20:49:12.347 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2023-10-11T20:49:12.377 INFO:teuthology.orchestra.run.smithi022.stdout:(6/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 626 kB/s | 548 kB 00:00 2023-10-11T20:49:12.381 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:12.381 INFO:teuthology.orchestra.run.smithi022.stdout:Total 6.0 MB/s | 6.8 MB 00:01 2023-10-11T20:49:12.381 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:12.383 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2023-10-11T20:49:12.391 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:12.392 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:12.425 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2023-10-11T20:49:12.488 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:12.489 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:12.519 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2023-10-11T20:49:12.633 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 7/13 2023-10-11T20:49:12.684 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2023-10-11T20:49:12.798 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:12.986 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-11T20:49:13.055 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-11T20:49:13.428 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2023-10-11T20:49:13.475 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2023-10-11T20:49:13.508 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2023-10-11T20:49:13.554 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2023-10-11T20:49:13.578 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 13/13 2023-10-11T20:49:13.603 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-11T20:49:13.684 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-11T20:49:13.752 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-11T20:49:13.783 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 6/6 2023-10-11T20:49:14.391 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 13/13 2023-10-11T20:49:14.392 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 1/13 2023-10-11T20:49:14.392 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2023-10-11T20:49:14.392 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2023-10-11T20:49:14.392 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2023-10-11T20:49:14.392 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2023-10-11T20:49:14.393 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2023-10-11T20:49:14.393 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2023-10-11T20:49:14.393 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2023-10-11T20:49:14.393 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2023-10-11T20:49:14.393 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 10/13 2023-10-11T20:49:14.394 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2023-10-11T20:49:14.394 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2023-10-11T20:49:14.572 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 6/6 2023-10-11T20:49:14.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/6 2023-10-11T20:49:14.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-11T20:49:14.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-11T20:49:14.573 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-11T20:49:14.574 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-11T20:49:14.773 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2023-10-11T20:49:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:14.774 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:14.774 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-11T20:49:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-11T20:49:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-11T20:49:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-11T20:49:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-11T20:49:14.775 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-11T20:49:14.776 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-11T20:49:14.777 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:14.777 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-11T20:49:15.020 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:15.021 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-11T20:49:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-11T20:49:15.021 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-11T20:49:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-11T20:49:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-11T20:49:15.022 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:15.022 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:15.023 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-cephadm 2023-10-11T20:49:15.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse 2023-10-11T20:49:15.603 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:16 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:15.743 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:15.743 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:15.743 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:49:15.744 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:15.744 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:15.744 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 132 k 2023-10-11T20:49:15.744 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:49:15.744 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-11T20:49:15.745 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-11T20:49:15.745 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-11T20:49:15.745 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-11T20:49:15.745 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-11T20:49:15.745 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:15.746 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:15.746 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:49:15.746 INFO:teuthology.orchestra.run.smithi183.stdout:Install 6 Packages 2023-10-11T20:49:15.746 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:15.747 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 6.8 M 2023-10-11T20:49:15.747 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 33 M 2023-10-11T20:49:15.747 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:15.991 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:22 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:16.135 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:16.136 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:16.136 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:49:16.136 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:16.136 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 836 k 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:16.137 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:16.138 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2023-10-11T20:49:16.138 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:16.138 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 914 k 2023-10-11T20:49:16.138 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.7 M 2023-10-11T20:49:16.138 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:16.142 INFO:teuthology.orchestra.run.smithi183.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.4 MB/s | 228 kB 00:00 2023-10-11T20:49:16.270 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 591 kB/s | 79 kB 00:00 2023-10-11T20:49:16.301 INFO:teuthology.orchestra.run.smithi183.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-10-11T20:49:16.401 INFO:teuthology.orchestra.run.smithi183.stdout:(3/6): ceph-mgr-cephadm-18.2.0-669.ge62d759a.el 313 kB/s | 132 kB 00:00 2023-10-11T20:49:16.445 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): ceph-fuse-18.2.0-669.ge62d759a.el9.x86_6 2.6 MB/s | 836 kB 00:00 2023-10-11T20:49:16.446 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.9 MB/s | 914 kB 00:00 2023-10-11T20:49:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:16.460 INFO:teuthology.orchestra.run.smithi183.stdout:(4/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.7 MB/s | 548 kB 00:00 2023-10-11T20:49:16.468 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:16.469 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:16.485 INFO:teuthology.orchestra.run.smithi183.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 314 kB/s | 58 kB 00:00 2023-10-11T20:49:16.548 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:16.548 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:16.594 INFO:teuthology.orchestra.run.smithi183.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 265 kB/s | 51 kB 00:00 2023-10-11T20:49:16.595 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:16.596 INFO:teuthology.orchestra.run.smithi183.stdout:Total 8.0 MB/s | 6.8 MB 00:00 2023-10-11T20:49:16.596 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:16.605 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:16.605 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:16.694 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:16.725 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:16.738 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:16.872 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-11T20:49:16.941 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:49:16.997 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:17.165 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2023-10-11T20:49:17.220 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2023-10-11T20:49:17.588 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:49:17.588 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/2 2023-10-11T20:49:17.734 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2023-10-11T20:49:17.813 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2023-10-11T20:49:17.883 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2023-10-11T20:49:17.908 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 6/6 2023-10-11T20:49:17.928 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-11T20:49:17.928 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:17.929 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:17.929 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-11T20:49:17.929 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:17.929 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:18.190 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-volume 2023-10-11T20:49:18.761 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 6/6 2023-10-11T20:49:18.761 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 1/6 2023-10-11T20:49:18.762 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2023-10-11T20:49:18.762 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2023-10-11T20:49:18.762 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2023-10-11T20:49:18.762 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2023-10-11T20:49:18.799 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:25 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:18.943 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:18.944 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:18.945 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2023-10-11T20:49:18.945 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:18.945 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:18.946 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 262 k 2023-10-11T20:49:18.946 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:18.946 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:18.947 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:18.947 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:18.947 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:18.947 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 262 k 2023-10-11T20:49:18.947 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.2 M 2023-10-11T20:49:18.948 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:19.081 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2023-10-11T20:49:19.081 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:19.082 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:19.082 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:19.082 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-11T20:49:19.083 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-11T20:49:19.083 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-11T20:49:19.083 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-11T20:49:19.084 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-11T20:49:19.084 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:19.084 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:19.175 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-volume-18.2.0-669.ge62d759a.el9.noarch.rpm 1.1 MB/s | 262 kB 00:00 2023-10-11T20:49:19.176 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:19.176 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.1 MB/s | 262 kB 00:00 2023-10-11T20:49:19.177 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:19.184 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:19.185 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:19.220 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:19.220 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:19.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-fuse 2023-10-11T20:49:19.452 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:19.527 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:19.543 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:19.544 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:49:19.544 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-11T20:49:19.544 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:19.899 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:20 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:20.038 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:20.039 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:20.039 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:49:20.039 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:20.039 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:20.040 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 836 k 2023-10-11T20:49:20.040 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:49:20.040 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-11T20:49:20.040 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:20.040 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:20.041 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:20.041 INFO:teuthology.orchestra.run.smithi183.stdout:Install 2 Packages 2023-10-11T20:49:20.041 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:20.041 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 914 k 2023-10-11T20:49:20.041 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.7 M 2023-10-11T20:49:20.042 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:20.170 INFO:teuthology.orchestra.run.smithi183.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 604 kB/s | 79 kB 00:00 2023-10-11T20:49:20.495 INFO:teuthology.orchestra.run.smithi183.stdout:(2/2): ceph-fuse-18.2.0-669.ge62d759a.el9.x86_6 1.8 MB/s | 836 kB 00:00 2023-10-11T20:49:20.496 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:20.497 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.0 MB/s | 914 kB 00:00 2023-10-11T20:49:20.497 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:20.516 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:20.517 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:20.517 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:20.518 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:20.518 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:20.518 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:20.518 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:20.518 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:20.590 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:20.591 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:20.769 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:20.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados-devel 2023-10-11T20:49:20.909 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2023-10-11T20:49:20.978 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:49:21.464 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:21.609 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:21.610 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:49:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:21.610 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:18.2.0-669.ge62d759a.el9 ceph 126 k 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:21.611 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:21.612 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 126 k 2023-10-11T20:49:21.612 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 456 k 2023-10-11T20:49:21.612 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:21.688 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:49:21.688 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/2 2023-10-11T20:49:21.807 INFO:teuthology.orchestra.run.smithi022.stdout:librados-devel-18.2.0-669.ge62d759a.el9.x86_64. 644 kB/s | 126 kB 00:00 2023-10-11T20:49:21.808 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:21.808 INFO:teuthology.orchestra.run.smithi022.stdout:Total 639 kB/s | 126 kB 00:00 2023-10-11T20:49:21.808 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:21.815 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:21.815 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:21.878 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:21.878 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:21.988 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2023-10-11T20:49:21.988 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:21.989 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:21.989 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2023-10-11T20:49:21.989 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:21.990 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:22.025 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:22.142 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:22.243 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-volume 2023-10-11T20:49:22.566 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:22.833 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:23 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:22.893 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:22.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:22.894 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:22.894 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:22.894 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:22.894 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:22.974 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:22.975 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:22.975 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2023-10-11T20:49:22.975 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:22.975 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:22.976 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:18.2.0-669.ge62d759a.el9 ceph-noarch 262 k 2023-10-11T20:49:22.976 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:22.976 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:22.976 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:22.977 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:22.977 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:22.977 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 262 k 2023-10-11T20:49:22.977 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.2 M 2023-10-11T20:49:22.977 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:23.093 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2 2023-10-11T20:49:23.333 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-volume-18.2.0-669.ge62d759a.el9.noarch.rpm 734 kB/s | 262 kB 00:00 2023-10-11T20:49:23.334 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:23.334 INFO:teuthology.orchestra.run.smithi183.stdout:Total 731 kB/s | 262 kB 00:00 2023-10-11T20:49:23.334 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:23.342 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:23.342 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:23.377 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:23.378 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:23.594 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:23.668 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:23.684 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:23.684 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:49:23.685 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-11T20:49:23.685 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:23.703 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:30 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:23.796 INFO:teuthology.orchestra.run.smithi022.stdout:Package libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:23.848 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:23.849 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:23.849 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:23.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs-devel 2023-10-11T20:49:24.520 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:24.664 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:24.664 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:24.665 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:49:24.665 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:24.665 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:24.665 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:18.2.0-669.ge62d759a.el9 ceph 31 k 2023-10-11T20:49:24.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:24.666 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:24.666 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:24.666 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:24.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:24.667 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 31 k 2023-10-11T20:49:24.667 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 137 k 2023-10-11T20:49:24.667 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:24.737 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 1/1 2023-10-11T20:49:24.737 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:24.738 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:24.738 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:18.2.0-669.ge62d759a.el9.noarch 2023-10-11T20:49:24.738 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:24.738 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:24.835 INFO:teuthology.orchestra.run.smithi022.stdout:libcephfs-devel-18.2.0-669.ge62d759a.el9.x86_64 180 kB/s | 31 kB 00:00 2023-10-11T20:49:24.836 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:24.836 INFO:teuthology.orchestra.run.smithi022.stdout:Total 179 kB/s | 31 kB 00:00 2023-10-11T20:49:24.837 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:24.839 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:24.840 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:24.866 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:24.866 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:24.952 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:25.061 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:25.067 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados-devel 2023-10-11T20:49:25.417 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:25.660 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:26 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:25.719 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:25.719 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:25.719 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:25.720 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:25.720 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:25.720 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:25.798 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:25.799 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:25.799 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:49:25.799 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:25.799 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:25.800 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:18.2.0-669.ge62d759a.el9 ceph 126 k 2023-10-11T20:49:25.800 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:25.800 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:25.800 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:25.800 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:25.801 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:25.801 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 126 k 2023-10-11T20:49:25.801 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 456 k 2023-10-11T20:49:25.801 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:25.904 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2 2023-10-11T20:49:25.996 INFO:teuthology.orchestra.run.smithi183.stdout:librados-devel-18.2.0-669.ge62d759a.el9.x86_64. 644 kB/s | 126 kB 00:00 2023-10-11T20:49:25.997 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:25.997 INFO:teuthology.orchestra.run.smithi183.stdout:Total 640 kB/s | 126 kB 00:00 2023-10-11T20:49:25.997 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:26.002 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:26.002 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:26.061 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:26.062 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:26.209 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:26.302 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:26.502 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:26.594 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:26.647 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:26.648 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:26.648 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:26.716 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1 2023-10-11T20:49:26.771 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:27.090 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:27.090 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:27.090 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:27.090 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:27.091 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:27.091 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:27.306 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs2 2023-10-11T20:49:27.317 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:27.409 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:27.461 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:27.462 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:27.462 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:27.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rados 2023-10-11T20:49:27.895 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:28 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:27.986 INFO:teuthology.orchestra.run.smithi183.stdout:Package libcephfs2-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:28.034 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:28.035 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:28.036 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:28.098 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs-devel 2023-10-11T20:49:28.131 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:28.224 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:28.276 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:28.277 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:28.278 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:28.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rgw 2023-10-11T20:49:28.678 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:29 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:28.817 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:28.817 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:28.818 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:49:28.818 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:28.818 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:28.818 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:18.2.0-669.ge62d759a.el9 ceph 31 k 2023-10-11T20:49:28.818 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:28.819 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:28.819 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 31 k 2023-10-11T20:49:28.820 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 137 k 2023-10-11T20:49:28.820 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:28.953 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:29.046 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:29.058 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs-devel-18.2.0-669.ge62d759a.el9.x86_64 127 kB/s | 31 kB 00:00 2023-10-11T20:49:29.059 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:29.059 INFO:teuthology.orchestra.run.smithi183.stdout:Total 127 kB/s | 31 kB 00:00 2023-10-11T20:49:29.059 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:29.062 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:29.063 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:29.091 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:29.091 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:29.098 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:29.099 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:29.099 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:29.165 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-cephfs 2023-10-11T20:49:29.191 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:29.299 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:29.694 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:29.772 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:36 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:29.864 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:29.917 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:29.919 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:29.919 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:29.961 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:29.962 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:29.962 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:29.962 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:29.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rbd 2023-10-11T20:49:30.168 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2 2023-10-11T20:49:30.592 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:37 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:30.685 INFO:teuthology.orchestra.run.smithi022.stdout:Package python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:30.737 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:30.738 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:49:30.738 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:30.749 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:31 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:30.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse 2023-10-11T20:49:30.839 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:30.888 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:30.889 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:30.889 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:30.949 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librbd1 2023-10-11T20:49:31.406 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:31.519 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:32 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:31.550 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:31.551 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:31.551 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2023-10-11T20:49:31.551 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:31.552 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:31.552 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 86 k 2023-10-11T20:49:31.552 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:31.552 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:31.552 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:31.553 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:31.553 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:31.553 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 86 k 2023-10-11T20:49:31.553 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 226 k 2023-10-11T20:49:31.553 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:31.608 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:31.658 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:31.659 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:31.659 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:31.718 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rados 2023-10-11T20:49:31.763 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-fuse-18.2.0-669.ge62d759a.el9.x86_64.rpm 407 kB/s | 86 kB 00:00 2023-10-11T20:49:31.764 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:31.764 INFO:teuthology.orchestra.run.smithi022.stdout:Total 404 kB/s | 86 kB 00:00 2023-10-11T20:49:31.765 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:31.772 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:31.772 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:31.830 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:31.831 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:31.975 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:32.073 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:32.292 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:33 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:32.382 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rados-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:32.431 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:32.432 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:32.432 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:32.463 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:32.490 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rgw 2023-10-11T20:49:32.792 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:32.792 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:32.793 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:32.793 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:32.793 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:32.794 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:33.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-mirror 2023-10-11T20:49:33.066 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:33.157 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rgw-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:33.206 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:33.207 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:33.207 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:33.264 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-cephfs 2023-10-11T20:49:33.668 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:40 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:33.812 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:33.813 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:33.814 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:49:33.814 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:33.814 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:33.814 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.0 M 2023-10-11T20:49:33.814 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:33.815 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:33.815 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:33.815 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:33.815 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:33.815 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 3.0 M 2023-10-11T20:49:33.816 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 12 M 2023-10-11T20:49:33.816 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:33.841 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:34 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:33.929 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-cephfs-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:33.980 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:33.981 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:33.981 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:34.040 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rbd 2023-10-11T20:49:34.617 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:35 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:34.707 INFO:teuthology.orchestra.run.smithi183.stdout:Package python3-rbd-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:49:34.708 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-mirror-18.2.0-669.ge62d759a.el9.x86_64.rpm 3.3 MB/s | 3.0 MB 00:00 2023-10-11T20:49:34.709 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:34.709 INFO:teuthology.orchestra.run.smithi022.stdout:Total 3.3 MB/s | 3.0 MB 00:00 2023-10-11T20:49:34.710 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:34.720 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:34.720 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:34.757 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:34.758 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:49:34.758 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:34.798 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:34.799 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:34.832 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-fuse 2023-10-11T20:49:35.227 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:35.275 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:35.300 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:35.301 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:49:35.301 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-11T20:49:35.301 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T20:49:35.301 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T20:49:35.301 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:35.408 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:36 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:35.546 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:35.547 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:35.547 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2023-10-11T20:49:35.548 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:35.548 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:35.548 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:18.2.0-669.ge62d759a.el9 ceph 86 k 2023-10-11T20:49:35.548 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:35.548 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:35.549 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:35.549 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:35.549 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:35.549 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 86 k 2023-10-11T20:49:35.549 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 226 k 2023-10-11T20:49:35.550 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:35.853 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse-18.2.0-669.ge62d759a.el9.x86_64.rpm 283 kB/s | 86 kB 00:00 2023-10-11T20:49:35.854 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:35.854 INFO:teuthology.orchestra.run.smithi183.stdout:Total 281 kB/s | 86 kB 00:00 2023-10-11T20:49:35.854 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:35.860 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:35.861 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:35.915 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:35.915 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:36.048 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:36.159 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:36.408 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:36.408 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:36.408 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:36.408 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:36.409 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:36.409 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:36.542 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:36.667 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-nbd 2023-10-11T20:49:36.869 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:36.870 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:36.870 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:36.870 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:36.870 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:36.871 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:37.111 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-mirror 2023-10-11T20:49:37.270 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:37.416 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2023-10-11T20:49:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:37.416 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 169 k 2023-10-11T20:49:37.417 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:49:37.417 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:37.418 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 169 k 2023-10-11T20:49:37.418 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 485 k 2023-10-11T20:49:37.418 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:37.699 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:38 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:37.728 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-nbd-18.2.0-669.ge62d759a.el9.x86_64.rpm 543 kB/s | 169 kB 00:00 2023-10-11T20:49:37.729 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:37.729 INFO:teuthology.orchestra.run.smithi022.stdout:Total 540 kB/s | 169 kB 00:00 2023-10-11T20:49:37.729 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:37.737 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:37.738 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:37.796 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:37.797 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:37.840 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:37.841 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:37.841 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:49:37.842 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:37.842 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:37.842 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:18.2.0-669.ge62d759a.el9 ceph 3.0 M 2023-10-11T20:49:37.842 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:37.842 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:37.843 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:37.843 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:37.843 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:37.843 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 3.0 M 2023-10-11T20:49:37.843 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 12 M 2023-10-11T20:49:37.844 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:37.956 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:38.071 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:38.240 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-mirror-18.2.0-669.ge62d759a.el9.x86_64.rpm 7.5 MB/s | 3.0 MB 00:00 2023-10-11T20:49:38.240 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:38.240 INFO:teuthology.orchestra.run.smithi183.stdout:Total 7.5 MB/s | 3.0 MB 00:00 2023-10-11T20:49:38.241 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:38.250 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:38.250 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:38.321 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:38.322 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:38.482 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:38.729 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:38.781 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:38.781 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:38.782 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:38.782 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:38.782 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:49:38.798 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:38.822 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:38.823 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-11T20:49:38.823 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-11T20:49:38.823 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T20:49:38.823 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-11T20:49:38.823 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:39.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base-debuginfo 2023-10-11T20:49:39.631 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:01:46 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:49:39.780 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:49:39.781 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:39.781 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:49:39.781 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:39.782 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:49:39.782 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 74 M 2023-10-11T20:49:39.782 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2023-10-11T20:49:39.782 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 20 M 2023-10-11T20:49:39.782 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:39.783 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:49:39.783 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:49:39.783 INFO:teuthology.orchestra.run.smithi022.stdout:Install 2 Packages 2023-10-11T20:49:39.783 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:39.783 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 94 M 2023-10-11T20:49:39.784 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 512 M 2023-10-11T20:49:39.784 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:49:39.943 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:39.944 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:39.944 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:39.944 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:39.944 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:39.945 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:40.184 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-nbd 2023-10-11T20:49:40.774 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:41 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:40.915 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:40.916 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:40.917 INFO:teuthology.orchestra.run.smithi183.stdout: Package Architecture Version Repository Size 2023-10-11T20:49:40.917 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:40.917 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:40.917 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:18.2.0-669.ge62d759a.el9 ceph 169 k 2023-10-11T20:49:40.917 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:40.918 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:40.918 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:40.918 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:49:40.918 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:40.918 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 169 k 2023-10-11T20:49:40.919 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 485 k 2023-10-11T20:49:40.919 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:41.226 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-nbd-18.2.0-669.ge62d759a.el9.x86_64.rpm 548 kB/s | 169 kB 00:00 2023-10-11T20:49:41.227 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:41.227 INFO:teuthology.orchestra.run.smithi183.stdout:Total 545 kB/s | 169 kB 00:00 2023-10-11T20:49:41.227 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:41.234 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:41.235 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:41.290 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:41.290 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:41.307 INFO:teuthology.orchestra.run.smithi022.stdout:(1/2): ceph-debuginfo-18.2.0-669.ge62d759a.el9. 13 MB/s | 20 MB 00:01 2023-10-11T20:49:41.433 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:41.540 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:41.951 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:42.268 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:49:42.269 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:42.269 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:49:42.269 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:42.269 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:42.269 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:49:42.484 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base-debuginfo 2023-10-11T20:49:43.073 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:01:44 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:49:43.211 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:49:43.211 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:43.212 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:49:43.212 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:43.212 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:49:43.212 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 74 M 2023-10-11T20:49:43.213 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2023-10-11T20:49:43.213 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 20 M 2023-10-11T20:49:43.213 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:43.213 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:49:43.213 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:49:43.214 INFO:teuthology.orchestra.run.smithi183.stdout:Install 2 Packages 2023-10-11T20:49:43.214 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:49:43.214 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 94 M 2023-10-11T20:49:43.214 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 512 M 2023-10-11T20:49:43.214 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:49:44.240 INFO:teuthology.orchestra.run.smithi022.stdout:(2/2): ceph-base-debuginfo-18.2.0-669.ge62d759a 17 MB/s | 74 MB 00:04 2023-10-11T20:49:44.242 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:44.242 INFO:teuthology.orchestra.run.smithi022.stdout:Total 21 MB/s | 94 MB 00:04 2023-10-11T20:49:44.243 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:49:44.247 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:49:44.248 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:49:44.885 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:49:44.886 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:49:45.812 INFO:teuthology.orchestra.run.smithi183.stdout:(1/2): ceph-debuginfo-18.2.0-669.ge62d759a.el9. 7.9 MB/s | 20 MB 00:02 2023-10-11T20:49:47.964 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:49:48.504 INFO:teuthology.orchestra.run.smithi183.stdout:(2/2): ceph-base-debuginfo-18.2.0-669.ge62d759a 14 MB/s | 74 MB 00:05 2023-10-11T20:49:48.506 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:49:48.507 INFO:teuthology.orchestra.run.smithi183.stdout:Total 18 MB/s | 94 MB 00:05 2023-10-11T20:49:48.507 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:49:48.512 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:49:48.512 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:49:49.130 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:49:49.130 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:49:52.040 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:49:56.108 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/2 2023-10-11T20:49:56.193 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 2/2 2023-10-11T20:49:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 2/2 2023-10-11T20:49:59.615 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/2 2023-10-11T20:49:59.697 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/2 2023-10-11T20:49:59.779 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 2/2 2023-10-11T20:49:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:49:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:59.913 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:49:59.913 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:49:59.914 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:49:59.914 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:50:00.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-common-debuginfo 2023-10-11T20:50:00.739 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:02:07 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:50:00.884 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:50:00.885 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:50:00.885 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:50:00.886 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:50:00.886 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:50:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 404 M 2023-10-11T20:50:00.886 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:50:00.887 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:50:00.887 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:50:00.887 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:50:00.887 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:50:00.887 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 404 M 2023-10-11T20:50:00.888 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.7 G 2023-10-11T20:50:00.888 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:50:03.200 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 2/2 2023-10-11T20:50:03.201 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/2 2023-10-11T20:50:03.497 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2/2 2023-10-11T20:50:03.497 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:50:03.498 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:50:03.498 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:50:03.498 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:50:03.498 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:50:03.498 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:50:03.708 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-common-debuginfo 2023-10-11T20:50:04.291 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:02:05 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:50:04.429 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:50:04.430 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:50:04.430 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:50:04.431 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:50:04.431 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:50:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 404 M 2023-10-11T20:50:04.431 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:50:04.431 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:50:04.432 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:50:04.432 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:50:04.432 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:50:04.432 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 404 M 2023-10-11T20:50:04.432 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.7 G 2023-10-11T20:50:04.433 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:50:21.626 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-common-debuginfo-18.2.0-669.ge62d759a.el9. 19 MB/s | 404 MB 00:20 2023-10-11T20:50:21.627 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:50:21.627 INFO:teuthology.orchestra.run.smithi022.stdout:Total 19 MB/s | 404 MB 00:20 2023-10-11T20:50:21.628 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:50:21.632 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:50:21.632 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:50:24.163 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:50:24.164 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:50:35.004 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-common-debuginfo-18.2.0-669.ge62d759a.el9. 13 MB/s | 404 MB 00:30 2023-10-11T20:50:35.005 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:50:35.006 INFO:teuthology.orchestra.run.smithi183.stdout:Total 13 MB/s | 404 MB 00:30 2023-10-11T20:50:35.006 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:50:35.010 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:50:35.011 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:50:37.420 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:50:37.421 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:51:08.397 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:51:08.490 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:12.026 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:12.309 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:12.309 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:12.310 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:51:12.310 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:12.310 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:12.310 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:51:12.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-10-11T20:51:13.153 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:03:20 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:51:13.302 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:51:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:51:13.303 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:51:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:51:13.303 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:51:13.304 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.4 M 2023-10-11T20:51:13.304 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:51:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2023-10-11T20:51:13.304 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:51:13.305 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:13.305 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.4 M 2023-10-11T20:51:13.305 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 6.2 M 2023-10-11T20:51:13.305 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:51:13.758 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-immutable-object-cache-debuginfo-18.2.0-66 3.1 MB/s | 1.4 MB 00:00 2023-10-11T20:51:13.759 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:51:13.759 INFO:teuthology.orchestra.run.smithi022.stdout:Total 3.1 MB/s | 1.4 MB 00:00 2023-10-11T20:51:13.759 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:51:13.763 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:51:13.763 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:51:13.806 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:51:13.806 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:51:14.072 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:51:14.174 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:14.585 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:14.859 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:14.860 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:14.860 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:51:14.860 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:14.860 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:14.861 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:51:15.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw-debuginfo 2023-10-11T20:51:15.624 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:03:22 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:51:15.771 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:51:15.772 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:15.773 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:51:15.773 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:15.773 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:51:15.774 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 162 M 2023-10-11T20:51:15.774 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:15.774 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:51:15.775 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:15.775 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:51:15.776 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:15.776 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 162 M 2023-10-11T20:51:15.776 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 678 M 2023-10-11T20:51:15.777 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:51:18.788 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:51:18.898 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:23.302 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-radosgw-debuginfo-18.2.0-669.ge62d759a.el9 22 MB/s | 162 MB 00:07 2023-10-11T20:51:23.303 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:51:23.304 INFO:teuthology.orchestra.run.smithi022.stdout:Total 22 MB/s | 162 MB 00:07 2023-10-11T20:51:23.304 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:51:23.308 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:51:23.308 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:51:24.357 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:51:24.357 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:51:26.744 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:27.034 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:51:27.034 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:27.035 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:51:27.035 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:27.035 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:27.035 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:51:27.255 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-immutable-object-cache-debuginfo 2023-10-11T20:51:27.853 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:03:28 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:51:28.004 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:51:28.005 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:51:28.006 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:51:28.006 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:51:28.006 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:51:28.006 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.4 M 2023-10-11T20:51:28.007 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:28.007 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:51:28.007 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2023-10-11T20:51:28.007 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:51:28.007 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:28.008 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 1.4 M 2023-10-11T20:51:28.008 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 6.2 M 2023-10-11T20:51:28.008 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:51:28.301 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-immutable-object-cache-debuginfo-18.2.0-66 4.8 MB/s | 1.4 MB 00:00 2023-10-11T20:51:28.302 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:51:28.302 INFO:teuthology.orchestra.run.smithi183.stdout:Total 4.8 MB/s | 1.4 MB 00:00 2023-10-11T20:51:28.303 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:51:28.306 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:51:28.306 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:51:28.347 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:51:28.348 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:51:28.607 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:51:28.710 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:29.137 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:29.397 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-debuginfo-2:18.2.0-669.g 1/1 2023-10-11T20:51:29.397 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:29.397 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:51:29.398 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:29.398 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:29.398 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:51:29.538 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw-debuginfo 2023-10-11T20:51:30.117 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:03:31 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:51:30.255 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:51:30.256 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:51:30.257 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:51:30.257 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:51:30.257 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:51:30.257 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 162 M 2023-10-11T20:51:30.257 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:30.258 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:51:30.258 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:51:30.258 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:51:30.258 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:30.259 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 162 M 2023-10-11T20:51:30.259 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 678 M 2023-10-11T20:51:30.259 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:51:37.354 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-radosgw-debuginfo-18.2.0-669.ge62d759a.el9 23 MB/s | 162 MB 00:07 2023-10-11T20:51:37.355 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:51:37.355 INFO:teuthology.orchestra.run.smithi183.stdout:Total 23 MB/s | 162 MB 00:07 2023-10-11T20:51:37.356 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:51:37.359 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:51:37.360 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:51:38.348 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:51:38.349 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:51:41.914 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:51:42.018 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:46.546 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:51:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:46.547 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:51:46.727 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-test-debuginfo 2023-10-11T20:51:47.334 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:03:54 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:51:47.480 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:51:47.481 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:47.481 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:51:47.481 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:47.482 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:51:47.482 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 601 M 2023-10-11T20:51:47.482 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:47.483 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:51:47.483 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:51:47.483 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:51:47.483 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:51:47.483 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 601 M 2023-10-11T20:51:47.484 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.7 G 2023-10-11T20:51:47.484 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:51:54.900 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:51:55.008 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:59.170 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:59.451 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x8 1/1 2023-10-11T20:51:59.451 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:59.451 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:51:59.451 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:51:59.452 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:51:59.452 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:51:59.632 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-test-debuginfo 2023-10-11T20:52:00.213 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:04:01 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:52:00.351 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:52:00.353 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:52:00.353 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:52:00.353 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:52:00.353 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:52:00.354 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 601 M 2023-10-11T20:52:00.354 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:52:00.354 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:52:00.354 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:52:00.355 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:52:00.355 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:52:00.355 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 601 M 2023-10-11T20:52:00.355 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.7 G 2023-10-11T20:52:00.355 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:52:20.607 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-test-debuginfo-18.2.0-669.ge62d759a.el9.x8 18 MB/s | 601 MB 00:33 2023-10-11T20:52:20.608 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:52:20.608 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 601 MB 00:33 2023-10-11T20:52:20.609 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:52:20.614 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:52:20.614 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:52:24.358 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:52:24.358 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:52:35.499 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-test-debuginfo-18.2.0-669.ge62d759a.el9.x8 17 MB/s | 601 MB 00:35 2023-10-11T20:52:35.500 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:52:35.501 INFO:teuthology.orchestra.run.smithi183.stdout:Total 17 MB/s | 601 MB 00:35 2023-10-11T20:52:35.501 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:52:35.506 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:52:35.506 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:52:39.064 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:52:39.065 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:53:31.010 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:53:31.116 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:39.875 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:40.160 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:40.160 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:40.161 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:53:40.161 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:53:40.161 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:40.161 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:53:40.423 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-base-debuginfo 2023-10-11T20:53:41.030 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:05:48 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:53:41.122 INFO:teuthology.orchestra.run.smithi022.stdout:Package ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:53:41.174 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:53:41.176 INFO:teuthology.orchestra.run.smithi022.stdout:Nothing to do. 2023-10-11T20:53:41.176 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:53:41.251 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mgr-debuginfo 2023-10-11T20:53:41.772 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:53:41.853 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:05:48 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:53:41.872 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:41.998 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:53:41.999 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:41.999 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:53:42.000 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:42.000 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:53:42.000 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 19 M 2023-10-11T20:53:42.000 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:42.001 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:53:42.001 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:42.001 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:53:42.001 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:42.001 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 19 M 2023-10-11T20:53:42.002 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 101 M 2023-10-11T20:53:42.002 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:53:43.092 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-mgr-debuginfo-18.2.0-669.ge62d759a.el9.x86 18 MB/s | 19 MB 00:01 2023-10-11T20:53:43.093 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:53:43.093 INFO:teuthology.orchestra.run.smithi022.stdout:Total 17 MB/s | 19 MB 00:01 2023-10-11T20:53:43.094 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:53:43.098 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:53:43.098 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:53:43.253 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:53:43.254 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:53:45.557 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:53:45.652 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:46.901 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:53:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:53:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:46.902 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:53:47.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mds-debuginfo 2023-10-11T20:53:47.667 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:05:54 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:53:47.812 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:53:47.813 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:47.814 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:53:47.814 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:47.814 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:53:47.814 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 48 M 2023-10-11T20:53:47.814 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:47.815 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:53:47.815 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:47.815 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:53:47.815 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:47.815 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 48 M 2023-10-11T20:53:47.816 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 203 M 2023-10-11T20:53:47.816 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:53:50.259 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:50.549 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:53:50.549 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:50.550 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:53:50.550 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:53:50.550 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:50.550 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:53:50.653 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-mds-debuginfo-18.2.0-669.ge62d759a.el9.x86 17 MB/s | 48 MB 00:02 2023-10-11T20:53:50.654 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:53:50.654 INFO:teuthology.orchestra.run.smithi022.stdout:Total 17 MB/s | 48 MB 00:02 2023-10-11T20:53:50.655 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:53:50.658 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:53:50.659 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:53:50.794 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-base-debuginfo 2023-10-11T20:53:50.994 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:53:50.996 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:53:51.373 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:05:52 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:53:51.463 INFO:teuthology.orchestra.run.smithi183.stdout:Package ceph-base-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 is already installed. 2023-10-11T20:53:51.513 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:53:51.513 INFO:teuthology.orchestra.run.smithi183.stdout:Nothing to do. 2023-10-11T20:53:51.514 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:53:51.588 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mgr-debuginfo 2023-10-11T20:53:52.168 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:05:53 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:53:52.307 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:53:52.308 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:53:52.308 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:52.308 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:53:52.308 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 19 M 2023-10-11T20:53:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:52.309 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:53:52.309 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:52.309 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:53:52.309 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:52.310 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 19 M 2023-10-11T20:53:52.310 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 101 M 2023-10-11T20:53:52.310 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:53:53.526 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-mgr-debuginfo-18.2.0-669.ge62d759a.el9.x86 16 MB/s | 19 MB 00:01 2023-10-11T20:53:53.526 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:53:53.527 INFO:teuthology.orchestra.run.smithi183.stdout:Total 16 MB/s | 19 MB 00:01 2023-10-11T20:53:53.527 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:53:53.530 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:53:53.531 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:53:53.675 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:53:53.676 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:53:55.861 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:53:55.965 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:56.289 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:53:56.395 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:56.884 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:57.164 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:57.165 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:57.165 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:53:57.165 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:53:57.165 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:57.166 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:53:57.317 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mds-debuginfo 2023-10-11T20:53:57.897 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:05:58 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:53:58.036 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:53:58.037 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:58.037 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:53:58.037 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:58.038 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:53:58.038 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 48 M 2023-10-11T20:53:58.038 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:58.038 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:53:58.038 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:53:58.039 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:53:58.039 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:53:58.039 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 48 M 2023-10-11T20:53:58.039 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 203 M 2023-10-11T20:53:58.040 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:53:58.229 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:58.515 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:53:58.516 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:58.517 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:53:58.518 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:53:58.519 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:58.521 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:53:58.841 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-mon-debuginfo 2023-10-11T20:53:59.448 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:06:06 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:53:59.594 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:53:59.595 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:59.595 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:53:59.596 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:59.596 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:53:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 113 M 2023-10-11T20:53:59.596 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:59.596 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:53:59.597 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:53:59.597 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:53:59.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:53:59.597 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 113 M 2023-10-11T20:53:59.597 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 525 M 2023-10-11T20:53:59.598 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:54:00.462 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-mds-debuginfo-18.2.0-669.ge62d759a.el9.x86 20 MB/s | 48 MB 00:02 2023-10-11T20:54:00.462 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:54:00.463 INFO:teuthology.orchestra.run.smithi183.stdout:Total 20 MB/s | 48 MB 00:02 2023-10-11T20:54:00.463 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:54:00.467 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:54:00.467 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:54:00.787 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:54:00.788 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:54:05.087 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-mon-debuginfo-18.2.0-669.ge62d759a.el9.x86 21 MB/s | 113 MB 00:05 2023-10-11T20:54:05.088 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:54:05.089 INFO:teuthology.orchestra.run.smithi022.stdout:Total 21 MB/s | 113 MB 00:05 2023-10-11T20:54:05.089 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:54:05.093 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:54:05.093 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:54:05.763 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:54:05.824 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:54:05.824 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:54:05.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:07.329 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:07.602 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:07.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:07.603 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:54:07.603 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:54:07.603 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:07.604 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:54:07.774 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-mon-debuginfo 2023-10-11T20:54:08.357 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:06:09 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:54:08.499 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:54:08.499 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:08.500 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:54:08.500 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:08.500 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:54:08.500 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 113 M 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:08.501 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 113 M 2023-10-11T20:54:08.502 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 525 M 2023-10-11T20:54:08.502 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:54:18.347 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:54:18.454 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:19.212 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-mon-debuginfo-18.2.0-669.ge62d759a.el9.x86 11 MB/s | 113 MB 00:10 2023-10-11T20:54:19.213 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:54:19.214 INFO:teuthology.orchestra.run.smithi183.stdout:Total 11 MB/s | 113 MB 00:10 2023-10-11T20:54:19.214 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:54:19.217 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:54:19.218 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:54:19.914 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:54:19.915 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:54:21.863 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:22.154 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:54:22.155 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:54:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:54:22.155 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:54:22.155 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:54:22.361 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-osd-debuginfo 2023-10-11T20:54:22.968 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:06:29 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:54:23.115 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:54:23.115 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:54:23.116 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:54:23.116 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:54:23.116 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:54:23.116 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 312 M 2023-10-11T20:54:23.116 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:54:23.117 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:54:23.117 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:54:23.117 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:54:23.117 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:54:23.117 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 312 M 2023-10-11T20:54:23.118 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.3 G 2023-10-11T20:54:23.118 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:54:31.729 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:54:31.901 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:35.199 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:35.464 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:54:35.464 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:35.465 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:54:35.465 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:54:35.465 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:35.465 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:54:35.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-osd-debuginfo 2023-10-11T20:54:36.203 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:06:37 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:54:36.342 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:54:36.343 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:36.344 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:54:36.344 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:36.344 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:54:36.344 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 312 M 2023-10-11T20:54:36.344 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:36.345 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:54:36.345 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:54:36.345 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:54:36.345 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:54:36.345 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 312 M 2023-10-11T20:54:36.346 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.3 G 2023-10-11T20:54:36.346 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:54:40.762 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-osd-debuginfo-18.2.0-669.ge62d759a.el9.x86 18 MB/s | 312 MB 00:17 2023-10-11T20:54:40.762 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:54:40.763 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 312 MB 00:17 2023-10-11T20:54:40.763 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:54:40.768 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:54:40.768 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:54:42.728 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:54:42.728 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:54:51.344 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-osd-debuginfo-18.2.0-669.ge62d759a.el9.x86 21 MB/s | 312 MB 00:14 2023-10-11T20:54:51.345 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:54:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:Total 21 MB/s | 312 MB 00:15 2023-10-11T20:54:51.346 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:54:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:54:51.350 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:54:53.224 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:54:53.224 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:16.603 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:16.700 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:24.863 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:25.142 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:25.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:25.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:25.143 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:25.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:25.144 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:25.183 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:55:25.288 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:25.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-fuse-debuginfo 2023-10-11T20:55:25.933 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:07:32 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:26.079 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:26.080 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:26.081 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:26.081 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:26.081 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:26.081 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 5.7 M 2023-10-11T20:55:26.081 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:26.082 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:26.082 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:26.082 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:26.082 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:26.082 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 5.7 M 2023-10-11T20:55:26.083 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 27 M 2023-10-11T20:55:26.083 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:26.593 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-fuse-debuginfo-18.2.0-669.ge62d759a.el9.x8 11 MB/s | 5.7 MB 00:00 2023-10-11T20:55:26.593 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:26.594 INFO:teuthology.orchestra.run.smithi022.stdout:Total 11 MB/s | 5.7 MB 00:00 2023-10-11T20:55:26.594 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:26.598 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:26.598 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:26.668 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:26.669 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:27.463 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:27.578 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:28.131 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:28.418 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:28.418 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:28.419 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:28.419 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:28.419 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:28.419 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:28.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados-devel-debuginfo 2023-10-11T20:55:29.187 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:07:36 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:29.331 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:29.332 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:29.333 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:29.333 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:29.333 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:29.333 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 108 k 2023-10-11T20:55:29.333 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:29.334 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:29.334 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:29.334 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:29.334 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:29.334 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 108 k 2023-10-11T20:55:29.335 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 440 k 2023-10-11T20:55:29.335 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:29.687 INFO:teuthology.orchestra.run.smithi022.stdout:librados-devel-debuginfo-18.2.0-669.ge62d759a.e 306 kB/s | 108 kB 00:00 2023-10-11T20:55:29.688 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:29.688 INFO:teuthology.orchestra.run.smithi022.stdout:Total 305 kB/s | 108 kB 00:00 2023-10-11T20:55:29.689 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:29.691 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:29.692 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:29.727 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:29.727 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:29.852 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:29.954 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:30.334 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:30.648 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:30.648 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:30.649 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:30.649 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:30.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install libcephfs2-debuginfo 2023-10-11T20:55:31.430 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:07:38 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:31.575 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:31.575 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:31.576 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:31.576 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:31.576 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:31.576 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.8 M 2023-10-11T20:55:31.577 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:31.577 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:31.577 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:31.577 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:31.577 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:31.578 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 4.8 M 2023-10-11T20:55:31.578 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 23 M 2023-10-11T20:55:31.578 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:32.157 INFO:teuthology.orchestra.run.smithi022.stdout:libcephfs2-debuginfo-18.2.0-669.ge62d759a.el9.x 8.4 MB/s | 4.8 MB 00:00 2023-10-11T20:55:32.158 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:32.158 INFO:teuthology.orchestra.run.smithi022.stdout:Total 8.3 MB/s | 4.8 MB 00:00 2023-10-11T20:55:32.158 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:32.162 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:32.162 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:32.228 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:32.228 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:32.878 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:32.982 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:33.151 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:33.423 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:33.423 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:33.423 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:55:33.423 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:33.424 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:33.424 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:55:33.477 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:33.608 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-fuse-debuginfo 2023-10-11T20:55:33.758 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:33.758 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:33.758 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:33.758 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:33.759 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:33.759 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:33.921 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librados2-debuginfo 2023-10-11T20:55:34.190 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:07:35 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:55:34.330 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:55:34.331 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:34.331 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:55:34.332 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:34.332 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:55:34.332 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 5.7 M 2023-10-11T20:55:34.332 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:34.332 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 5.7 M 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 27 M 2023-10-11T20:55:34.333 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:55:34.525 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:07:41 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:34.670 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:34.671 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:34.671 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:34.671 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:34.672 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:34.672 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 44 M 2023-10-11T20:55:34.672 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:34.672 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:34.672 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:34.673 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:34.673 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:34.673 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 44 M 2023-10-11T20:55:34.673 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 238 M 2023-10-11T20:55:34.673 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:35.042 INFO:teuthology.orchestra.run.smithi183.stdout:ceph-fuse-debuginfo-18.2.0-669.ge62d759a.el9.x8 8.0 MB/s | 5.7 MB 00:00 2023-10-11T20:55:35.042 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:35.043 INFO:teuthology.orchestra.run.smithi183.stdout:Total 8.0 MB/s | 5.7 MB 00:00 2023-10-11T20:55:35.043 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:55:35.046 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:55:35.046 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:55:35.113 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:55:35.113 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:35.853 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:55:35.964 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:36.488 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:36.753 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:36.754 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:36.754 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:55:36.754 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:36.754 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:36.755 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:55:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:librados2-debuginfo-18.2.0-669.ge62d759a.el9.x8 20 MB/s | 44 MB 00:02 2023-10-11T20:55:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:Total 20 MB/s | 44 MB 00:02 2023-10-11T20:55:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:36.897 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados-devel-debuginfo 2023-10-11T20:55:37.161 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:37.162 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:37.473 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:07:38 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:55:37.611 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:55:37.612 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:37.612 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:55:37.613 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:37.613 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:55:37.613 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 108 k 2023-10-11T20:55:37.613 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:37.613 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:55:37.614 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:37.614 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:55:37.614 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:37.614 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 108 k 2023-10-11T20:55:37.614 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 440 k 2023-10-11T20:55:37.615 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:55:37.820 INFO:teuthology.orchestra.run.smithi183.stdout:librados-devel-debuginfo-18.2.0-669.ge62d759a.e 524 kB/s | 108 kB 00:00 2023-10-11T20:55:37.820 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:37.821 INFO:teuthology.orchestra.run.smithi183.stdout:Total 521 kB/s | 108 kB 00:00 2023-10-11T20:55:37.821 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:55:37.824 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:55:37.824 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:55:37.856 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:55:37.857 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:37.981 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:55:38.093 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:38.473 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:38.762 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:38.762 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:38.762 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:55:38.762 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:38.763 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:38.763 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:55:38.936 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install libcephfs2-debuginfo 2023-10-11T20:55:39.516 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:07:40 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:55:39.654 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:55:39.655 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:39.655 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:55:39.655 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:39.655 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:55:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 4.8 M 2023-10-11T20:55:39.656 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:39.656 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:55:39.656 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:39.656 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:55:39.657 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:39.657 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 4.8 M 2023-10-11T20:55:39.657 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 23 M 2023-10-11T20:55:39.657 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:55:40.106 INFO:teuthology.orchestra.run.smithi183.stdout:libcephfs2-debuginfo-18.2.0-669.ge62d759a.el9.x 11 MB/s | 4.8 MB 00:00 2023-10-11T20:55:40.106 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:40.107 INFO:teuthology.orchestra.run.smithi183.stdout:Total 11 MB/s | 4.8 MB 00:00 2023-10-11T20:55:40.107 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:55:40.110 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:55:40.110 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:55:40.170 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:55:40.171 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:40.786 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:55:40.878 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:41.364 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:41.635 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:55:41.636 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:41.636 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:55:41.636 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:41.636 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:41.637 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:55:41.800 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librados2-debuginfo 2023-10-11T20:55:42.380 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:07:43 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:55:42.398 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:42.494 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:42.518 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:55:42.519 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:42.519 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:55:42.519 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:42.519 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:55:42.519 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 44 M 2023-10-11T20:55:42.520 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:42.520 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:55:42.520 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:42.520 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:55:42.521 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:42.521 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 44 M 2023-10-11T20:55:42.521 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 238 M 2023-10-11T20:55:42.521 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:55:44.250 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:44.531 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:44.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:44.531 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:44.531 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:44.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:44.532 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:44.833 INFO:teuthology.orchestra.run.smithi183.stdout:librados2-debuginfo-18.2.0-669.ge62d759a.el9.x8 19 MB/s | 44 MB 00:02 2023-10-11T20:55:44.834 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:44.835 INFO:teuthology.orchestra.run.smithi183.stdout:Total 19 MB/s | 44 MB 00:02 2023-10-11T20:55:44.835 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:55:44.839 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:55:44.839 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:55:44.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install librbd1-debuginfo 2023-10-11T20:55:45.145 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:55:45.146 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:45.485 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:07:52 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:45.629 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:45.630 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:45.630 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:45.630 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:45.631 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 51 M 2023-10-11T20:55:45.631 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:45.631 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:45.631 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:45.632 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:45.632 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:45.632 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 51 M 2023-10-11T20:55:45.632 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 292 M 2023-10-11T20:55:45.632 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:48.395 INFO:teuthology.orchestra.run.smithi022.stdout:librbd1-debuginfo-18.2.0-669.ge62d759a.el9.x86_ 18 MB/s | 51 MB 00:02 2023-10-11T20:55:48.396 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:48.397 INFO:teuthology.orchestra.run.smithi022.stdout:Total 18 MB/s | 51 MB 00:02 2023-10-11T20:55:48.397 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:48.401 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:48.401 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:48.761 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:48.761 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:50.067 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:55:50.166 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:51.920 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:52.209 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_6 1/1 2023-10-11T20:55:52.209 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:52.209 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:55:52.209 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:52.210 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:52.210 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:55:52.385 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install librbd1-debuginfo 2023-10-11T20:55:52.968 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:07:53 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:55:53.106 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:55:53.107 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:53.107 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:55:53.107 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:53.108 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:55:53.108 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 51 M 2023-10-11T20:55:53.108 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:53.108 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:55:53.109 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:55:53.109 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:55:53.109 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:55:53.109 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 51 M 2023-10-11T20:55:53.109 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 292 M 2023-10-11T20:55:53.110 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:55:54.909 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:55.030 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:55.669 INFO:teuthology.orchestra.run.smithi183.stdout:librbd1-debuginfo-18.2.0-669.ge62d759a.el9.x86_ 20 MB/s | 51 MB 00:02 2023-10-11T20:55:55.670 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:55.670 INFO:teuthology.orchestra.run.smithi183.stdout:Total 20 MB/s | 51 MB 00:02 2023-10-11T20:55:55.671 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:55:55.675 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:55:55.675 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:55:56.016 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:55:56.016 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:55:57.235 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:57.520 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:55:57.520 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:57.521 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:57.521 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:57.521 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:57.521 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:57.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-cephfs-debuginfo 2023-10-11T20:55:58.341 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:05 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:55:58.485 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:55:58.486 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:58.486 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:55:58.486 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:58.486 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 593 k 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:55:58.487 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:58.488 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 593 k 2023-10-11T20:55:58.488 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.0 M 2023-10-11T20:55:58.488 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:55:58.765 INFO:teuthology.orchestra.run.smithi022.stdout:python3-cephfs-debuginfo-18.2.0-669.ge62d759a.e 2.1 MB/s | 593 kB 00:00 2023-10-11T20:55:58.766 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:55:58.766 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.1 MB/s | 593 kB 00:00 2023-10-11T20:55:58.767 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:55:58.769 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:55:58.769 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:55:58.807 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:55:58.808 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:55:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:55:59.074 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:59.488 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:59.762 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:55:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:59.763 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:55:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:55:59.763 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:55:59.763 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:55:59.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rados-debuginfo 2023-10-11T20:56:00.517 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:07 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:00.663 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:00.664 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:00.664 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:00.665 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:00.665 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 769 k 2023-10-11T20:56:00.665 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:00.665 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:00.666 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:00.666 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:00.666 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:00.666 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 769 k 2023-10-11T20:56:00.666 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.7 M 2023-10-11T20:56:00.667 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:01.200 INFO:teuthology.orchestra.run.smithi022.stdout:python3-rados-debuginfo-18.2.0-669.ge62d759a.el 1.4 MB/s | 769 kB 00:00 2023-10-11T20:56:01.201 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:01.201 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.4 MB/s | 769 kB 00:00 2023-10-11T20:56:01.202 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:01.205 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:01.245 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:01.246 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:01.435 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:01.527 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:01.804 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:01.910 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:01.949 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:02.236 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:02.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:02.237 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:02.237 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:02.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:02.238 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:02.409 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rbd-debuginfo 2023-10-11T20:56:03.015 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:10 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:03.162 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:03.162 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:03.163 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:03.163 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:03.163 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:03.163 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.1 M 2023-10-11T20:56:03.163 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:03.164 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:03.164 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:03.164 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:03.164 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:03.165 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.1 M 2023-10-11T20:56:03.165 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 4.3 M 2023-10-11T20:56:03.165 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:03.470 INFO:teuthology.orchestra.run.smithi022.stdout:python3-rbd-debuginfo-18.2.0-669.ge62d759a.el9. 3.6 MB/s | 1.1 MB 00:00 2023-10-11T20:56:03.471 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:03.471 INFO:teuthology.orchestra.run.smithi022.stdout:Total 3.6 MB/s | 1.1 MB 00:00 2023-10-11T20:56:03.471 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:03.474 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:03.475 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:03.518 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:03.518 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:03.757 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:03.855 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:03.981 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:04.241 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:04.249 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:04.249 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:04.249 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:04.249 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:04.249 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:04.250 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:04.424 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-cephfs-debuginfo 2023-10-11T20:56:04.539 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:04.540 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:04.540 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:04.540 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:04.540 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:04.541 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:04.709 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install python3-rgw-debuginfo 2023-10-11T20:56:05.006 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:06 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:05.146 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:05.147 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:05.147 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:05.147 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:05.147 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:05.147 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 593 k 2023-10-11T20:56:05.148 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:05.148 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:05.148 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:05.148 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:05.148 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:05.149 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 593 k 2023-10-11T20:56:05.149 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.0 M 2023-10-11T20:56:05.149 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:05.314 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:12 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:05.458 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:05.459 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:05.459 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:05.460 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:05.460 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:05.460 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 337 k 2023-10-11T20:56:05.460 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:05.460 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:05.461 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:05.461 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:05.461 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:05.461 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 337 k 2023-10-11T20:56:05.461 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 1.0 M 2023-10-11T20:56:05.462 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:05.546 INFO:teuthology.orchestra.run.smithi183.stdout:python3-cephfs-debuginfo-18.2.0-669.ge62d759a.e 1.5 MB/s | 593 kB 00:00 2023-10-11T20:56:05.547 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:05.547 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.4 MB/s | 593 kB 00:00 2023-10-11T20:56:05.547 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:05.550 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:05.551 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:05.586 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:05.587 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:05.749 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:05.815 INFO:teuthology.orchestra.run.smithi022.stdout:python3-rgw-debuginfo-18.2.0-669.ge62d759a.el9. 951 kB/s | 337 kB 00:00 2023-10-11T20:56:05.815 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:05.816 INFO:teuthology.orchestra.run.smithi022.stdout:Total 948 kB/s | 337 kB 00:00 2023-10-11T20:56:05.816 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:05.819 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:05.819 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:05.836 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:56:05.856 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:05.857 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:05.994 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:06.098 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:06.263 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:56:06.466 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9. 1/1 2023-10-11T20:56:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:06.540 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:06.540 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:06.541 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:06.541 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:06.721 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rados-debuginfo 2023-10-11T20:56:06.745 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:06.745 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:06.746 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:06.746 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:06.746 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:06.746 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:06.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-fuse-debuginfo 2023-10-11T20:56:07.303 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:08 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:07.440 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:07.441 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:07.441 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:07.442 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:07.442 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:07.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 769 k 2023-10-11T20:56:07.442 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:07.442 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:07.443 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:07.443 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:07.443 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:07.443 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 769 k 2023-10-11T20:56:07.443 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.7 M 2023-10-11T20:56:07.444 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:07.537 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:14 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:07.681 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:07.682 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 507 k 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:07.683 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:07.684 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:07.684 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:07.684 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:07.684 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 507 k 2023-10-11T20:56:07.684 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 2.5 M 2023-10-11T20:56:07.685 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:07.866 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rados-debuginfo-18.2.0-669.ge62d759a.el 1.8 MB/s | 769 kB 00:00 2023-10-11T20:56:07.867 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:07.867 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.8 MB/s | 769 kB 00:00 2023-10-11T20:56:07.867 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:07.870 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:07.871 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:07.908 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:07.909 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:07.967 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-fuse-debuginfo-18.2.0-669.ge62d759a.el9.x86 1.7 MB/s | 507 kB 00:00 2023-10-11T20:56:07.968 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:07.969 INFO:teuthology.orchestra.run.smithi022.stdout:Total 1.7 MB/s | 507 kB 00:00 2023-10-11T20:56:07.969 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:07.972 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:07.972 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:08.012 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:08.012 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:08.093 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:08.176 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:08.189 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:08.286 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:08.572 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:08.676 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:08.840 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x 1/1 2023-10-11T20:56:08.840 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:08.840 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:08.840 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:08.841 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:08.841 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:08.952 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:08.952 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:08.953 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:08.953 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:08.953 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:09.025 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rbd-debuginfo 2023-10-11T20:56:09.101 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-mirror-debuginfo 2023-10-11T20:56:09.608 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:10 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:09.710 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:16 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:09.747 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:09.748 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:09.749 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:09.749 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:09.749 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:09.749 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.1 M 2023-10-11T20:56:09.749 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:09.750 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:09.750 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:09.750 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:09.750 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:09.750 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 1.1 M 2023-10-11T20:56:09.751 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 4.3 M 2023-10-11T20:56:09.751 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:09.854 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:09.855 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:09.856 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:09.856 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:09.856 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:09.856 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 51 M 2023-10-11T20:56:09.856 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:09.857 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:09.857 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:09.857 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:09.857 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:09.857 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 51 M 2023-10-11T20:56:09.858 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 282 M 2023-10-11T20:56:09.858 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:10.194 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rbd-debuginfo-18.2.0-669.ge62d759a.el9. 2.5 MB/s | 1.1 MB 00:00 2023-10-11T20:56:10.194 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:10.195 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.5 MB/s | 1.1 MB 00:00 2023-10-11T20:56:10.195 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:10.198 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:10.198 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:10.238 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:10.239 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:10.452 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:10.550 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:10.981 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:11.252 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:11.252 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:11.253 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:11.253 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:11.253 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:11.253 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:11.435 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install python3-rgw-debuginfo 2023-10-11T20:56:12.018 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:13 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:12.157 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:12.158 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:12.159 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:12.159 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:12.159 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:12.159 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 337 k 2023-10-11T20:56:12.159 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:12.160 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:12.160 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:12.160 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:12.160 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:12.160 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 337 k 2023-10-11T20:56:12.161 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 1.0 M 2023-10-11T20:56:12.161 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:12.730 INFO:teuthology.orchestra.run.smithi183.stdout:python3-rgw-debuginfo-18.2.0-669.ge62d759a.el9. 591 kB/s | 337 kB 00:00 2023-10-11T20:56:12.731 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:12.731 INFO:teuthology.orchestra.run.smithi183.stdout:Total 589 kB/s | 337 kB 00:00 2023-10-11T20:56:12.731 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:12.734 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:12.735 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:12.770 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:12.770 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:12.820 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-mirror-debuginfo-18.2.0-669.ge62d759a.el9.x 17 MB/s | 51 MB 00:02 2023-10-11T20:56:12.821 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:12.822 INFO:teuthology.orchestra.run.smithi022.stdout:Total 17 MB/s | 51 MB 00:02 2023-10-11T20:56:12.822 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:12.826 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:12.826 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:12.906 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:13.004 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:13.176 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:13.177 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:13.386 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:13.665 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86 1/1 2023-10-11T20:56:13.665 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:13.665 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:13.665 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:13.666 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:13.666 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:13.854 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-fuse-debuginfo 2023-10-11T20:56:14.433 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:15 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:14.570 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:14.571 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:14.572 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:14.572 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:14.572 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:14.572 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 507 k 2023-10-11T20:56:14.572 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:14.573 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:14.573 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:14.573 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:14.573 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:14.573 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 507 k 2023-10-11T20:56:14.574 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 2.5 M 2023-10-11T20:56:14.574 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:14.833 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-fuse-debuginfo-18.2.0-669.ge62d759a.el9.x86 1.9 MB/s | 507 kB 00:00 2023-10-11T20:56:14.834 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:14.834 INFO:teuthology.orchestra.run.smithi183.stdout:Total 1.9 MB/s | 507 kB 00:00 2023-10-11T20:56:14.834 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:14.837 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:14.837 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:14.872 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:14.873 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:15.029 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:15.124 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:15.542 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:15.813 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:15.814 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:15.814 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:15.814 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:15.815 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:15.815 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:15.981 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-mirror-debuginfo 2023-10-11T20:56:16.559 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:17 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:16.697 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:16.698 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:16.698 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:16.698 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:16.699 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:16.699 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 51 M 2023-10-11T20:56:16.699 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:16.699 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:16.699 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:16.700 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:16.700 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:16.700 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 51 M 2023-10-11T20:56:16.700 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 282 M 2023-10-11T20:56:16.700 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:19.110 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-mirror-debuginfo-18.2.0-669.ge62d759a.el9.x 21 MB/s | 51 MB 00:02 2023-10-11T20:56:19.111 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:19.112 INFO:teuthology.orchestra.run.smithi183.stdout:Total 21 MB/s | 51 MB 00:02 2023-10-11T20:56:19.112 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:19.116 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:19.116 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:19.258 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:19.359 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:19.448 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:19.448 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:21.331 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:21.625 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:21.626 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:21.626 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:21.626 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:21.627 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:21.627 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:21.812 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install rbd-nbd-debuginfo 2023-10-11T20:56:22.421 INFO:teuthology.orchestra.run.smithi022.stdout:Last metadata expiration check: 0:08:29 ago on Wed 11 Oct 2023 08:47:53 PM UTC. 2023-10-11T20:56:22.564 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2023-10-11T20:56:22.565 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:22.565 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repo Size 2023-10-11T20:56:22.566 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:22.566 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2023-10-11T20:56:22.566 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.2 M 2023-10-11T20:56:22.566 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:22.567 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2023-10-11T20:56:22.567 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2023-10-11T20:56:22.567 INFO:teuthology.orchestra.run.smithi022.stdout:Install 1 Package 2023-10-11T20:56:22.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:22.567 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 1.2 M 2023-10-11T20:56:22.568 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 5.4 M 2023-10-11T20:56:22.568 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2023-10-11T20:56:23.022 INFO:teuthology.orchestra.run.smithi022.stdout:rbd-nbd-debuginfo-18.2.0-669.ge62d759a.el9.x86_ 2.7 MB/s | 1.2 MB 00:00 2023-10-11T20:56:23.023 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:23.023 INFO:teuthology.orchestra.run.smithi022.stdout:Total 2.7 MB/s | 1.2 MB 00:00 2023-10-11T20:56:23.024 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2023-10-11T20:56:23.027 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2023-10-11T20:56:23.027 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2023-10-11T20:56:23.071 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2023-10-11T20:56:23.072 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2023-10-11T20:56:23.321 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2023-10-11T20:56:23.432 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:23.857 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:24.142 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:24.142 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:24.143 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2023-10-11T20:56:24.143 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:24.143 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:24.143 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2023-10-11T20:56:24.298 DEBUG:teuthology.parallel:result is None 2023-10-11T20:56:25.178 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:25.283 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:27.267 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:27.554 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_ 1/1 2023-10-11T20:56:27.555 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:27.555 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:27.555 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:27.555 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:27.743 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install rbd-nbd-debuginfo 2023-10-11T20:56:28.326 INFO:teuthology.orchestra.run.smithi183.stdout:Last metadata expiration check: 0:08:29 ago on Wed 11 Oct 2023 08:47:59 PM UTC. 2023-10-11T20:56:28.464 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2023-10-11T20:56:28.465 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:28.465 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repo Size 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-debuginfo x86_64 2:18.2.0-669.ge62d759a.el9 ceph 1.2 M 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2023-10-11T20:56:28.466 INFO:teuthology.orchestra.run.smithi183.stdout:================================================================================ 2023-10-11T20:56:28.467 INFO:teuthology.orchestra.run.smithi183.stdout:Install 1 Package 2023-10-11T20:56:28.467 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:28.467 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 1.2 M 2023-10-11T20:56:28.467 INFO:teuthology.orchestra.run.smithi183.stdout:Installed size: 5.4 M 2023-10-11T20:56:28.467 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2023-10-11T20:56:28.904 INFO:teuthology.orchestra.run.smithi183.stdout:rbd-nbd-debuginfo-18.2.0-669.ge62d759a.el9.x86_ 2.8 MB/s | 1.2 MB 00:00 2023-10-11T20:56:28.905 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2023-10-11T20:56:28.905 INFO:teuthology.orchestra.run.smithi183.stdout:Total 2.8 MB/s | 1.2 MB 00:00 2023-10-11T20:56:28.905 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2023-10-11T20:56:28.908 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2023-10-11T20:56:28.908 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2023-10-11T20:56:28.948 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2023-10-11T20:56:28.948 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2023-10-11T20:56:29.184 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2023-10-11T20:56:29.286 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:29.754 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:30.020 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 1/1 2023-10-11T20:56:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:30.021 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2023-10-11T20:56:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-debuginfo-2:18.2.0-669.ge62d759a.el9.x86_64 2023-10-11T20:56:30.021 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:30.022 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2023-10-11T20:56:30.210 DEBUG:teuthology.parallel:result is None 2023-10-11T20:56:30.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:56:30.350 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-11T20:56:30.375 INFO:teuthology.orchestra.run.smithi022.stdout:18.2.0-669.ge62d759a.el9 2023-10-11T20:56:30.375 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-669.ge62d759a.el9 2023-10-11T20:56:30.376 INFO:teuthology.task.install:The correct ceph version 18.2.0-669.ge62d759a is installed. 2023-10-11T20:56:30.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:56:30.514 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-11T20:56:30.535 INFO:teuthology.orchestra.run.smithi183.stdout:18.2.0-669.ge62d759a.el9 2023-10-11T20:56:30.536 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-669.ge62d759a.el9 2023-10-11T20:56:30.536 INFO:teuthology.task.install:The correct ceph version 18.2.0-669.ge62d759a is installed. 2023-10-11T20:56:30.536 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-11T20:56:30.537 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:30.537 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-11T20:56:30.573 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:30.574 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-11T20:56:30.603 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-11T20:56:30.603 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:30.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2023-10-11T20:56:30.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-11T20:56:30.723 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:30.723 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2023-10-11T20:56:30.750 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-11T20:56:30.816 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-11T20:56:30.817 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:30.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-11T20:56:30.852 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-11T20:56:30.925 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:30.926 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-11T20:56:30.953 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-11T20:56:31.019 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-11T20:56:31.020 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:31.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2023-10-11T20:56:31.054 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-11T20:56:31.128 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:31.129 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2023-10-11T20:56:31.155 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-11T20:56:31.223 INFO:teuthology.run_tasks:Running task ceph... 2023-10-11T20:56:31.288 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-11T20:56:31.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2023-10-11T20:56:31.292 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /var/log/ceph 2023-10-11T20:56:31.323 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-11T20:56:31.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-11T20:56:31.366 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-11T20:56:31.396 INFO:tasks.ceph:Creating extra log directories... 2023-10-11T20:56:31.397 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-11T20:56:31.439 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-11T20:56:31.481 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-11T20:56:31.481 INFO:tasks.ceph:config {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2023-10-11T20:56:31.482 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575', 'branch': 'wip-yuri11-testing-2023-10-10-1226-reef', 'description': 'rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7421575', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri11-testing-2023-10-10-1226-reef'}, 'ceph': {'conf': {'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd', 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri11-testing-2023-10-10-1226-reef', 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 5878, 'sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri11-testing-2023-10-10-1226-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'e62d759a6de3042e046d7d9889d2209cbc674fbd', 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAp7mZpaoVc/wuaJlSHU0ll0diFnPGt20rhRfEYYWdVm5wW7TZ4LnHFD/MwjXgKIfuQwcR7CmEVYQ7ZJJf4EByA=', 'smithi183.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOu3Q7wkHByOetS2rapqah+piqG0kpJ/U/dBkCnPFXLG2lDN3jixV41sWEJ7UHaYSLW+RZK1k1kSVcV1fq/4s8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'workunit': {'clients': {'client.0': ['cls']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-11_14:08:36', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-11T20:56:31.482 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-11T20:56:31.512 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-11T20:56:31.527 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2023-10-11T20:56:31.569 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m0777 -- /var/run/ceph 2023-10-11T20:56:31.598 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:31.599 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2023-10-11T20:56:31.655 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-11T20:56:31.655 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2023-10-11T20:56:31.711 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-11T20:56:31.711 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:31.712 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 665 Links: 1 2023-10-11T20:56:31.712 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:31.712 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:31.712 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-11 20:49:35.531923079 +0000 2023-10-11T20:56:31.713 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-11 20:47:06.849247028 +0000 2023-10-11T20:56:31.713 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-11 20:47:06.849247028 +0000 2023-10-11T20:56:31.713 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-10-11 20:47:06.849247028 +0000 2023-10-11T20:56:31.713 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-11T20:56:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-11T20:56:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-11T20:56:31.781 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000102913 s, 5.0 MB/s 2023-10-11T20:56:31.782 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-11T20:56:31.839 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2023-10-11T20:56:31.895 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-11T20:56:31.895 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:31.895 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-11T20:56:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-11 20:49:35.531923079 +0000 2023-10-11T20:56:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-11 20:47:07.352240392 +0000 2023-10-11T20:56:31.896 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-11 20:47:07.352240392 +0000 2023-10-11T20:56:31.897 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-10-11 20:47:07.352240392 +0000 2023-10-11T20:56:31.897 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-11T20:56:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-11T20:56:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-11T20:56:31.965 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.9184e-05 s, 5.2 MB/s 2023-10-11T20:56:31.966 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-11T20:56:32.022 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2023-10-11T20:56:32.077 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-11T20:56:32.078 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.078 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-10-11T20:56:32.078 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.078 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.079 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-11 20:49:35.532923066 +0000 2023-10-11T20:56:32.079 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-11 20:47:07.859233703 +0000 2023-10-11T20:56:32.079 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-11 20:47:07.859233703 +0000 2023-10-11T20:56:32.079 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-10-11 20:47:07.859233703 +0000 2023-10-11T20:56:32.080 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-11T20:56:32.147 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-11T20:56:32.147 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-11T20:56:32.147 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.4362e-05 s, 5.4 MB/s 2023-10-11T20:56:32.148 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-11T20:56:32.204 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2023-10-11T20:56:32.259 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-11T20:56:32.260 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.260 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-10-11T20:56:32.260 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.260 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.261 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2023-10-11 20:49:35.532923066 +0000 2023-10-11T20:56:32.261 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2023-10-11 20:47:08.370226961 +0000 2023-10-11T20:56:32.261 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2023-10-11 20:47:08.370226961 +0000 2023-10-11T20:56:32.261 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2023-10-11 20:47:08.370226961 +0000 2023-10-11T20:56:32.262 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-11T20:56:32.328 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2023-10-11T20:56:32.328 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2023-10-11T20:56:32.328 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000100044 s, 5.1 MB/s 2023-10-11T20:56:32.329 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-11T20:56:32.385 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:32.385 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:32.386 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2023-10-11T20:56:32.402 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-11T20:56:32.403 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2023-10-11T20:56:32.457 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-11T20:56:32.457 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.458 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-10-11T20:56:32.458 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.458 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.458 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-11 20:49:39.054752623 +0000 2023-10-11T20:56:32.458 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-11 20:46:58.991202899 +0000 2023-10-11T20:56:32.459 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-11 20:46:58.991202899 +0000 2023-10-11T20:56:32.459 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-10-11 20:46:58.991202899 +0000 2023-10-11T20:56:32.459 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-11T20:56:32.524 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-11T20:56:32.524 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-11T20:56:32.525 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000212227 s, 2.4 MB/s 2023-10-11T20:56:32.526 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-11T20:56:32.582 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2023-10-11T20:56:32.637 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-11T20:56:32.637 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.637 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 681 Links: 1 2023-10-11T20:56:32.637 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.638 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.638 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-11 20:49:39.054752623 +0000 2023-10-11T20:56:32.638 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-11 20:46:59.495189258 +0000 2023-10-11T20:56:32.638 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-11 20:46:59.495189258 +0000 2023-10-11T20:56:32.638 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-10-11 20:46:59.495189258 +0000 2023-10-11T20:56:32.639 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-11T20:56:32.702 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-11T20:56:32.703 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-11T20:56:32.703 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000194436 s, 2.6 MB/s 2023-10-11T20:56:32.704 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-11T20:56:32.760 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2023-10-11T20:56:32.814 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-11T20:56:32.815 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.815 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-10-11T20:56:32.815 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.815 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.815 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-11 20:49:39.054752623 +0000 2023-10-11T20:56:32.816 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-11 20:47:00.001175562 +0000 2023-10-11T20:56:32.816 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-11 20:47:00.001175562 +0000 2023-10-11T20:56:32.816 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-10-11 20:47:00.001175562 +0000 2023-10-11T20:56:32.816 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-11T20:56:32.880 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-11T20:56:32.880 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-11T20:56:32.880 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000227538 s, 2.3 MB/s 2023-10-11T20:56:32.881 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-11T20:56:32.937 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2023-10-11T20:56:32.992 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-11T20:56:32.993 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-11T20:56:32.993 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-10-11T20:56:32.993 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-11T20:56:32.993 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2023-10-11T20:56:32.993 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2023-10-11 20:49:39.055752596 +0000 2023-10-11T20:56:32.994 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2023-10-11 20:47:00.485162462 +0000 2023-10-11T20:56:32.994 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2023-10-11 20:47:00.485162462 +0000 2023-10-11T20:56:32.994 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2023-10-11 20:47:00.485162462 +0000 2023-10-11T20:56:32.995 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-11T20:56:33.058 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2023-10-11T20:56:33.058 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2023-10-11T20:56:33.058 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000205772 s, 2.5 MB/s 2023-10-11T20:56:33.059 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-11T20:56:33.115 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:33.115 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-11T20:56:33.116 INFO:tasks.ceph:Generating config... 2023-10-11T20:56:33.117 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-10-11T20:56:33.117 INFO:tasks.ceph:[global] mon election default strategy = 1 2023-10-11T20:56:33.117 INFO:tasks.ceph:[global] ms bind msgr2 = False 2023-10-11T20:56:33.118 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-10-11T20:56:33.118 INFO:tasks.ceph:[global] ms type = async 2023-10-11T20:56:33.118 INFO:tasks.ceph:[global] osd heartbeat grace = 80 2023-10-11T20:56:33.118 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-11T20:56:33.119 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-11T20:56:33.119 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-11T20:56:33.119 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-11T20:56:33.119 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-11T20:56:33.120 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2023-10-11T20:56:33.120 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2023-10-11T20:56:33.120 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2023-10-11T20:56:33.121 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2023-10-11T20:56:33.121 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2023-10-11T20:56:33.121 INFO:tasks.ceph:[mon] mon scrub interval = 300 2023-10-11T20:56:33.121 INFO:tasks.ceph:[mon] paxos service trim min = 10 2023-10-11T20:56:33.121 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-11T20:56:33.122 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-11T20:56:33.122 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-11T20:56:33.122 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-11T20:56:33.123 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2023-10-11T20:56:33.123 INFO:tasks.ceph:[osd] debug bluefs = 1 2023-10-11T20:56:33.123 INFO:tasks.ceph:[osd] debug bluestore = 1 2023-10-11T20:56:33.123 INFO:tasks.ceph:[osd] debug monc = 20 2023-10-11T20:56:33.124 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-11T20:56:33.124 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-11T20:56:33.124 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-11T20:56:33.124 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-11T20:56:33.125 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-11T20:56:33.125 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-11T20:56:33.125 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2023-10-11T20:56:33.125 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2023-10-11T20:56:33.126 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-11T20:56:33.126 INFO:tasks.ceph:[osd] osd fast shutdown = False 2023-10-11T20:56:33.126 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2023-10-11T20:56:33.126 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2023-10-11T20:56:33.127 INFO:tasks.ceph:[osd] osd memory target = 1610612736 2023-10-11T20:56:33.127 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-11T20:56:33.127 INFO:tasks.ceph:[osd] osd op queue = debug_random 2023-10-11T20:56:33.127 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2023-10-11T20:56:33.128 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-10-11T20:56:33.128 INFO:tasks.ceph:[osd] osd_class_default_list = * 2023-10-11T20:56:33.128 INFO:tasks.ceph:[osd] osd_class_load_list = * 2023-10-11T20:56:33.129 INFO:tasks.ceph:Setting up mon.a... 2023-10-11T20:56:33.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-11T20:56:33.187 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2023-10-11T20:56:33.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-11T20:56:33.242 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T20:56:33.274 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.22:6789]'), ('mon.c', '[v1:172.21.15.22:6790]'), ('mon.b', '[v1:172.21.15.183:6789]')] 2023-10-11T20:56:33.275 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.22:6789],[v1:172.21.15.22:6790],[v1:172.21.15.183:6789]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async', 'osd heartbeat grace': 80}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 1, 'debug bluestore': 1, 'debug monc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd mclock override recovery settings': True, 'osd memory target': 1610612736, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd shutdown pgref assert': True, 'osd_class_default_list': '*', 'osd_class_load_list': '*'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osd crush smoke test': False, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub interval': 300, 'paxos service trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-10-11T20:56:33.276 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:33.276 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-11T20:56:33.330 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.22:6789]' --addv c '[v1:172.21.15.22:6790]' --addv b '[v1:172.21.15.183:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:33.415 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:33.415 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid bae0e1e0-30c1-4b31-993c-2e12cbe45466 2023-10-11T20:56:33.416 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = pacific 2023-10-11T20:56:33.416 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2023-10-11T20:56:33.416 INFO:teuthology.orchestra.run.smithi022.stdout:fsid bae0e1e0-30c1-4b31-993c-2e12cbe45466 2023-10-11T20:56:33.416 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2023-10-11T20:56:33.415138+0000 2023-10-11T20:56:33.416 INFO:teuthology.orchestra.run.smithi022.stdout:created 2023-10-11T20:56:33.415138+0000 2023-10-11T20:56:33.417 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 16 (pacific) 2023-10-11T20:56:33.417 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2023-10-11T20:56:33.417 INFO:teuthology.orchestra.run.smithi022.stdout:0: v1:172.21.15.22:6789/0 mon.a 2023-10-11T20:56:33.417 INFO:teuthology.orchestra.run.smithi022.stdout:1: v1:172.21.15.183:6789/0 mon.b 2023-10-11T20:56:33.417 INFO:teuthology.orchestra.run.smithi022.stdout:2: v1:172.21.15.22:6790/0 mon.c 2023-10-11T20:56:33.418 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-11T20:56:33.419 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-11T20:56:33.434 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bae0e1e0-30c1-4b31-993c-2e12cbe45466... 2023-10-11T20:56:33.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-11T20:56:33.477 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-11T20:56:33.527 INFO:teuthology.orchestra.run.smithi183.stdout:[global] 2023-10-11T20:56:33.527 INFO:teuthology.orchestra.run.smithi183.stdout: chdir = "" 2023-10-11T20:56:33.528 INFO:teuthology.orchestra.run.smithi183.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-11T20:56:33.528 INFO:teuthology.orchestra.run.smithi183.stdout: auth supported = cephx 2023-10-11T20:56:33.528 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.528 INFO:teuthology.orchestra.run.smithi183.stdout: filestore xattr use omap = true 2023-10-11T20:56:33.528 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.529 INFO:teuthology.orchestra.run.smithi183.stdout: mon clock drift allowed = 1.000 2023-10-11T20:56:33.529 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.529 INFO:teuthology.orchestra.run.smithi183.stdout: osd crush chooseleaf type = 0 2023-10-11T20:56:33.529 INFO:teuthology.orchestra.run.smithi183.stdout: auth debug = true 2023-10-11T20:56:33.530 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.530 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on old message = true 2023-10-11T20:56:33.530 INFO:teuthology.orchestra.run.smithi183.stdout: ms die on bug = true 2023-10-11T20:56:33.530 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.530 INFO:teuthology.orchestra.run.smithi183.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-11T20:56:33.531 INFO:teuthology.orchestra.run.smithi183.stdout: mon pg warn max object skew = 0 2023-10-11T20:56:33.531 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.531 INFO:teuthology.orchestra.run.smithi183.stdout: # disable pg_autoscaler by default for new pools 2023-10-11T20:56:33.531 INFO:teuthology.orchestra.run.smithi183.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-11T20:56:33.532 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.532 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default size = 2 2023-10-11T20:56:33.532 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.533 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow primary affinity = true 2023-10-11T20:56:33.533 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd allow pg remap = true 2023-10-11T20:56:33.533 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on legacy crush tunables = false 2023-10-11T20:56:33.533 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on crush straw calc version zero = false 2023-10-11T20:56:33.533 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on no sortbitwise = false 2023-10-11T20:56:33.534 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on osd down out interval zero = false 2023-10-11T20:56:33.534 INFO:teuthology.orchestra.run.smithi183.stdout: mon warn on too few osds = false 2023-10-11T20:56:33.534 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-11T20:56:33.534 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-11T20:56:33.534 INFO:teuthology.orchestra.run.smithi183.stdout: mon_allow_pool_size_one = true 2023-10-11T20:56:33.535 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.535 INFO:teuthology.orchestra.run.smithi183.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-11T20:56:33.535 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.535 INFO:teuthology.orchestra.run.smithi183.stdout: osd default data pool replay window = 5 2023-10-11T20:56:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: mon allow pool delete = true 2023-10-11T20:56:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: mon cluster log file level = debug 2023-10-11T20:56:33.536 INFO:teuthology.orchestra.run.smithi183.stdout: debug asserts on shutdown = true 2023-10-11T20:56:33.537 INFO:teuthology.orchestra.run.smithi183.stdout: mon health detail to clog = false 2023-10-11T20:56:33.537 INFO:teuthology.orchestra.run.smithi183.stdout: mon host = "[v1:172.21.15.22:6789],[v1:172.21.15.22:6790],[v1:172.21.15.183:6789]" 2023-10-11T20:56:33.537 INFO:teuthology.orchestra.run.smithi183.stdout: mon client directed command retry = 5 2023-10-11T20:56:33.537 INFO:teuthology.orchestra.run.smithi183.stdout: mon election default strategy = 1 2023-10-11T20:56:33.537 INFO:teuthology.orchestra.run.smithi183.stdout: ms bind msgr2 = False 2023-10-11T20:56:33.538 INFO:teuthology.orchestra.run.smithi183.stdout: ms inject socket failures = 5000 2023-10-11T20:56:33.538 INFO:teuthology.orchestra.run.smithi183.stdout: ms type = async 2023-10-11T20:56:33.538 INFO:teuthology.orchestra.run.smithi183.stdout: osd heartbeat grace = 80 2023-10-11T20:56:33.538 INFO:teuthology.orchestra.run.smithi183.stdout: fsid = bae0e1e0-30c1-4b31-993c-2e12cbe45466 2023-10-11T20:56:33.539 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.539 INFO:teuthology.orchestra.run.smithi183.stdout:[osd] 2023-10-11T20:56:33.539 INFO:teuthology.orchestra.run.smithi183.stdout: osd journal size = 100 2023-10-11T20:56:33.539 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.540 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub load threshold = 5.0 2023-10-11T20:56:33.540 INFO:teuthology.orchestra.run.smithi183.stdout: osd scrub max interval = 600 2023-10-11T20:56:33.540 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock profile = high_recovery_ops 2023-10-11T20:56:33.540 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.541 INFO:teuthology.orchestra.run.smithi183.stdout: osd recover clone overlap = true 2023-10-11T20:56:33.541 INFO:teuthology.orchestra.run.smithi183.stdout: osd recovery max chunk = 1048576 2023-10-11T20:56:33.541 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.541 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug shutdown = true 2023-10-11T20:56:33.541 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug op order = true 2023-10-11T20:56:33.542 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify stray on activate = true 2023-10-11T20:56:33.542 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.542 INFO:teuthology.orchestra.run.smithi183.stdout: osd open classes on start = true 2023-10-11T20:56:33.542 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug pg log writeout = true 2023-10-11T20:56:33.543 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.543 INFO:teuthology.orchestra.run.smithi183.stdout: osd deep scrub update digest min age = 30 2023-10-11T20:56:33.543 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.543 INFO:teuthology.orchestra.run.smithi183.stdout: osd map max advance = 10 2023-10-11T20:56:33.544 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.544 INFO:teuthology.orchestra.run.smithi183.stdout: journal zero on create = true 2023-10-11T20:56:33.544 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.544 INFO:teuthology.orchestra.run.smithi183.stdout: filestore ondisk finisher threads = 3 2023-10-11T20:56:33.544 INFO:teuthology.orchestra.run.smithi183.stdout: filestore apply finisher threads = 3 2023-10-11T20:56:33.545 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.545 INFO:teuthology.orchestra.run.smithi183.stdout: bdev debug aio = true 2023-10-11T20:56:33.545 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug misdirected ops = true 2023-10-11T20:56:33.545 INFO:teuthology.orchestra.run.smithi183.stdout: bdev async discard = True 2023-10-11T20:56:33.545 INFO:teuthology.orchestra.run.smithi183.stdout: bdev enable discard = True 2023-10-11T20:56:33.546 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore block size = 96636764160 2023-10-11T20:56:33.546 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore fsck on mount = True 2023-10-11T20:56:33.546 INFO:teuthology.orchestra.run.smithi183.stdout: bluestore zero block detection = True 2023-10-11T20:56:33.546 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluefs = 1 2023-10-11T20:56:33.547 INFO:teuthology.orchestra.run.smithi183.stdout: debug bluestore = 1 2023-10-11T20:56:33.547 INFO:teuthology.orchestra.run.smithi183.stdout: debug monc = 20 2023-10-11T20:56:33.547 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-11T20:56:33.547 INFO:teuthology.orchestra.run.smithi183.stdout: debug osd = 20 2023-10-11T20:56:33.547 INFO:teuthology.orchestra.run.smithi183.stdout: debug rocksdb = 10 2023-10-11T20:56:33.548 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd backfillfull_ratio = 0.85 2023-10-11T20:56:33.548 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd full ratio = 0.9 2023-10-11T20:56:33.548 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd nearfull ratio = 0.8 2023-10-11T20:56:33.548 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify cached snaps = True 2023-10-11T20:56:33.549 INFO:teuthology.orchestra.run.smithi183.stdout: osd debug verify missing on start = True 2023-10-11T20:56:33.549 INFO:teuthology.orchestra.run.smithi183.stdout: osd failsafe full ratio = 0.95 2023-10-11T20:56:33.549 INFO:teuthology.orchestra.run.smithi183.stdout: osd fast shutdown = False 2023-10-11T20:56:33.549 INFO:teuthology.orchestra.run.smithi183.stdout: osd mclock override recovery settings = True 2023-10-11T20:56:33.549 INFO:teuthology.orchestra.run.smithi183.stdout: osd memory target = 1610612736 2023-10-11T20:56:33.550 INFO:teuthology.orchestra.run.smithi183.stdout: osd objectstore = bluestore 2023-10-11T20:56:33.550 INFO:teuthology.orchestra.run.smithi183.stdout: osd op queue = debug_random 2023-10-11T20:56:33.550 INFO:teuthology.orchestra.run.smithi183.stdout: osd op queue cut off = debug_random 2023-10-11T20:56:33.550 INFO:teuthology.orchestra.run.smithi183.stdout: osd shutdown pgref assert = True 2023-10-11T20:56:33.550 INFO:teuthology.orchestra.run.smithi183.stdout: osd_class_default_list = * 2023-10-11T20:56:33.551 INFO:teuthology.orchestra.run.smithi183.stdout: osd_class_load_list = * 2023-10-11T20:56:33.551 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.551 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr] 2023-10-11T20:56:33.552 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-11T20:56:33.552 INFO:teuthology.orchestra.run.smithi183.stdout: debug mgr = 20 2023-10-11T20:56:33.552 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-11T20:56:33.552 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-11T20:56:33.552 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-11T20:56:33.553 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-11T20:56:33.553 INFO:teuthology.orchestra.run.smithi183.stdout: mgr/telemetry/nag = false 2023-10-11T20:56:33.553 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.554 INFO:teuthology.orchestra.run.smithi183.stdout:[mon] 2023-10-11T20:56:33.554 INFO:teuthology.orchestra.run.smithi183.stdout: debug ms = 1 2023-10-11T20:56:33.554 INFO:teuthology.orchestra.run.smithi183.stdout: debug mon = 20 2023-10-11T20:56:33.554 INFO:teuthology.orchestra.run.smithi183.stdout: debug paxos = 20 2023-10-11T20:56:33.554 INFO:teuthology.orchestra.run.smithi183.stdout: debug auth = 20 2023-10-11T20:56:33.555 INFO:teuthology.orchestra.run.smithi183.stdout: mon data avail warn = 5 2023-10-11T20:56:33.555 INFO:teuthology.orchestra.run.smithi183.stdout: mon mgr mkfs grace = 240 2023-10-11T20:56:33.555 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min pgs per osd = 4 2023-10-11T20:56:33.555 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd reporter subtree level = osd 2023-10-11T20:56:33.555 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd prime pg temp = true 2023-10-11T20:56:33.556 INFO:teuthology.orchestra.run.smithi183.stdout: mon reweight min bytes per osd = 10 2023-10-11T20:56:33.556 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.556 INFO:teuthology.orchestra.run.smithi183.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-11T20:56:33.556 INFO:teuthology.orchestra.run.smithi183.stdout: auth mon ticket ttl = 660 # 11m 2023-10-11T20:56:33.557 INFO:teuthology.orchestra.run.smithi183.stdout: auth service ticket ttl = 240 # 4m 2023-10-11T20:56:33.557 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.557 INFO:teuthology.orchestra.run.smithi183.stdout: # don't complain about insecure global_id in the test suite 2023-10-11T20:56:33.557 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-11T20:56:33.558 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-11T20:56:33.558 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.558 INFO:teuthology.orchestra.run.smithi183.stdout: # 1m isn't quite enough 2023-10-11T20:56:33.558 INFO:teuthology.orchestra.run.smithi183.stdout: mon_down_mkfs_grace = 2m 2023-10-11T20:56:33.558 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.559 INFO:teuthology.orchestra.run.smithi183.stdout: mon_warn_on_filestore_osds = false 2023-10-11T20:56:33.559 INFO:teuthology.orchestra.run.smithi183.stdout: mon min osdmap epochs = 50 2023-10-11T20:56:33.559 INFO:teuthology.orchestra.run.smithi183.stdout: mon osd crush smoke test = False 2023-10-11T20:56:33.559 INFO:teuthology.orchestra.run.smithi183.stdout: mon osdmap full prune interval = 2 2023-10-11T20:56:33.560 INFO:teuthology.orchestra.run.smithi183.stdout: mon osdmap full prune min = 15 2023-10-11T20:56:33.560 INFO:teuthology.orchestra.run.smithi183.stdout: mon osdmap full prune txsize = 2 2023-10-11T20:56:33.560 INFO:teuthology.orchestra.run.smithi183.stdout: mon scrub interval = 300 2023-10-11T20:56:33.560 INFO:teuthology.orchestra.run.smithi183.stdout: paxos service trim min = 10 2023-10-11T20:56:33.561 INFO:teuthology.orchestra.run.smithi183.stdout: 2023-10-11T20:56:33.561 INFO:teuthology.orchestra.run.smithi183.stdout:[client] 2023-10-11T20:56:33.561 INFO:teuthology.orchestra.run.smithi183.stdout: rgw cache enabled = true 2023-10-11T20:56:33.561 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable ops log = true 2023-10-11T20:56:33.562 INFO:teuthology.orchestra.run.smithi183.stdout: rgw enable usage log = true 2023-10-11T20:56:33.562 INFO:teuthology.orchestra.run.smithi183.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-11T20:56:33.562 INFO:teuthology.orchestra.run.smithi183.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-11T20:56:33.562 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.a] 2023-10-11T20:56:33.562 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.c] 2023-10-11T20:56:33.563 INFO:teuthology.orchestra.run.smithi183.stdout:[mon.b] 2023-10-11T20:56:33.564 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2023-10-11T20:56:33.565 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2023-10-11T20:56:33.565 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-11T20:56:33.565 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2023-10-11T20:56:33.565 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.565 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2023-10-11T20:56:33.566 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.566 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2023-10-11T20:56:33.566 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.566 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2023-10-11T20:56:33.567 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2023-10-11T20:56:33.567 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.567 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2023-10-11T20:56:33.567 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2023-10-11T20:56:33.568 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.568 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-11T20:56:33.568 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2023-10-11T20:56:33.568 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.568 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2023-10-11T20:56:33.569 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-11T20:56:33.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.569 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2023-10-11T20:56:33.569 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.570 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2023-10-11T20:56:33.570 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2023-10-11T20:56:33.570 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2023-10-11T20:56:33.570 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2023-10-11T20:56:33.570 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2023-10-11T20:56:33.571 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2023-10-11T20:56:33.571 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2023-10-11T20:56:33.571 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-11T20:56:33.571 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-11T20:56:33.571 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2023-10-11T20:56:33.572 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.572 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-11T20:56:33.572 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.572 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2023-10-11T20:56:33.573 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.573 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2023-10-11T20:56:33.573 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.574 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2023-10-11T20:56:33.574 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2023-10-11T20:56:33.575 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2023-10-11T20:56:33.575 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "[v1:172.21.15.22:6789],[v1:172.21.15.22:6790],[v1:172.21.15.183:6789]" 2023-10-11T20:56:33.575 INFO:teuthology.orchestra.run.smithi022.stdout: mon client directed command retry = 5 2023-10-11T20:56:33.576 INFO:teuthology.orchestra.run.smithi022.stdout: mon election default strategy = 1 2023-10-11T20:56:33.576 INFO:teuthology.orchestra.run.smithi022.stdout: ms bind msgr2 = False 2023-10-11T20:56:33.576 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject socket failures = 5000 2023-10-11T20:56:33.576 INFO:teuthology.orchestra.run.smithi022.stdout: ms type = async 2023-10-11T20:56:33.576 INFO:teuthology.orchestra.run.smithi022.stdout: osd heartbeat grace = 80 2023-10-11T20:56:33.577 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = bae0e1e0-30c1-4b31-993c-2e12cbe45466 2023-10-11T20:56:33.577 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.577 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2023-10-11T20:56:33.577 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2023-10-11T20:56:33.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.578 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2023-10-11T20:56:33.578 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2023-10-11T20:56:33.578 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2023-10-11T20:56:33.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.579 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2023-10-11T20:56:33.579 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2023-10-11T20:56:33.579 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.579 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2023-10-11T20:56:33.579 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2023-10-11T20:56:33.580 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2023-10-11T20:56:33.580 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.580 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2023-10-11T20:56:33.580 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2023-10-11T20:56:33.580 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.581 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2023-10-11T20:56:33.581 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.581 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2023-10-11T20:56:33.582 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.582 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2023-10-11T20:56:33.583 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.583 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2023-10-11T20:56:33.583 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2023-10-11T20:56:33.583 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2023-10-11T20:56:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2023-10-11T20:56:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: bdev async discard = True 2023-10-11T20:56:33.584 INFO:teuthology.orchestra.run.smithi022.stdout: bdev enable discard = True 2023-10-11T20:56:33.585 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2023-10-11T20:56:33.585 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2023-10-11T20:56:33.585 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore zero block detection = True 2023-10-11T20:56:33.585 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 1 2023-10-11T20:56:33.586 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 1 2023-10-11T20:56:33.586 INFO:teuthology.orchestra.run.smithi022.stdout: debug monc = 20 2023-10-11T20:56:33.586 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-11T20:56:33.586 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2023-10-11T20:56:33.587 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 10 2023-10-11T20:56:33.587 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2023-10-11T20:56:33.587 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2023-10-11T20:56:33.587 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2023-10-11T20:56:33.588 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify cached snaps = True 2023-10-11T20:56:33.588 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify missing on start = True 2023-10-11T20:56:33.589 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2023-10-11T20:56:33.589 INFO:teuthology.orchestra.run.smithi022.stdout: osd fast shutdown = False 2023-10-11T20:56:33.589 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock override recovery settings = True 2023-10-11T20:56:33.589 INFO:teuthology.orchestra.run.smithi022.stdout: osd memory target = 1610612736 2023-10-11T20:56:33.590 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2023-10-11T20:56:33.590 INFO:teuthology.orchestra.run.smithi022.stdout: osd op queue = debug_random 2023-10-11T20:56:33.590 INFO:teuthology.orchestra.run.smithi022.stdout: osd op queue cut off = debug_random 2023-10-11T20:56:33.590 INFO:teuthology.orchestra.run.smithi022.stdout: osd shutdown pgref assert = True 2023-10-11T20:56:33.591 INFO:teuthology.orchestra.run.smithi022.stdout: osd_class_default_list = * 2023-10-11T20:56:33.591 INFO:teuthology.orchestra.run.smithi022.stdout: osd_class_load_list = * 2023-10-11T20:56:33.591 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.591 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2023-10-11T20:56:33.591 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-11T20:56:33.592 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2023-10-11T20:56:33.592 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-10-11T20:56:33.592 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-10-11T20:56:33.592 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-10-11T20:56:33.592 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-10-11T20:56:33.593 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2023-10-11T20:56:33.593 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.593 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2023-10-11T20:56:33.593 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2023-10-11T20:56:33.594 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2023-10-11T20:56:33.594 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2023-10-11T20:56:33.595 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2023-10-11T20:56:33.595 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2023-10-11T20:56:33.595 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2023-10-11T20:56:33.596 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2023-10-11T20:56:33.596 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2023-10-11T20:56:33.596 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2023-10-11T20:56:33.596 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2023-10-11T20:56:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-11T20:56:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2023-10-11T20:56:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2023-10-11T20:56:33.597 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.598 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2023-10-11T20:56:33.598 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-11T20:56:33.598 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-11T20:56:33.598 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.598 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2023-10-11T20:56:33.599 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2023-10-11T20:56:33.599 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.599 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2023-10-11T20:56:33.599 INFO:teuthology.orchestra.run.smithi022.stdout: mon min osdmap epochs = 50 2023-10-11T20:56:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd crush smoke test = False 2023-10-11T20:56:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: mon osdmap full prune interval = 2 2023-10-11T20:56:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: mon osdmap full prune min = 15 2023-10-11T20:56:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: mon osdmap full prune txsize = 2 2023-10-11T20:56:33.600 INFO:teuthology.orchestra.run.smithi022.stdout: mon scrub interval = 300 2023-10-11T20:56:33.601 INFO:teuthology.orchestra.run.smithi022.stdout: paxos service trim min = 10 2023-10-11T20:56:33.601 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:56:33.601 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2023-10-11T20:56:33.601 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2023-10-11T20:56:33.602 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2023-10-11T20:56:33.602 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2023-10-11T20:56:33.602 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-11T20:56:33.603 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-11T20:56:33.603 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2023-10-11T20:56:33.603 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2023-10-11T20:56:33.603 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2023-10-11T20:56:33.604 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-11T20:56:33.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-11T20:56:33.663 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-11T20:56:33.663 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:33.664 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-11T20:56:33.679 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:33.680 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-11T20:56:33.734 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:56:33.734 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:33.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-11T20:56:33.735 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T20:56:33.820 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:56:33.821 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:33.875 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:56:33.876 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:33.876 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-11T20:56:33.876 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-11T20:56:33.916 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:56:33.916 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:33.970 INFO:tasks.ceph:Setting up mon nodes... 2023-10-11T20:56:33.971 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-11T20:56:33.971 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-11T20:56:34.033 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-11T20:56:34.036 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-11T20:56:34.095 INFO:teuthology.orchestra.run.smithi183.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-11T20:56:34.098 INFO:tasks.ceph:Setting up mds nodes... 2023-10-11T20:56:34.098 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-11T20:56:34.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-11T20:56:34.145 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-11T20:56:34.164 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-11T20:56:34.206 INFO:teuthology.orchestra.run.smithi183.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-11T20:56:34.222 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-11T20:56:34.222 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi183.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-11T20:56:34.222 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-11T20:56:34.253 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:34.254 INFO:tasks.ceph:role: osd.0 2023-10-11T20:56:34.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:56:34.254 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-11T20:56:34.323 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:34.324 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:34.324 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:34.324 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:34.324 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:34.325 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:34.325 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:34.325 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:34.325 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:34.325 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:34.356 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-11T20:56:34.358 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-11T20:56:34.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-11T20:56:34.435 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-11T20:56:34.510 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-11T20:56:34.580 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:34.581 INFO:tasks.ceph:role: osd.1 2023-10-11T20:56:34.581 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:56:34.581 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-11T20:56:34.650 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:34.650 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:34.651 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:34.651 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:34.651 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:34.651 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:34.651 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:34.652 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:34.652 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:34.652 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:34.683 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-11T20:56:34.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-11T20:56:34.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-11T20:56:34.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-11T20:56:34.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-11T20:56:34.905 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:34.905 INFO:tasks.ceph:role: osd.2 2023-10-11T20:56:34.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:56:34.906 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-11T20:56:34.976 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:34.976 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:34.976 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:34.977 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:34.977 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:34.977 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:34.977 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:34.977 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:34.978 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:34.978 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:35.008 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-11T20:56:35.010 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-11T20:56:35.010 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-11T20:56:35.086 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-11T20:56:35.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-11T20:56:35.237 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:35.237 INFO:tasks.ceph:role: osd.3 2023-10-11T20:56:35.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-11T20:56:35.238 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-11T20:56:35.308 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:35.308 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:35.308 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:35.308 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:35.309 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:35.309 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:35.309 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:35.309 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:35.309 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:35.310 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:35.340 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2023-10-11T20:56:35.342 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2023-10-11T20:56:35.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-11T20:56:35.416 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-11T20:56:35.491 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:35.613 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.612+0000 7fd735e0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-11T20:56:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.612+0000 7fd735e0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-11T20:56:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.612+0000 7fd735e0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-11T20:56:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.612+0000 7fd735e0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-11T20:56:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.612+0000 7fd735e0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-11T20:56:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:35.613+0000 7fd735e0c500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-11T20:56:38.452 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-11T20:56:38.488 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-11T20:56:38.583 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-11T20:56:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-11T20:56:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-11T20:56:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-11T20:56:38.584 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:38.582+0000 7fc095667500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-11T20:56:41.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-11T20:56:41.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-11T20:56:41.555 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-11T20:56:41.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-11T20:56:41.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-11T20:56:41.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-11T20:56:41.556 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:41.554+0000 7f027200e500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-11T20:56:44.392 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-11T20:56:44.428 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.523+0000 7f56c0014500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-11T20:56:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.523+0000 7f56c0014500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-11T20:56:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.523+0000 7f56c0014500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-11T20:56:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.523+0000 7f56c0014500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-11T20:56:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.523+0000 7f56c0014500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-11T20:56:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2023-10-11T20:56:44.524+0000 7f56c0014500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-11T20:56:47.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-11T20:56:47.404 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-11T20:56:47.437 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:47.437 INFO:tasks.ceph:role: osd.4 2023-10-11T20:56:47.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:56:47.438 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-11T20:56:47.514 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:47.514 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:47.515 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:47.515 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:47.515 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:47.515 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:47.515 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:47.516 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:47.516 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:47.516 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:48.028 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-11T20:56:48.030 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-11T20:56:48.030 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-11T20:56:48.181 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-11T20:56:48.216 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-11T20:56:48.284 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:48.285 INFO:tasks.ceph:role: osd.5 2023-10-11T20:56:48.285 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:56:48.285 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-11T20:56:48.359 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:48.360 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:48.360 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:48.360 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:48.360 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:48.361 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:48.361 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:48.361 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:48.361 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:48.817 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-11T20:56:48.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-11T20:56:48.820 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-11T20:56:48.915 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-11T20:56:48.949 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-11T20:56:49.017 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:49.018 INFO:tasks.ceph:role: osd.6 2023-10-11T20:56:49.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:56:49.018 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-11T20:56:49.093 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:49.093 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:49.093 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:49.094 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:49.094 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:49.094 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:49.094 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:49.094 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:49.095 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:49.095 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:49.581 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-11T20:56:49.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-11T20:56:49.583 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-11T20:56:49.738 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-11T20:56:49.774 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-11T20:56:49.844 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-11T20:56:49.844 INFO:tasks.ceph:role: osd.7 2023-10-11T20:56:49.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-11T20:56:49.845 DEBUG:teuthology.orchestra.run.smithi183:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-11T20:56:49.921 INFO:teuthology.orchestra.run.smithi183.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-11T20:56:49.921 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-11T20:56:49.922 INFO:teuthology.orchestra.run.smithi183.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-11T20:56:49.922 INFO:teuthology.orchestra.run.smithi183.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-11T20:56:49.922 INFO:teuthology.orchestra.run.smithi183.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-11T20:56:49.922 INFO:teuthology.orchestra.run.smithi183.stdout: = sunit=0 swidth=0 blks 2023-10-11T20:56:49.922 INFO:teuthology.orchestra.run.smithi183.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-11T20:56:49.923 INFO:teuthology.orchestra.run.smithi183.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-11T20:56:49.923 INFO:teuthology.orchestra.run.smithi183.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-11T20:56:49.923 INFO:teuthology.orchestra.run.smithi183.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-11T20:56:50.404 INFO:teuthology.orchestra.run.smithi183.stdout:Discarding blocks...Done. 2023-10-11T20:56:50.406 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi183.front.sepia.ceph.com -o noatime 2023-10-11T20:56:50.406 DEBUG:teuthology.orchestra.run.smithi183:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-11T20:56:50.544 DEBUG:teuthology.orchestra.run.smithi183:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-11T20:56:50.580 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:50.705 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.703+0000 7f8babd29500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-11T20:56:50.706 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.703+0000 7f8babd29500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-11T20:56:50.706 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.703+0000 7f8babd29500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-11T20:56:50.706 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.703+0000 7f8babd29500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-11T20:56:50.706 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.703+0000 7f8babd29500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-11T20:56:50.707 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:50.704+0000 7f8babd29500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-11T20:56:53.555 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-11T20:56:53.586 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:53.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.679+0000 7fe2228a9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-11T20:56:53.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.680+0000 7fe2228a9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-11T20:56:53.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.680+0000 7fe2228a9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-11T20:56:53.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.680+0000 7fe2228a9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-11T20:56:53.680 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.680+0000 7fe2228a9500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-11T20:56:53.681 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:53.680+0000 7fe2228a9500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-11T20:56:56.528 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-11T20:56:56.560 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:56.650 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.649+0000 7f6b2b09c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-11T20:56:56.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.649+0000 7f6b2b09c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-11T20:56:56.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.649+0000 7f6b2b09c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-11T20:56:56.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.649+0000 7f6b2b09c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-11T20:56:56.651 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.649+0000 7f6b2b09c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-11T20:56:56.652 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:56.650+0000 7f6b2b09c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-11T20:56:59.508 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-11T20:56:59.540 DEBUG:teuthology.orchestra.run.smithi183:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:56:59.630 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.629+0000 7fe8aba0c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-11T20:56:59.631 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.629+0000 7fe8aba0c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-11T20:56:59.631 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.629+0000 7fe8aba0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-11T20:56:59.631 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.629+0000 7fe8aba0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-11T20:56:59.631 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.629+0000 7fe8aba0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-11T20:56:59.632 INFO:teuthology.orchestra.run.smithi183.stderr:2023-10-11T20:56:59.630+0000 7fe8aba0c500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-11T20:57:02.475 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-11T20:57:02.507 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-11T20:57:02.507 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:02.507 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-11T20:57:02.544 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:02.545 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-11T20:57:02.618 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:02.619 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-11T20:57:02.691 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:02.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-11T20:57:02.764 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:02.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-11T20:57:02.836 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:02.837 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-11T20:57:02.868 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:02.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-11T20:57:02.940 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:02.940 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-11T20:57:03.009 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:03.010 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-11T20:57:03.078 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:03.079 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-11T20:57:03.147 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:03.147 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-11T20:57:03.165 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:03.165 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-11T20:57:03.202 INFO:tasks.ceph:Adding keys to all mons... 2023-10-11T20:57:03.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-11T20:57:03.207 DEBUG:teuthology.orchestra.run.smithi183:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-11T20:57:03.246 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2023-10-11T20:57:03.247 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQACDCdlkkMAAhAAP6G2oZ1kB19DTK+yt6xGqA== 2023-10-11T20:57:03.247 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2023-10-11T20:57:03.247 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQADDCdl51qMJBAA8hP6KcxcAd5DCNX8LHFQsA== 2023-10-11T20:57:03.247 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2023-10-11T20:57:03.248 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAGDCdlN7y8IhAAscevO2XI0Ggl+zxIVGO+6Q== 2023-10-11T20:57:03.248 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2023-10-11T20:57:03.248 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAJDCdlhHATIRAADweyI9Vi29tkXEXFjXWMTQ== 2023-10-11T20:57:03.248 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2023-10-11T20:57:03.249 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAMDCdloHk9HxAAjA9X5o3dK/6ySCSsuMzO9w== 2023-10-11T20:57:03.249 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2023-10-11T20:57:03.249 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQACDCdlXByxBRAA4zTUKnTAmNxT2Wn1gq63Iw== 2023-10-11T20:57:03.249 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2023-10-11T20:57:03.249 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQASDCdlupb7KRAAjl1pukbvQRldrIKTGvtmrg== 2023-10-11T20:57:03.250 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2023-10-11T20:57:03.250 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAVDCdlat6DKBAAudExsO4e9HCZ3ZJZTjFjyQ== 2023-10-11T20:57:03.250 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2023-10-11T20:57:03.250 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAYDCdlMh7IJhAAqXHzLN02olD8IhzfvJGqDg== 2023-10-11T20:57:03.250 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2023-10-11T20:57:03.251 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAbDCdlQaWTJRAAj2+2aUW0yqEwaB22QCPQBg== 2023-10-11T20:57:03.251 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2023-10-11T20:57:03.251 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQACDCdlRq+qCBAAEo180hL5wrP/vishF0Kiyw== 2023-10-11T20:57:03.251 INFO:teuthology.orchestra.run.smithi022.stdout:[client.1] 2023-10-11T20:57:03.252 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQACDCdlsbxPDBAAXnHZSiAcoKrJcuw+GcK26Q== 2023-10-11T20:57:03.268 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.y] 2023-10-11T20:57:03.268 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQACDCdlkkMAAhAAP6G2oZ1kB19DTK+yt6xGqA== 2023-10-11T20:57:03.269 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.0] 2023-10-11T20:57:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQADDCdl51qMJBAA8hP6KcxcAd5DCNX8LHFQsA== 2023-10-11T20:57:03.269 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.1] 2023-10-11T20:57:03.269 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAGDCdlN7y8IhAAscevO2XI0Ggl+zxIVGO+6Q== 2023-10-11T20:57:03.269 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.2] 2023-10-11T20:57:03.270 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAJDCdlhHATIRAADweyI9Vi29tkXEXFjXWMTQ== 2023-10-11T20:57:03.270 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.3] 2023-10-11T20:57:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAMDCdloHk9HxAAjA9X5o3dK/6ySCSsuMzO9w== 2023-10-11T20:57:03.271 INFO:teuthology.orchestra.run.smithi183.stdout:[mgr.x] 2023-10-11T20:57:03.271 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQACDCdlXByxBRAA4zTUKnTAmNxT2Wn1gq63Iw== 2023-10-11T20:57:03.272 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.4] 2023-10-11T20:57:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQASDCdlupb7KRAAjl1pukbvQRldrIKTGvtmrg== 2023-10-11T20:57:03.272 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.5] 2023-10-11T20:57:03.272 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAVDCdlat6DKBAAudExsO4e9HCZ3ZJZTjFjyQ== 2023-10-11T20:57:03.272 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.6] 2023-10-11T20:57:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAYDCdlMh7IJhAAqXHzLN02olD8IhzfvJGqDg== 2023-10-11T20:57:03.273 INFO:teuthology.orchestra.run.smithi183.stdout:[osd.7] 2023-10-11T20:57:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQAbDCdlQaWTJRAAj2+2aUW0yqEwaB22QCPQBg== 2023-10-11T20:57:03.273 INFO:teuthology.orchestra.run.smithi183.stdout:[client.0] 2023-10-11T20:57:03.273 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQACDCdlRq+qCBAAEo180hL5wrP/vishF0Kiyw== 2023-10-11T20:57:03.274 INFO:teuthology.orchestra.run.smithi183.stdout:[client.1] 2023-10-11T20:57:03.274 INFO:teuthology.orchestra.run.smithi183.stdout: key = AQACDCdlsbxPDBAAXnHZSiAcoKrJcuw+GcK26Q== 2023-10-11T20:57:03.275 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-11T20:57:03.296 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-11T20:57:03.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.370 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.427 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.429 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.484 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.486 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.539 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.542 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.594 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-11T20:57:03.597 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-11T20:57:03.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.653 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.709 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.761 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.764 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.817 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.820 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-11T20:57:03.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T20:57:03.875 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T20:57:03.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T20:57:03.935 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-11T20:57:03.992 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-11T20:57:03.992 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-11T20:57:04.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-11T20:57:04.123 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-11T20:57:04.153 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-11T20:57:04.224 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-11T20:57:04.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-11T20:57:04.355 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-11T20:57:04.382 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-11T20:57:04.479 DEBUG:teuthology.orchestra.run.smithi183:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-11T20:57:04.506 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:57:04.509 DEBUG:teuthology.orchestra.run.smithi183:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-11T20:57:04.560 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-11T20:57:04.561 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-11T20:57:04.561 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-11T20:57:04.562 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2023-10-11T20:57:04.564 INFO:tasks.ceph.mon.a:Started 2023-10-11T20:57:04.565 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-11T20:57:04.565 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-11T20:57:04.565 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2023-10-11T20:57:04.567 INFO:tasks.ceph.mon.c:Started 2023-10-11T20:57:04.568 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2023-10-11T20:57:04.568 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-11T20:57:04.569 DEBUG:teuthology.orchestra.run.smithi183:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2023-10-11T20:57:04.603 INFO:tasks.ceph.mon.b:Started 2023-10-11T20:57:04.604 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-11T20:57:04.604 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-11T20:57:04.605 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2023-10-11T20:57:04.607 INFO:tasks.ceph.mgr.y:Started 2023-10-11T20:57:04.608 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-11T20:57:04.608 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2023-10-11T20:57:04.610 INFO:tasks.ceph.mgr.x:Started 2023-10-11T20:57:04.610 INFO:tasks.ceph:Setting crush tunables to default 2023-10-11T20:57:04.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2023-10-11T20:57:12.228 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:00:07.504 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:12.541 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:00:07.817 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:12.797 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:00:08.124 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:12.802 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:00:08.129 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:13.131 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:00:08.457 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:13.136 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:00:08.463 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:57:23.571 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2023-10-11T20:57:23.582 INFO:tasks.ceph:check_enable_crimson: False 2023-10-11T20:57:23.583 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-11T20:57:23.583 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:23.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-11T20:57:23.615 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:23.615 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-11T20:57:23.687 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:23.687 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-11T20:57:23.758 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:57:23.758 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-11T20:57:23.797 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:23.795+0000 7f8f15352040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-11T20:57:23.813 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:23.812+0000 7ff72d42b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-11T20:57:23.828 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:23.828 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-11T20:57:23.854 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:23.853+0000 7f8f15352040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-11T20:57:23.856 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:23.856 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-11T20:57:23.871 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:23.870+0000 7ff72d42b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-11T20:57:23.897 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:23.898 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-11T20:57:23.964 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2023-10-11T20:57:23.965 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-11T20:57:24.032 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 0db31795-9ebe-4ff5-99f1-4fc5e5316716 0 2023-10-11T20:57:24.398 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.397+0000 7f8f15352040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-11T20:57:24.439 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.438+0000 7ff72d42b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-11T20:57:24.454 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.452+0000 7f8f15352040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-11T20:57:24.493 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.492+0000 7ff72d42b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-11T20:57:24.522 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.520+0000 7f8f15352040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-11T20:57:24.537 INFO:teuthology.orchestra.run.smithi183.stdout:0 2023-10-11T20:57:24.548 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new bac1e611-b7cf-456c-a53d-a93591a7e1ca 1 2023-10-11T20:57:24.551 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.549+0000 7ff72d42b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-11T20:57:24.579 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.577+0000 7f8f15352040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-11T20:57:24.617 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.616+0000 7ff72d42b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-11T20:57:24.624 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.622+0000 7f8f15352040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-11T20:57:24.661 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.660+0000 7ff72d42b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-11T20:57:24.750 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.749+0000 7f8f15352040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-11T20:57:24.765 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.765+0000 7ff72d42b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-11T20:57:24.824 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.822+0000 7f8f15352040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-11T20:57:24.836 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.835+0000 7ff72d42b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-11T20:57:24.874 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.872+0000 7f8f15352040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-11T20:57:24.883 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.882+0000 7ff72d42b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-11T20:57:24.934 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.933+0000 7f8f15352040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-11T20:57:24.935 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.934+0000 7ff72d42b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-11T20:57:24.961 INFO:teuthology.orchestra.run.smithi183.stdout:1 2023-10-11T20:57:24.972 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new ea34afad-62a6-4c5d-af58-60cfe1770aa5 2 2023-10-11T20:57:24.984 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:24.983+0000 7ff72d42b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-11T20:57:24.987 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:24.986+0000 7f8f15352040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-11T20:57:25.321 INFO:teuthology.orchestra.run.smithi183.stdout:2 2023-10-11T20:57:25.334 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new cc05f381-3aac-4116-ac22-612b6d5dd0f6 3 2023-10-11T20:57:25.373 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.372+0000 7ff72d42b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-11T20:57:25.394 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.392+0000 7f8f15352040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-11T20:57:25.515 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.514+0000 7ff72d42b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-11T20:57:25.539 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.538+0000 7f8f15352040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-11T20:57:25.636 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.634+0000 7ff72d42b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-11T20:57:25.671 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.670+0000 7f8f15352040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-11T20:57:25.682 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.681+0000 7ff72d42b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-11T20:57:25.716 INFO:teuthology.orchestra.run.smithi183.stdout:3 2023-10-11T20:57:25.722 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.720+0000 7f8f15352040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-11T20:57:25.728 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 4585ef06-a109-4750-8c12-5b7092791065 4 2023-10-11T20:57:25.784 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.783+0000 7ff72d42b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-11T20:57:25.825 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.824+0000 7f8f15352040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-11T20:57:25.883 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:25.882+0000 7ff72d42b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-11T20:57:25.927 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:25.925+0000 7f8f15352040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-11T20:57:26.026 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:26.025+0000 7ff72d42b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-11T20:57:26.071 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:26.070+0000 7ff72d42b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-11T20:57:26.074 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:26.072+0000 7f8f15352040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-11T20:57:26.120 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:26.118+0000 7f8f15352040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-11T20:57:26.217 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:26.216+0000 7ff72d42b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-11T20:57:26.228 INFO:teuthology.orchestra.run.smithi183.stdout:4 2023-10-11T20:57:26.239 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 4d3653f9-a201-494f-a5cc-0073380f6207 5 2023-10-11T20:57:26.272 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:26.270+0000 7f8f15352040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-11T20:57:26.600 INFO:teuthology.orchestra.run.smithi183.stdout:5 2023-10-11T20:57:26.611 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new f9a57a70-534e-41fd-8779-c306f05d0d12 6 2023-10-11T20:57:26.969 INFO:teuthology.orchestra.run.smithi183.stdout:6 2023-10-11T20:57:26.981 DEBUG:teuthology.orchestra.run.smithi183:> sudo ceph --cluster ceph osd new 319c2148-5202-4238-959b-29a30a7765de 7 2023-10-11T20:57:27.042 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:27.041+0000 7ff72d42b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-11T20:57:27.115 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:27.113+0000 7f8f15352040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-11T20:57:27.323 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:27.322+0000 7ff72d42b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-11T20:57:27.375 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:27.374+0000 7ff72d42b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-11T20:57:27.376 INFO:teuthology.orchestra.run.smithi183.stdout:7 2023-10-11T20:57:27.387 DEBUG:tasks.ceph_manager:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.387 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-11T20:57:27.387 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 2023-10-11T20:57:27.390 INFO:tasks.ceph.osd.0:Started 2023-10-11T20:57:27.390 DEBUG:tasks.ceph_manager:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.390 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-11T20:57:27.391 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 2023-10-11T20:57:27.393 INFO:tasks.ceph.osd.1:Started 2023-10-11T20:57:27.393 DEBUG:tasks.ceph_manager:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.394 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-11T20:57:27.394 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 2023-10-11T20:57:27.396 INFO:tasks.ceph.osd.2:Started 2023-10-11T20:57:27.397 DEBUG:tasks.ceph_manager:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.397 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-11T20:57:27.397 DEBUG:teuthology.orchestra.run.smithi022:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 2023-10-11T20:57:27.400 INFO:tasks.ceph.osd.3:Started 2023-10-11T20:57:27.400 DEBUG:tasks.ceph_manager:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.400 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-11T20:57:27.401 DEBUG:teuthology.orchestra.run.smithi183:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4 2023-10-11T20:57:27.403 INFO:tasks.ceph.osd.4:Started 2023-10-11T20:57:27.403 DEBUG:tasks.ceph_manager:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.403 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-11T20:57:27.404 DEBUG:teuthology.orchestra.run.smithi183:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 2023-10-11T20:57:27.405 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:27.402+0000 7f8f15352040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-11T20:57:27.406 INFO:tasks.ceph.osd.5:Started 2023-10-11T20:57:27.407 DEBUG:tasks.ceph_manager:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.407 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-11T20:57:27.407 DEBUG:teuthology.orchestra.run.smithi183:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 2023-10-11T20:57:27.409 INFO:tasks.ceph.osd.6:Started 2023-10-11T20:57:27.410 DEBUG:tasks.ceph_manager:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck'] 2023-10-11T20:57:27.410 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-11T20:57:27.410 DEBUG:teuthology.orchestra.run.smithi183:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 2023-10-11T20:57:27.412 INFO:tasks.ceph.osd.7:Started 2023-10-11T20:57:27.413 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T20:57:27.479 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:27.477+0000 7f8f15352040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-11T20:57:27.498 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:27.497+0000 7ff72d42b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-11T20:57:27.668 INFO:tasks.ceph.mgr.y.smithi022.stderr:2023-10-11T20:57:27.667+0000 7f8f15352040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-11T20:57:28.414 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:57:28.414 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:57:28.431 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-11T20:57:28.432 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-11T20:57:29.238 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:57:29.279 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:29.278+0000 7ff6ce137640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-11T20:57:29.588 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T20:57:29.587+0000 7ff6ce137640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-11T20:57:30.942 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:57:30.943 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:57:30.959 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-11T20:57:34.984 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:07.516 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.021 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:07.531 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.046 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:07.578 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.071 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:07.599 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.083 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:07.592 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.132 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:07.660 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.182 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:07.689 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.240 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:07.747 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.586 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T20:57:35.579+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:35.615 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:08.129 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.637 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T20:57:35.628+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:35.655 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:08.183 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.678 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:08.193 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.691 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T20:57:35.682+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:35.720 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:08.249 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.822 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T20:57:35.815+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:35.881 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:08.399 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.942 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:08.460 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:35.999 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:08.521 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.017 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:08.549 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.062 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:08.583 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.085 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:08.594 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.119 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:08.647 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.221 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T20:57:36.213+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:36.255 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:08.762 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.262 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T20:57:36.255+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:36.365 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:08.897 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.439 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:08.948 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.478 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:09.006 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.521 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T20:57:36.513+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:36.600 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:09.107 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.646 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T20:57:36.638+0000 5dc2340 -1 Falling back to public interface 2023-10-11T20:57:36.694 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:09.208 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.694 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:09.223 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.724 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:09.256 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.794 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:09.303 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.836 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:09.364 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.952 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:09.459 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:36.959 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:09.478 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.018 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:09.550 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.046 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:09.560 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.049 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:09.578 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.091 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:09.601 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.094 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:09.615 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.123 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:09.651 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.216 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:09.737 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.239 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:09.746 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.282 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:09.814 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.307 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:09.825 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.360 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:09.869 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.370 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:09.885 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.382 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:09.910 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.393 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:09.921 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.504 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:10.011 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.533 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:10.054 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.546 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:10.078 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.622 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:10.141 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.628 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:10.138 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.644 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:10.159 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.647 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:10.175 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.661 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:10.189 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.764 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:57:37.775 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:10.282 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.805 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:10.326 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.814 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:10.346 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.893 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:10.402 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.905 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:10.423 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.926 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:10.454 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.927 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:10.441 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:37.933 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:10.461 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.046 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:10.553 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.074 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:10.595 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.078 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:10.610 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.158 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:10.667 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.173 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:10.691 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.196 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:10.711 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.197 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:10.725 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.202 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:10.730 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.311 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:10.818 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.339 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:10.860 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.348 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:10.880 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.354 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:57:38.354 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:57:38.365 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-11T20:57:38.426 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:10.935 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.444 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:10.962 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.466 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:10.994 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.469 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:10.984 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.474 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:11.002 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.576 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:11.083 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.604 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:11.125 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.709 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:11.227 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.745 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:11.260 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.745 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:11.273 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.819 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:11.351 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.870 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:11.391 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.882 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:11.414 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.922 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:11.432 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.946 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:11.474 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.977 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:11.495 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:38.977 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:11.486 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.000 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:11.528 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.013 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:11.541 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.017 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:11.531 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.053 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:11.559 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.106 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:11.613 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.149 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:11.670 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.242 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:11.760 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.501 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:12.016 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.536 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:12.064 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.576 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:12.091 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.627 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:12.156 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.652 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:12.173 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.713 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:12.234 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.816 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:12.335 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:39.906 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:12.425 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:43.982 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:16.514 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:44.220 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:16.729 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:44.285 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:16.813 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:44.378 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:16.884 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:45.109 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:17.638 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:45.171 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:57:45.285 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:17.800 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:45.438 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:17.959 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:45.907 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:57:45.907 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:57:45.923 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-11T20:57:45.936 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:18.455 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:48.958 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:21.490 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:48.963 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:21.496 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.046 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:21.574 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.050 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:21.578 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.126 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:21.635 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.130 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:21.639 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.236 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:21.743 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:49.240 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:21.747 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.341 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:22.855 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.345 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:22.859 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.370 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:22.891 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.374 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:22.895 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.471 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:22.999 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:50.475 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:23.003 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:51.005 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:23.523 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:51.011 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:23.530 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:52.730 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:57:53.265 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:00:25.797 86089== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:53.352 INFO:tasks.ceph.osd.6.smithi183.stderr:==00:00:00:25.861 86091== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:53.355 INFO:tasks.ceph.osd.7.smithi183.stderr:==00:00:00:25.862 86092== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:53.360 INFO:tasks.ceph.osd.5.smithi183.stderr:==00:00:00:25.888 86090== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:53.481 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:57:53.482 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:57:53.498 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-11T20:57:54.718 INFO:tasks.ceph.osd.1.smithi022.stderr:==00:00:00:27.232 86143== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:54.837 INFO:tasks.ceph.osd.0.smithi022.stderr:==00:00:00:27.358 86141== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:54.994 INFO:tasks.ceph.osd.2.smithi022.stderr:==00:00:00:27.522 86140== Warning: unimplemented fcntl command: 1038 2023-10-11T20:57:55.377 INFO:tasks.ceph.osd.3.smithi022.stderr:==00:00:00:27.895 86142== Warning: unimplemented fcntl command: 1038 2023-10-11T20:58:00.304 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:58:01.086 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:58:01.086 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:57:27.315094+0000","last_up_change":"0.000000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:58:01.101 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-11T20:58:01.681 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T20:58:01.677+0000 5dc2340 -1 osd.6 0 log_to_monitors true 2023-10-11T20:58:01.704 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T20:58:01.700+0000 5dc2340 -1 osd.5 0 log_to_monitors true 2023-10-11T20:58:01.851 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T20:58:01.847+0000 5dc2340 -1 osd.7 0 log_to_monitors true 2023-10-11T20:58:01.914 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T20:58:01.911+0000 5dc2340 -1 osd.4 0 log_to_monitors true 2023-10-11T20:58:03.163 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T20:58:03.160+0000 5dc2340 -1 osd.0 0 log_to_monitors true 2023-10-11T20:58:03.507 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T20:58:03.503+0000 5dc2340 -1 osd.1 0 log_to_monitors true 2023-10-11T20:58:03.865 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T20:58:03.862+0000 5dc2340 -1 osd.2 0 log_to_monitors true 2023-10-11T20:58:04.497 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T20:58:04.493+0000 5dc2340 -1 osd.3 0 log_to_monitors true 2023-10-11T20:58:04.711 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T20:58:04.705+0000 c496640 -1 osd.5 0 waiting for initial osdmap 2023-10-11T20:58:04.750 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T20:58:04.745+0000 c496640 -1 osd.6 0 waiting for initial osdmap 2023-10-11T20:58:04.759 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T20:58:04.755+0000 c496640 -1 osd.7 0 waiting for initial osdmap 2023-10-11T20:58:05.144 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T20:58:05.131+0000 10a5d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:05.178 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T20:58:05.165+0000 10a5d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:05.210 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T20:58:05.191+0000 10a5d640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:05.838 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T20:58:05.833+0000 ac7d640 -1 osd.4 0 waiting for initial osdmap 2023-10-11T20:58:06.225 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T20:58:06.212+0000 10a5d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:06.916 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T20:58:06.912+0000 c496640 -1 osd.0 0 waiting for initial osdmap 2023-10-11T20:58:07.055 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T20:58:07.051+0000 ac7d640 -1 osd.2 0 waiting for initial osdmap 2023-10-11T20:58:07.142 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T20:58:07.137+0000 ac7d640 -1 osd.1 0 waiting for initial osdmap 2023-10-11T20:58:07.495 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T20:58:07.481+0000 1025c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:07.607 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T20:58:07.594+0000 1025c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:07.674 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T20:58:07.661+0000 1025c640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:07.872 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T20:58:07.868+0000 ac7d640 -1 osd.3 0 waiting for initial osdmap 2023-10-11T20:58:07.907 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:58:08.385 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T20:58:08.364+0000 1025c640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T20:58:08.617 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:58:08.618 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":15,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:58:07.514846+0000","last_up_change":"2023-10-11T20:58:06.413550+0000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T20:58:06.276050+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6801","nonce":86089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6802","nonce":86089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6804","nonce":86089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6803","nonce":86089}]},"public_addr":"172.21.15.183:6801/86089","cluster_addr":"172.21.15.183:6802/86089","heartbeat_back_addr":"172.21.15.183:6804/86089","heartbeat_front_addr":"172.21.15.183:6803/86089","state":["exists","up"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6809","nonce":86090}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6810","nonce":86090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6812","nonce":86090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6811","nonce":86090}]},"public_addr":"172.21.15.183:6809/86090","cluster_addr":"172.21.15.183:6810/86090","heartbeat_back_addr":"172.21.15.183:6812/86090","heartbeat_front_addr":"172.21.15.183:6811/86090","state":["exists","up"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6805","nonce":86091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6806","nonce":86091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6808","nonce":86091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6807","nonce":86091}]},"public_addr":"172.21.15.183:6805/86091","cluster_addr":"172.21.15.183:6806/86091","heartbeat_back_addr":"172.21.15.183:6808/86091","heartbeat_front_addr":"172.21.15.183:6807/86091","state":["exists","up"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6813","nonce":86092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6814","nonce":86092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6816","nonce":86092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6815","nonce":86092}]},"public_addr":"172.21.15.183:6813/86092","cluster_addr":"172.21.15.183:6814/86092","heartbeat_back_addr":"172.21.15.183:6816/86092","heartbeat_front_addr":"172.21.15.183:6815/86092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.978649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.667069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.816575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.831954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:58:08.630 DEBUG:teuthology.misc:4 of 8 OSDs are up 2023-10-11T20:58:15.436 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-11T20:58:16.015 INFO:teuthology.misc.health.smithi022.stdout: 2023-10-11T20:58:16.016 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":18,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:58:10.922047+0000","last_up_change":"2023-10-11T20:58:08.560955+0000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T20:58:06.276050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":86141}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":86141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":86141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":86141}]},"public_addr":"172.21.15.22:6812/86141","cluster_addr":"172.21.15.22:6813/86141","heartbeat_back_addr":"172.21.15.22:6815/86141","heartbeat_front_addr":"172.21.15.22:6814/86141","state":["exists","up"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":86143}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":86143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":86143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":86143}]},"public_addr":"172.21.15.22:6800/86143","cluster_addr":"172.21.15.22:6801/86143","heartbeat_back_addr":"172.21.15.22:6803/86143","heartbeat_front_addr":"172.21.15.22:6802/86143","state":["exists","up"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":86140}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":86140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":86140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":86140}]},"public_addr":"172.21.15.22:6804/86140","cluster_addr":"172.21.15.22:6805/86140","heartbeat_back_addr":"172.21.15.22:6807/86140","heartbeat_front_addr":"172.21.15.22:6806/86140","state":["exists","up"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":86142}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":86142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":86142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":86142}]},"public_addr":"172.21.15.22:6808/86142","cluster_addr":"172.21.15.22:6809/86142","heartbeat_back_addr":"172.21.15.22:6811/86142","heartbeat_front_addr":"172.21.15.22:6810/86142","state":["exists","up"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6801","nonce":86089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6802","nonce":86089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6804","nonce":86089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6803","nonce":86089}]},"public_addr":"172.21.15.183:6801/86089","cluster_addr":"172.21.15.183:6802/86089","heartbeat_back_addr":"172.21.15.183:6804/86089","heartbeat_front_addr":"172.21.15.183:6803/86089","state":["exists","up"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6809","nonce":86090}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6810","nonce":86090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6812","nonce":86090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6811","nonce":86090}]},"public_addr":"172.21.15.183:6809/86090","cluster_addr":"172.21.15.183:6810/86090","heartbeat_back_addr":"172.21.15.183:6812/86090","heartbeat_front_addr":"172.21.15.183:6811/86090","state":["exists","up"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6805","nonce":86091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6806","nonce":86091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6808","nonce":86091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6807","nonce":86091}]},"public_addr":"172.21.15.183:6805/86091","cluster_addr":"172.21.15.183:6806/86091","heartbeat_back_addr":"172.21.15.183:6808/86091","heartbeat_front_addr":"172.21.15.183:6807/86091","state":["exists","up"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6813","nonce":86092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6814","nonce":86092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6816","nonce":86092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6815","nonce":86092}]},"public_addr":"172.21.15.183:6813/86092","cluster_addr":"172.21.15.183:6814/86092","heartbeat_back_addr":"172.21.15.183:6816/86092","heartbeat_front_addr":"172.21.15.183:6815/86092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.236159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.682703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.907020+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:06.497013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.978649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.667069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.816575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.831954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:58:16.027 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-11T20:58:16.028 INFO:tasks.ceph:Creating RBD pool 2023-10-11T20:58:16.028 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-11T20:58:17.853 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'rbd' created 2023-10-11T20:58:17.867 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-11T20:58:19.133 INFO:teuthology.orchestra.run.smithi022.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-11T20:58:19.147 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-11T20:58:19.148 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-11T20:58:19.148 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-11T20:58:19.149 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-11T20:58:19.149 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-11T20:58:19.936 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:19.948 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"active_gid":4113,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6800","nonce":85546}]},"active_addr":"172.21.15.183:6800/85546","active_change":"2023-10-11T20:57:27.566707+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":4002319379}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3895045932}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":759668247}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.183:0","nonce":3875109315}]}]} 2023-10-11T20:58:19.954 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-11T20:58:19.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-11T20:58:19.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T20:58:20.055 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:15.382 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.114 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:15.440 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.150 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:15.427 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.202 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:15.478 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.212 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:15.539 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.270 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:15.597 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.369 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:15.696 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.430 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:15.706 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:20.536 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:15.863 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:21.356 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:21.356 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":21,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:58:20.023874+0000","last_up_change":"2023-10-11T20:58:08.560955+0000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T20:58:06.276050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-11T20:58:16.606863+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":86141}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":86141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":86141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":86141}]},"public_addr":"172.21.15.22:6812/86141","cluster_addr":"172.21.15.22:6813/86141","heartbeat_back_addr":"172.21.15.22:6815/86141","heartbeat_front_addr":"172.21.15.22:6814/86141","state":["exists","up"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":86143}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":86143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":86143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":86143}]},"public_addr":"172.21.15.22:6800/86143","cluster_addr":"172.21.15.22:6801/86143","heartbeat_back_addr":"172.21.15.22:6803/86143","heartbeat_front_addr":"172.21.15.22:6802/86143","state":["exists","up"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":86140}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":86140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":86140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":86140}]},"public_addr":"172.21.15.22:6804/86140","cluster_addr":"172.21.15.22:6805/86140","heartbeat_back_addr":"172.21.15.22:6807/86140","heartbeat_front_addr":"172.21.15.22:6806/86140","state":["exists","up"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":86142}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":86142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":86142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":86142}]},"public_addr":"172.21.15.22:6808/86142","cluster_addr":"172.21.15.22:6809/86142","heartbeat_back_addr":"172.21.15.22:6811/86142","heartbeat_front_addr":"172.21.15.22:6810/86142","state":["exists","up"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6801","nonce":86089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6802","nonce":86089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6804","nonce":86089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6803","nonce":86089}]},"public_addr":"172.21.15.183:6801/86089","cluster_addr":"172.21.15.183:6802/86089","heartbeat_back_addr":"172.21.15.183:6804/86089","heartbeat_front_addr":"172.21.15.183:6803/86089","state":["exists","up"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6809","nonce":86090}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6810","nonce":86090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6812","nonce":86090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6811","nonce":86090}]},"public_addr":"172.21.15.183:6809/86090","cluster_addr":"172.21.15.183:6810/86090","heartbeat_back_addr":"172.21.15.183:6812/86090","heartbeat_front_addr":"172.21.15.183:6811/86090","state":["exists","up"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6805","nonce":86091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6806","nonce":86091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6808","nonce":86091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6807","nonce":86091}]},"public_addr":"172.21.15.183:6805/86091","cluster_addr":"172.21.15.183:6806/86091","heartbeat_back_addr":"172.21.15.183:6808/86091","heartbeat_front_addr":"172.21.15.183:6807/86091","state":["exists","up"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6813","nonce":86092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6814","nonce":86092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6816","nonce":86092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6815","nonce":86092}]},"public_addr":"172.21.15.183:6813/86092","cluster_addr":"172.21.15.183:6814/86092","heartbeat_back_addr":"172.21.15.183:6816/86092","heartbeat_front_addr":"172.21.15.183:6815/86092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.236159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.682703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.907020+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:06.497013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.978649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.667069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.816575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.831954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:58:21.369 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-11T20:58:21.369 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-11T20:58:22.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:22.052 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":22,"fsid":"bae0e1e0-30c1-4b31-993c-2e12cbe45466","created":"2023-10-11T20:57:22.016906+0000","modified":"2023-10-11T20:58:21.688088+0000","last_up_change":"2023-10-11T20:58:08.560955+0000","last_in_change":"2023-10-11T20:57:27.315094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":7,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-11T20:58:06.276050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-11T20:58:16.606863+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0db31795-9ebe-4ff5-99f1-4fc5e5316716","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6812","nonce":86141}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6813","nonce":86141}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6815","nonce":86141}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6814","nonce":86141}]},"public_addr":"172.21.15.22:6812/86141","cluster_addr":"172.21.15.22:6813/86141","heartbeat_back_addr":"172.21.15.22:6815/86141","heartbeat_front_addr":"172.21.15.22:6814/86141","state":["exists","up"]},{"osd":1,"uuid":"bac1e611-b7cf-456c-a53d-a93591a7e1ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6800","nonce":86143}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6801","nonce":86143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6803","nonce":86143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6802","nonce":86143}]},"public_addr":"172.21.15.22:6800/86143","cluster_addr":"172.21.15.22:6801/86143","heartbeat_back_addr":"172.21.15.22:6803/86143","heartbeat_front_addr":"172.21.15.22:6802/86143","state":["exists","up"]},{"osd":2,"uuid":"ea34afad-62a6-4c5d-af58-60cfe1770aa5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6804","nonce":86140}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6805","nonce":86140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6807","nonce":86140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6806","nonce":86140}]},"public_addr":"172.21.15.22:6804/86140","cluster_addr":"172.21.15.22:6805/86140","heartbeat_back_addr":"172.21.15.22:6807/86140","heartbeat_front_addr":"172.21.15.22:6806/86140","state":["exists","up"]},{"osd":3,"uuid":"cc05f381-3aac-4116-ac22-612b6d5dd0f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6808","nonce":86142}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6809","nonce":86142}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6811","nonce":86142}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.22:6810","nonce":86142}]},"public_addr":"172.21.15.22:6808/86142","cluster_addr":"172.21.15.22:6809/86142","heartbeat_back_addr":"172.21.15.22:6811/86142","heartbeat_front_addr":"172.21.15.22:6810/86142","state":["exists","up"]},{"osd":4,"uuid":"4585ef06-a109-4750-8c12-5b7092791065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6801","nonce":86089}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6802","nonce":86089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6804","nonce":86089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6803","nonce":86089}]},"public_addr":"172.21.15.183:6801/86089","cluster_addr":"172.21.15.183:6802/86089","heartbeat_back_addr":"172.21.15.183:6804/86089","heartbeat_front_addr":"172.21.15.183:6803/86089","state":["exists","up"]},{"osd":5,"uuid":"4d3653f9-a201-494f-a5cc-0073380f6207","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6809","nonce":86090}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6810","nonce":86090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6812","nonce":86090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6811","nonce":86090}]},"public_addr":"172.21.15.183:6809/86090","cluster_addr":"172.21.15.183:6810/86090","heartbeat_back_addr":"172.21.15.183:6812/86090","heartbeat_front_addr":"172.21.15.183:6811/86090","state":["exists","up"]},{"osd":6,"uuid":"f9a57a70-534e-41fd-8779-c306f05d0d12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6805","nonce":86091}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6806","nonce":86091}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6808","nonce":86091}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6807","nonce":86091}]},"public_addr":"172.21.15.183:6805/86091","cluster_addr":"172.21.15.183:6806/86091","heartbeat_back_addr":"172.21.15.183:6808/86091","heartbeat_front_addr":"172.21.15.183:6807/86091","state":["exists","up"]},{"osd":7,"uuid":"319c2148-5202-4238-959b-29a30a7765de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6813","nonce":86092}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6814","nonce":86092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6816","nonce":86092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.183:6815","nonce":86092}]},"public_addr":"172.21.15.183:6813/86092","cluster_addr":"172.21.15.183:6814/86092","heartbeat_back_addr":"172.21.15.183:6816/86092","heartbeat_front_addr":"172.21.15.183:6815/86092","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.236159+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.682703+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:05.907020+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:06.497013+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.978649+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.667069+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.816575+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-11T20:58:03.831954+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-11T20:58:22.064 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-11T20:58:22.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-11T20:58:22.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-11T20:58:22.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-11T20:58:22.067 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-11T20:58:22.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-11T20:58:22.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-11T20:58:22.069 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-11T20:58:22.458 INFO:teuthology.orchestra.run.smithi022.stdout:68719476742 2023-10-11T20:58:22.459 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-11T20:58:22.496 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:22.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-11T20:58:22.499 INFO:teuthology.orchestra.run.smithi022.stdout:60129542149 2023-10-11T20:58:22.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-11T20:58:22.540 INFO:teuthology.orchestra.run.smithi022.stdout:68719476742 2023-10-11T20:58:22.541 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-11T20:58:22.547 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-11T20:58:22.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-11T20:58:22.561 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-11T20:58:22.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-11T20:58:22.571 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-11T20:58:22.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-11T20:58:22.572 INFO:teuthology.orchestra.run.smithi022.stdout:68719476742 2023-10-11T20:58:22.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T20:58:23.251 INFO:teuthology.orchestra.run.smithi022.stdout:68719476739 2023-10-11T20:58:23.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476739 for osd.3 2023-10-11T20:58:23.276 INFO:teuthology.orchestra.run.smithi022.stdout:60129542147 2023-10-11T20:58:23.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.4 2023-10-11T20:58:23.449 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:23.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2023-10-11T20:58:24.173 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:24.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.0 2023-10-11T20:58:24.215 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2023-10-11T20:58:24.216 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:24.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2023-10-11T20:58:24.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.1 2023-10-11T20:58:24.265 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-11T20:58:24.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-11T20:58:24.292 INFO:teuthology.orchestra.run.smithi022.stdout:55834574851 2023-10-11T20:58:24.311 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.7 2023-10-11T20:58:24.448 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-11T20:58:24.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-10-11T20:58:24.463 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T20:58:24.998 INFO:teuthology.orchestra.run.smithi022.stdout:68719476740 2023-10-11T20:58:25.008 INFO:teuthology.orchestra.run.smithi022.stdout:60129542148 2023-10-11T20:58:25.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.3 2023-10-11T20:58:25.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2023-10-11T20:58:25.094 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:25.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2023-10-11T20:58:25.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-11T20:58:25.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-11T20:58:25.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-11T20:58:25.312 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-11T20:58:25.462 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-11T20:58:25.785 INFO:teuthology.orchestra.run.smithi022.stdout:68719476742 2023-10-11T20:58:25.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.0 2023-10-11T20:58:25.803 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-11T20:58:26.023 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-11T20:58:26.027 INFO:teuthology.orchestra.run.smithi022.stdout:68719476742 2023-10-11T20:58:26.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476742 for osd.1 2023-10-11T20:58:26.044 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.109 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-11T20:58:26.365 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-11T20:58:26.383 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-10-11T20:58:26.384 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.476 INFO:teuthology.orchestra.run.smithi022.stdout:55834574853 2023-10-11T20:58:26.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-10-11T20:58:26.494 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.638 INFO:teuthology.orchestra.run.smithi022.stdout:55834574854 2023-10-11T20:58:26.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-10-11T20:58:26.652 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.654 INFO:teuthology.orchestra.run.smithi022.stdout:68719476741 2023-10-11T20:58:26.664 INFO:teuthology.orchestra.run.smithi022.stdout:60129542149 2023-10-11T20:58:26.669 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476741 for osd.3 2023-10-11T20:58:26.670 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2023-10-11T20:58:26.678 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.848 INFO:teuthology.orchestra.run.smithi022.stdout:68719476743 2023-10-11T20:58:26.863 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.2 2023-10-11T20:58:26.863 DEBUG:teuthology.parallel:result is None 2023-10-11T20:58:26.864 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-11T20:58:26.864 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-11T20:58:27.412 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:27.412 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-11T20:58:27.424 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-10-11T20:58:25.874097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217864,"kb_used_data":2248,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756856,"statfs":{"total":773094113280,"available":772871020544,"internally_reserved":0,"allocated":2301952,"data_stored":1319420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.808578"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.747616+0000","last_change":"2023-10-11T20:58:19.685862+0000","last_active":"2023-10-11T20:58:20.747616+0000","last_peered":"2023-10-11T20:58:20.747616+0000","last_clean":"2023-10-11T20:58:20.747616+0000","last_became_active":"2023-10-11T20:58:19.676153+0000","last_became_peered":"2023-10-11T20:58:19.676153+0000","last_unstale":"2023-10-11T20:58:20.747616+0000","last_undegraded":"2023-10-11T20:58:20.747616+0000","last_fullsized":"2023-10-11T20:58:20.747616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T00:28:47.395781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.813264+0000","last_change":"2023-10-11T20:58:19.722256+0000","last_active":"2023-10-11T20:58:20.813264+0000","last_peered":"2023-10-11T20:58:20.813264+0000","last_clean":"2023-10-11T20:58:20.813264+0000","last_became_active":"2023-10-11T20:58:19.694562+0000","last_became_peered":"2023-10-11T20:58:19.694562+0000","last_unstale":"2023-10-11T20:58:20.813264+0000","last_undegraded":"2023-10-11T20:58:20.813264+0000","last_fullsized":"2023-10-11T20:58:20.813264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T03:07:46.272088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.745504+0000","last_change":"2023-10-11T20:58:19.416761+0000","last_active":"2023-10-11T20:58:20.745504+0000","last_peered":"2023-10-11T20:58:20.745504+0000","last_clean":"2023-10-11T20:58:20.745504+0000","last_became_active":"2023-10-11T20:58:19.410337+0000","last_became_peered":"2023-10-11T20:58:19.410337+0000","last_unstale":"2023-10-11T20:58:20.745504+0000","last_undegraded":"2023-10-11T20:58:20.745504+0000","last_fullsized":"2023-10-11T20:58:20.745504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T05:56:01.138923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.808001+0000","last_change":"2023-10-11T20:58:19.813103+0000","last_active":"2023-10-11T20:58:20.808001+0000","last_peered":"2023-10-11T20:58:20.808001+0000","last_clean":"2023-10-11T20:58:20.808001+0000","last_became_active":"2023-10-11T20:58:19.780069+0000","last_became_peered":"2023-10-11T20:58:19.780069+0000","last_unstale":"2023-10-11T20:58:20.808001+0000","last_undegraded":"2023-10-11T20:58:20.808001+0000","last_fullsized":"2023-10-11T20:58:20.808001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T23:59:26.481573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.739532+0000","last_change":"2023-10-11T20:58:19.760521+0000","last_active":"2023-10-11T20:58:20.739532+0000","last_peered":"2023-10-11T20:58:20.739532+0000","last_clean":"2023-10-11T20:58:20.739532+0000","last_became_active":"2023-10-11T20:58:19.754122+0000","last_became_peered":"2023-10-11T20:58:19.754122+0000","last_unstale":"2023-10-11T20:58:20.739532+0000","last_undegraded":"2023-10-11T20:58:20.739532+0000","last_fullsized":"2023-10-11T20:58:20.739532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T07:56:59.260290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.852825+0000","last_change":"2023-10-11T20:58:19.377422+0000","last_active":"2023-10-11T20:58:20.852825+0000","last_peered":"2023-10-11T20:58:20.852825+0000","last_clean":"2023-10-11T20:58:20.852825+0000","last_became_active":"2023-10-11T20:58:19.350528+0000","last_became_peered":"2023-10-11T20:58:19.350528+0000","last_unstale":"2023-10-11T20:58:20.852825+0000","last_undegraded":"2023-10-11T20:58:20.852825+0000","last_fullsized":"2023-10-11T20:58:20.852825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T21:41:10.229164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.735060+0000","last_change":"2023-10-11T20:58:19.367881+0000","last_active":"2023-10-11T20:58:20.735060+0000","last_peered":"2023-10-11T20:58:20.735060+0000","last_clean":"2023-10-11T20:58:20.735060+0000","last_became_active":"2023-10-11T20:58:19.339959+0000","last_became_peered":"2023-10-11T20:58:19.339959+0000","last_unstale":"2023-10-11T20:58:20.735060+0000","last_undegraded":"2023-10-11T20:58:20.735060+0000","last_fullsized":"2023-10-11T20:58:20.735060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T22:59:51.965152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.742231+0000","last_change":"2023-10-11T20:58:19.793751+0000","last_active":"2023-10-11T20:58:20.742231+0000","last_peered":"2023-10-11T20:58:20.742231+0000","last_clean":"2023-10-11T20:58:20.742231+0000","last_became_active":"2023-10-11T20:58:19.788372+0000","last_became_peered":"2023-10-11T20:58:19.788372+0000","last_unstale":"2023-10-11T20:58:20.742231+0000","last_undegraded":"2023-10-11T20:58:20.742231+0000","last_fullsized":"2023-10-11T20:58:20.742231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T00:48:23.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'76","reported_seq":117,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.808395+0000","last_change":"2023-10-11T20:58:10.301838+0000","last_active":"2023-10-11T20:58:20.808395+0000","last_peered":"2023-10-11T20:58:20.808395+0000","last_clean":"2023-10-11T20:58:20.808395+0000","last_became_active":"2023-10-11T20:58:10.245847+0000","last_became_peered":"2023-10-11T20:58:10.245847+0000","last_unstale":"2023-10-11T20:58:20.808395+0000","last_undegraded":"2023-10-11T20:58:20.808395+0000","last_fullsized":"2023-10-11T20:58:20.808395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:06.413550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:06.413550+0000","last_clean_scrub_stamp":"2023-10-11T20:58:06.413550+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T06:30:04.792981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.394}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":43.719000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.550000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":31.228999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.388000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.956}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.391}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0739999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6519999999999992}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.148}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.358000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.065999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":463886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":249.38399999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":41.159999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.662000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.045999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3780000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.484000000000002}]}]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.002000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.713999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.444000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.042999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3740000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.829000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.169}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":61418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6300000000000008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7160000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.965999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.526999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.312000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.185}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7750000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1929999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.047000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.257999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2669999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.738}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.727}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4089999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.495999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.292999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.802}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.667999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":463886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.816000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.967000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.933999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.382000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.617000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.931999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":38.024999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-11T20:58:27.426 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-11T20:58:27.976 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:27.977 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2023-10-11T20:58:27.988 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-11T20:58:27.874394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":217872,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754756848,"statfs":{"total":773094113280,"available":772871012352,"internally_reserved":0,"allocated":2310144,"data_stored":1324048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001284"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.747616+0000","last_change":"2023-10-11T20:58:19.685862+0000","last_active":"2023-10-11T20:58:20.747616+0000","last_peered":"2023-10-11T20:58:20.747616+0000","last_clean":"2023-10-11T20:58:20.747616+0000","last_became_active":"2023-10-11T20:58:19.676153+0000","last_became_peered":"2023-10-11T20:58:19.676153+0000","last_unstale":"2023-10-11T20:58:20.747616+0000","last_undegraded":"2023-10-11T20:58:20.747616+0000","last_fullsized":"2023-10-11T20:58:20.747616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T00:28:47.395781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:21.820913+0000","last_change":"2023-10-11T20:58:19.722256+0000","last_active":"2023-10-11T20:58:21.820913+0000","last_peered":"2023-10-11T20:58:21.820913+0000","last_clean":"2023-10-11T20:58:21.820913+0000","last_became_active":"2023-10-11T20:58:19.694562+0000","last_became_peered":"2023-10-11T20:58:19.694562+0000","last_unstale":"2023-10-11T20:58:21.820913+0000","last_undegraded":"2023-10-11T20:58:21.820913+0000","last_fullsized":"2023-10-11T20:58:21.820913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T03:07:46.272088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.745504+0000","last_change":"2023-10-11T20:58:19.416761+0000","last_active":"2023-10-11T20:58:20.745504+0000","last_peered":"2023-10-11T20:58:20.745504+0000","last_clean":"2023-10-11T20:58:20.745504+0000","last_became_active":"2023-10-11T20:58:19.410337+0000","last_became_peered":"2023-10-11T20:58:19.410337+0000","last_unstale":"2023-10-11T20:58:20.745504+0000","last_undegraded":"2023-10-11T20:58:20.745504+0000","last_fullsized":"2023-10-11T20:58:20.745504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T05:56:01.138923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.808001+0000","last_change":"2023-10-11T20:58:19.813103+0000","last_active":"2023-10-11T20:58:20.808001+0000","last_peered":"2023-10-11T20:58:20.808001+0000","last_clean":"2023-10-11T20:58:20.808001+0000","last_became_active":"2023-10-11T20:58:19.780069+0000","last_became_peered":"2023-10-11T20:58:19.780069+0000","last_unstale":"2023-10-11T20:58:20.808001+0000","last_undegraded":"2023-10-11T20:58:20.808001+0000","last_fullsized":"2023-10-11T20:58:20.808001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T23:59:26.481573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.739532+0000","last_change":"2023-10-11T20:58:19.760521+0000","last_active":"2023-10-11T20:58:20.739532+0000","last_peered":"2023-10-11T20:58:20.739532+0000","last_clean":"2023-10-11T20:58:20.739532+0000","last_became_active":"2023-10-11T20:58:19.754122+0000","last_became_peered":"2023-10-11T20:58:19.754122+0000","last_unstale":"2023-10-11T20:58:20.739532+0000","last_undegraded":"2023-10-11T20:58:20.739532+0000","last_fullsized":"2023-10-11T20:58:20.739532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T07:56:59.260290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.852825+0000","last_change":"2023-10-11T20:58:19.377422+0000","last_active":"2023-10-11T20:58:20.852825+0000","last_peered":"2023-10-11T20:58:20.852825+0000","last_clean":"2023-10-11T20:58:20.852825+0000","last_became_active":"2023-10-11T20:58:19.350528+0000","last_became_peered":"2023-10-11T20:58:19.350528+0000","last_unstale":"2023-10-11T20:58:20.852825+0000","last_undegraded":"2023-10-11T20:58:20.852825+0000","last_fullsized":"2023-10-11T20:58:20.852825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T21:41:10.229164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.735060+0000","last_change":"2023-10-11T20:58:19.367881+0000","last_active":"2023-10-11T20:58:20.735060+0000","last_peered":"2023-10-11T20:58:20.735060+0000","last_clean":"2023-10-11T20:58:20.735060+0000","last_became_active":"2023-10-11T20:58:19.339959+0000","last_became_peered":"2023-10-11T20:58:19.339959+0000","last_unstale":"2023-10-11T20:58:20.735060+0000","last_undegraded":"2023-10-11T20:58:20.735060+0000","last_fullsized":"2023-10-11T20:58:20.735060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-12T22:59:51.965152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.742231+0000","last_change":"2023-10-11T20:58:19.793751+0000","last_active":"2023-10-11T20:58:20.742231+0000","last_peered":"2023-10-11T20:58:20.742231+0000","last_clean":"2023-10-11T20:58:20.742231+0000","last_became_active":"2023-10-11T20:58:19.788372+0000","last_became_peered":"2023-10-11T20:58:19.788372+0000","last_unstale":"2023-10-11T20:58:20.742231+0000","last_undegraded":"2023-10-11T20:58:20.742231+0000","last_fullsized":"2023-10-11T20:58:20.742231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:17.703788+0000","last_clean_scrub_stamp":"2023-10-11T20:58:17.703788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T00:48:23.141587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'76","reported_seq":117,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-11T20:58:20.808395+0000","last_change":"2023-10-11T20:58:10.301838+0000","last_active":"2023-10-11T20:58:20.808395+0000","last_peered":"2023-10-11T20:58:20.808395+0000","last_clean":"2023-10-11T20:58:20.808395+0000","last_became_active":"2023-10-11T20:58:10.245847+0000","last_became_peered":"2023-10-11T20:58:10.245847+0000","last_unstale":"2023-10-11T20:58:20.808395+0000","last_undegraded":"2023-10-11T20:58:20.808395+0000","last_fullsized":"2023-10-11T20:58:20.808395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-11T20:58:06.413550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-11T20:58:06.413550+0000","last_clean_scrub_stamp":"2023-10-11T20:58:06.413550+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-13T06:30:04.792981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":459280,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":82,"num_write":113,"num_write_kb":1372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":802816,"data_stored":795680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476742,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9950000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.394}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":43.719000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.550000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":31.228999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.388000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.956}]}]},{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.391}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.0739999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6519999999999992}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.148}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.358000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":21.065999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":463886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":249.38399999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.443}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":41.159999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.662000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.045999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3780000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.484000000000002}]}]},{"osd":0,"up_from":16,"seq":68719476743,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.002000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":23.713999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.444000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":25.042999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3740000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":22.829000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":26.169}]}]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.6300000000000008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.7160000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.965999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":10.526999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.089}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.312000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.185}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.7750000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.1929999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.047000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.257999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.2669999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.738}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.727}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27136,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344704,"statfs":{"total":96636764160,"available":96608976896,"internally_reserved":0,"allocated":188416,"data_stored":66046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4089999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":13.754}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":16.495999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.292999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":17.802}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":12.667999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":589824,"data_stored":463886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":11.816000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":15.967000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":14.933999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":19.382000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.617000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":24.931999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":38.024999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":397840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-11T20:58:27.989 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-11T20:58:27.990 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-11T20:58:27.990 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-11T20:58:27.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-11T20:58:28.586 INFO:teuthology.orchestra.run.smithi022.stdout: 2023-10-11T20:58:28.586 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-11T20:58:28.598 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-11T20:58:28.599 INFO:teuthology.run_tasks:Running task workunit... 2023-10-11T20:58:28.612 INFO:tasks.workunit:Pulling workunits from ref e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:58:28.613 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-10-11T20:58:28.613 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2023-10-11T20:58:28.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-11T20:58:28.629 INFO:teuthology.orchestra.run.smithi022.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-11T20:58:28.629 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-10-11T20:58:28.684 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-10-11T20:58:28.685 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-10-11T20:58:28.739 INFO:tasks.workunit:timeout=3h 2023-10-11T20:58:28.739 INFO:tasks.workunit:cleanup=True 2023-10-11T20:58:28.740 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e62d759a6de3042e046d7d9889d2209cbc674fbd 2023-10-11T20:58:28.795 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-10-11T20:58:40.006 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:35.333 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.010 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:35.337 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.057 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:35.333 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.060 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:35.337 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.062 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:35.389 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.071 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:35.398 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.079 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:35.405 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.096 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:35.373 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:58:40.119 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:35.445 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.086 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:55.413 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.111 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:55.438 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.138 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:55.415 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.141 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:01:55.468 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.142 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:55.418 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.149 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:55.476 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.153 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:55.480 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.158 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:01:55.435 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:00.175 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:01:55.501 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:14.074 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 98% (11459/11620) Updating files: 99% (11504/11620) Updating files: 100% (11620/11620) Updating files: 100% (11620/11620), done. 2023-10-11T20:59:14.455 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to 'e62d759a6de3042e046d7d9889d2209cbc674fbd'. 2023-10-11T20:59:14.455 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.455 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-10-11T20:59:14.456 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2023-10-11T20:59:14.456 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2023-10-11T20:59:14.456 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.456 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2023-10-11T20:59:14.457 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2023-10-11T20:59:14.457 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.457 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2023-10-11T20:59:14.457 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.457 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2023-10-11T20:59:14.458 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.458 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2023-10-11T20:59:14.458 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.458 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-10-11T20:59:14.458 INFO:tasks.workunit.client.0.smithi022.stderr: 2023-10-11T20:59:14.459 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at e62d759a6de Merge branch 'wip-63169-reef' of https://github.com/adk3798/ceph into wip-yuri11-testing-2023-10-10-1226-reef 2023-10-11T20:59:14.462 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-10-11T20:59:14.525 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-10-11T20:59:14.527 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-11T20:59:14.528 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-10-11T20:59:15.200 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-10-11T20:59:15.265 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-10-11T20:59:15.305 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-10-11T20:59:15.306 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-11T20:59:15.306 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-10-11T20:59:15.347 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-10-11T20:59:15.350 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2023-10-11T20:59:15.350 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-10-11T20:59:15.405 INFO:tasks.workunit:Running workunits matching cls on client.0... 2023-10-11T20:59:15.406 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2023-10-11T20:59:15.406 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2023-10-11T20:59:15.473 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T20:59:15.474 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 22 tests from 1 test suite. 2023-10-11T20:59:15.474 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T20:59:15.474 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 22 tests from TestCls2PCQueue 2023-10-11T20:59:15.474 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2023-10-11T20:59:18.389 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2914 ms) 2023-10-11T20:59:18.389 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2023-10-11T20:59:20.117 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:15.443 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.120 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:15.447 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.140 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:15.466 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.166 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:15.443 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.168 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:15.444 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.170 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:15.497 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.173 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:15.500 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.183 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:15.459 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:20.190 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:15.517 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:21.582 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3193 ms) 2023-10-11T20:59:21.583 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.Reserve 2023-10-11T20:59:25.974 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.Reserve (4392 ms) 2023-10-11T20:59:25.975 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2023-10-11T20:59:29.255 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3281 ms) 2023-10-11T20:59:29.256 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.Commit 2023-10-11T20:59:40.164 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:35.491 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.167 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:35.493 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.192 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:35.519 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.214 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:35.541 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.216 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:35.493 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.217 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:35.544 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.218 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:35.494 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.241 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:35.518 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:40.243 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:35.570 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T20:59:47.951 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.Commit (18695 ms) 2023-10-11T20:59:47.951 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.Abort 2023-10-11T20:59:52.457 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.Abort (4506 ms) 2023-10-11T20:59:52.458 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2023-10-11T21:00:00.222 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:55.549 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.225 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:55.551 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.258 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:02:55.582 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.274 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:55.550 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.276 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:55.552 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.286 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:55.613 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.288 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:55.615 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.295 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:02:55.571 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:00.309 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:02:55.635 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:03.139 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.ReserveError (10683 ms) 2023-10-11T21:00:03.139 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.CommitError 2023-10-11T21:00:08.634 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.CommitError (5495 ms) 2023-10-11T21:00:08.635 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.AbortError 2023-10-11T21:00:12.983 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.AbortError (4349 ms) 2023-10-11T21:00:12.984 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2023-10-11T21:00:22.738 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.MultiReserve (9755 ms) 2023-10-11T21:00:22.738 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2023-10-11T21:00:25.242 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:20.568 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.299 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:20.626 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.327 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:20.654 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.347 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:20.623 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.352 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:20.628 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.360 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:20.687 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.365 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:20.692 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.380 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:20.656 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:25.394 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:20.721 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:39.485 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.MultiCommit (16747 ms) 2023-10-11T21:00:39.486 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2023-10-11T21:00:45.479 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:40.806 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.482 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:40.808 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.499 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:03:40.826 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.529 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:40.806 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.530 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:40.807 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.547 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:03:40.823 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.549 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:40.875 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.552 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:40.879 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:45.569 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:03:40.896 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:00:54.524 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.MultiAbort (15039 ms) 2023-10-11T21:00:54.525 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2023-10-11T21:01:05.433 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:00.759 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.435 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:00.761 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.456 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:00.783 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.482 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:00.809 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.483 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:00.759 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.485 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:00.812 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.486 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:00.762 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.506 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:00.782 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:05.512 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:00.839 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:09.810 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (15286 ms) 2023-10-11T21:01:09.810 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2023-10-11T21:01:28.763 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (18953 ms) 2023-10-11T21:01:28.763 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2023-10-11T21:01:45.533 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:40.860 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.536 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:40.862 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.574 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:04:40.900 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.585 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:40.861 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.586 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:40.863 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.600 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:40.927 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.601 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:40.928 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.612 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:04:40.888 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:45.626 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:04:40.952 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:01:46.899 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (18136 ms) 2023-10-11T21:01:46.900 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2023-10-11T21:01:57.646 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.Cleanup (10747 ms) 2023-10-11T21:01:57.646 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2023-10-11T21:02:05.585 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:00.911 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.587 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:00.914 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.607 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:00.934 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.635 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:00.911 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.636 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:00.913 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.655 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:00.931 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.666 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:00.993 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.671 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:00.998 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:05.693 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:01.019 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.632 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:20.959 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.634 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:20.961 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.651 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:20.978 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.680 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:20.956 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.683 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:20.959 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.692 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:21.019 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.694 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:21.021 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.697 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:20.974 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:25.707 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:21.034 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.691 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:41.018 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.693 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:41.020 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.714 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:05:41.041 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.740 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:41.067 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.743 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:41.019 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.744 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:41.070 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.744 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:41.021 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.757 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:05:41.034 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:02:45.759 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:05:41.086 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.749 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:01.076 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.774 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:01.101 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.788 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:01.115 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.798 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:01.074 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.799 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:01.076 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.800 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:01.127 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.803 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:01.130 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.814 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:01.091 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:05.824 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:01.150 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.742 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:21.069 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.794 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:21.120 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.796 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:21.122 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.796 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:21.072 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.797 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:21.124 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.800 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:21.076 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.818 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:21.094 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.819 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:21.146 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:25.824 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:21.150 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.852 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:41.179 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.854 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:41.181 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.871 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:06:41.198 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.898 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:41.174 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.901 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:41.177 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.902 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:41.229 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.905 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:41.232 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.915 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:06:41.192 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:03:45.927 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:06:41.254 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.892 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:01.219 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.895 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:01.222 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.911 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:01.238 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.945 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:01.272 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.948 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:01.275 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.953 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:01.229 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.957 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:01.231 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.964 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:01.290 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:05.971 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:01.248 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.892 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:21.219 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.942 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:21.269 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.959 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:21.286 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.996 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:21.272 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.998 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:21.325 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:25.999 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:21.275 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:26.001 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:21.328 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:26.015 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:21.342 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:26.025 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:21.302 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:45.987 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:41.314 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:45.989 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:41.316 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.006 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:07:41.332 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.038 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:41.365 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.041 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:41.317 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.042 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:41.369 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.043 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:41.319 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.056 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:07:41.383 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:04:46.057 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:07:41.334 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.066 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:01.392 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.069 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:01.395 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.088 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:01.415 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.117 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:01.394 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.119 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:01.396 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.126 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:01.453 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.132 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:01.458 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.133 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:01.409 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:06.148 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:01.475 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.120 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:11.396 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.122 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:11.398 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.134 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:11.410 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.138 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:11.465 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.142 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:11.469 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.161 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:11.488 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.205 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:11.532 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.210 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:11.537 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:16.224 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:11.551 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.287 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:21.613 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.292 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:21.619 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.303 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:21.630 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.339 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:21.666 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.340 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:21.667 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.342 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:21.618 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.343 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:21.620 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.353 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:21.630 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:26.354 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:21.681 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.206 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:41.532 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.207 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:41.534 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.221 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:08:41.548 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.256 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:41.532 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.257 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:41.583 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.257 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:41.534 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.259 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:41.586 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.271 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:08:41.548 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:05:46.274 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:08:41.601 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.256 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:01.582 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.258 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:01.585 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.272 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:01.598 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.311 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:01.637 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.311 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:01.587 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.312 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:01.588 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.312 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:01.639 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.325 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:01.601 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:06.325 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:01.652 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.608 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:02.935 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.612 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:02.939 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.619 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:02.895 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.620 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:02.947 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.621 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:02.897 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.624 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:02.951 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.630 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:02.956 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.635 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:02.912 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:07.645 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:02.972 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.321 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:21.648 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.327 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:21.654 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.349 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:21.676 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.377 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:21.654 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.380 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:21.657 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.394 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:21.670 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.399 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:21.726 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.402 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:21.729 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:26.416 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:21.743 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.351 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:41.678 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.356 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:41.683 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.372 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:09:41.699 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.403 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:41.730 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.405 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:41.681 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.407 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:41.734 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.408 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:41.685 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.422 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:09:41.698 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:06:46.422 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:09:41.749 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.411 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:01.738 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.414 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:01.741 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.429 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:01.756 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.463 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:01.739 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.466 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:01.743 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.480 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:01.756 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.496 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:01.823 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.502 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:01.829 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:06.523 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:01.850 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.404 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:21.731 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.475 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:21.802 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.494 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:21.821 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.523 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:21.800 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.526 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:21.803 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.527 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:21.853 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.531 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:21.858 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.541 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:21.817 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:26.552 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:21.879 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.464 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:41.790 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.512 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:41.788 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.514 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:41.790 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.518 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:41.845 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.531 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:10:41.808 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.536 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:10:41.862 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.567 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:41.893 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.571 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:41.897 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:07:46.586 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:10:41.913 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.564 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:01.890 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.568 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:01.895 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.584 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:01.910 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.619 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:01.896 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.622 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:01.899 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.626 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:01.953 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.628 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:01.955 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.636 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:01.913 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:06.643 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:01.970 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.628 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:21.955 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.633 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:21.960 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.651 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:21.978 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.683 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:21.959 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.684 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:21.961 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.686 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:22.013 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.689 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:22.016 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.701 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:21.978 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:26.707 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:22.034 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.658 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:41.985 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.659 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:41.986 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.673 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:11:42.000 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.709 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:41.985 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.710 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:41.986 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.723 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:11:42.000 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.730 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:42.057 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.733 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:42.060 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:08:46.748 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:11:42.075 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.725 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:02.051 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.727 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:02.053 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.743 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:02.070 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.775 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:02.052 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.778 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:02.105 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.778 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:02.055 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.781 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:02.108 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.793 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:02.070 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:06.796 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:02.123 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.903 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.229 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.907 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.234 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.920 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.247 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.955 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.231 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.959 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.236 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.963 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.290 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.967 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.294 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.973 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.249 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:26.982 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.308 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.275 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.552 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.322 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.599 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.334 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:22.611 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.351 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.678 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.352 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.679 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.365 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:22.692 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.373 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.699 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.374 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.701 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:27.387 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:22.713 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.819 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:42.146 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.824 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:42.151 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.841 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:12:42.168 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.874 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:42.151 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.877 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:42.154 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.886 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:42.213 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.888 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:42.215 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.892 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:12:42.169 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:09:46.904 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:12:42.231 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.825 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:02.152 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.876 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:02.202 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.899 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:02.225 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.926 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:02.203 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.927 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:02.253 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.929 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:02.255 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.929 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:02.206 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.944 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:02.220 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:06.945 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:02.272 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.873 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:22.200 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.921 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:22.198 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.922 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:22.199 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.927 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:22.254 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.940 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:22.216 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.954 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:22.280 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.983 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:22.310 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:26.986 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:22.313 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:27.002 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:22.329 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:46.982 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:42.308 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:46.986 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:42.312 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.007 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:13:42.334 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.034 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:42.311 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.037 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:42.313 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.049 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:42.376 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.052 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:13:42.329 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.052 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:42.379 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:10:47.070 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:13:42.397 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.020 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:02.346 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.023 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:02.350 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.039 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:02.365 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.062 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:02.339 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.065 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:02.342 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.074 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:02.401 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.076 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:02.403 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.078 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:02.355 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:07.096 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:02.423 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.059 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:22.385 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.061 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:22.388 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.078 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:22.405 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.110 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:22.386 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.112 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:22.389 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.114 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:22.441 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.117 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:22.444 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.127 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:22.404 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:27.136 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:22.462 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.108 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:42.435 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.110 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:42.437 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.126 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:14:42.452 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.160 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:42.436 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.161 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:42.438 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.175 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:14:42.451 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.187 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:42.514 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.189 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:42.516 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:11:47.209 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:14:42.536 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.172 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:02.499 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.176 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:02.503 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.197 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:02.524 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.226 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:02.502 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.227 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:02.503 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.228 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:02.555 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.230 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:02.557 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.241 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:02.517 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:07.250 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:02.577 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.238 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:22.564 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.240 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:22.567 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.256 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:22.582 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.287 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:22.563 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.288 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:22.564 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.292 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:22.619 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.296 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:22.623 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.301 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:22.578 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:27.312 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:22.639 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.616 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:41.942 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.618 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:41.945 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.646 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:41.973 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.668 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:41.945 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.669 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:41.946 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.685 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.011 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.686 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.013 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.687 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:41.963 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:46.704 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.031 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.257 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:42.533 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.258 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:42.535 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.305 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:42.631 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.309 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:42.636 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.310 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.636 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.318 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:15:42.595 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.322 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:15:42.649 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.360 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.687 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:12:47.378 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:15:42.705 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.320 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:02.646 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.370 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:02.696 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.389 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:02.716 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.420 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:02.696 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.421 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:02.748 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.421 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:02.698 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.422 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:02.749 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.435 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:02.712 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:07.437 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:02.764 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.334 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:12.660 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.384 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:12.660 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.387 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:12.664 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.397 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:12.723 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.401 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:12.677 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.416 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:12.742 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.434 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:12.760 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.438 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:12.765 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:17.453 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:12.780 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.495 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:22.821 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.545 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:22.872 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.560 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:22.887 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.591 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:22.868 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.593 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:22.920 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.594 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:22.870 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.597 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:22.923 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.606 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:22.881 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:27.609 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:22.936 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.449 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:32.775 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.452 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:32.779 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.465 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:32.792 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.502 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:32.828 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.505 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:32.781 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.505 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:32.832 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.508 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:32.784 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.516 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:32.843 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:37.519 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:32.796 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.429 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:42.755 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.477 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:42.804 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.494 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:42.821 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.521 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:42.798 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.525 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:42.802 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.529 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:42.855 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.531 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:42.858 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.537 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:42.814 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:47.543 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:42.870 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.515 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:52.842 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.520 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:52.847 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.536 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:16:52.862 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.561 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:52.838 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.564 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:52.841 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.573 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:52.900 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.575 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:16:52.852 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.576 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:52.903 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:13:57.589 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:16:52.915 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.561 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:02.887 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.562 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:02.889 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.575 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:02.902 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.615 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:02.891 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.616 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:02.942 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.616 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:02.893 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.617 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:02.944 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.626 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:02.903 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:07.630 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:02.957 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.562 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:12.838 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.563 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:12.889 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.567 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:12.894 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.578 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:12.854 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.590 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:12.867 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.594 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:12.920 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.629 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:12.956 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.632 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:12.959 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:17.649 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:12.976 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.587 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:22.914 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.590 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:22.916 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.605 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:22.931 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.641 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:22.917 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.643 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:22.970 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.644 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:22.920 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.655 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:22.931 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.656 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:22.983 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:27.669 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:22.996 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.626 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:32.952 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.630 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:32.956 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.643 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:32.970 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.676 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:32.952 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.677 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:33.003 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.679 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:32.955 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:32.967 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.691 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:33.018 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:37.704 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:33.031 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.641 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:42.968 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.644 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:42.920 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.646 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:42.973 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.647 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:42.923 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.658 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:42.935 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.662 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:42.989 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.698 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:43.025 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.701 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:43.028 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:14:47.713 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:43.039 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.685 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:58.012 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.686 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:58.013 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.700 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:17:58.026 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.736 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:58.012 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.737 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:58.013 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.749 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:17:58.026 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.756 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:58.083 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.758 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:58.085 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:02.777 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:17:58.103 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.691 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:03.018 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.696 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:03.022 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.712 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:03.039 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.743 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:03.019 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.746 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:03.073 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.747 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:03.023 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.751 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:03.077 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.758 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:03.034 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:07.762 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:03.089 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.742 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:18.069 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.746 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:18.073 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.761 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:18.088 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.793 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:18.069 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.794 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:18.120 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.795 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:18.072 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.799 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:18.125 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.809 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:18.085 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:22.813 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:18.139 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.771 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:23.098 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.775 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:23.102 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.791 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:23.117 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.825 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:23.101 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.826 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:23.103 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.837 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:23.113 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.844 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:23.170 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.847 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:23.174 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:27.862 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:23.189 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:38.943 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.MultiProducer (821297 ms) 2023-10-11T21:15:38.943 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2023-10-11T21:15:42.778 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:38.104 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.782 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:38.108 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.807 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:38.134 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.832 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:38.109 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.834 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:38.111 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.839 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:38.165 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.841 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:38.167 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.851 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:38.127 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:42.857 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:38.184 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.791 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:43.118 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.795 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:43.122 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.807 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:43.134 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.845 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:43.121 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.847 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:43.124 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.848 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:43.174 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.849 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:43.175 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.858 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:43.185 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:15:47.861 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:43.136 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.830 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:58.156 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.832 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:58.159 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.850 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:18:58.176 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.876 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:58.152 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.877 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:58.154 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.884 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:58.211 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.886 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:58.213 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.894 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:18:58.171 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:02.903 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:18:58.230 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:03.309 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (24366 ms) 2023-10-11T21:16:03.309 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2023-10-11T21:16:07.840 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:03.166 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.841 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:03.168 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.853 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:03.180 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.883 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:03.160 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.886 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:03.163 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.900 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:03.176 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.904 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:03.231 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.907 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:03.233 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:07.920 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:03.247 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.850 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:23.177 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.910 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:23.236 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.929 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:23.256 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.957 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:23.233 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.960 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:23.236 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.970 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:23.297 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.972 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:23.299 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.974 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:23.250 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:27.988 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:23.314 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:42.954 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:38.280 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:42.960 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:38.287 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:42.987 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:38.306 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.006 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:38.282 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.010 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:38.285 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.011 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:38.337 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.013 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:38.340 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.023 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:38.299 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:43.030 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:38.356 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:47.957 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:43.283 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:47.960 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:43.287 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:47.972 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:43.299 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.005 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:43.281 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.007 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:43.284 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.009 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:43.336 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.012 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:43.339 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.019 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:43.296 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:16:48.024 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:43.351 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.008 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:58.334 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.011 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:58.338 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.027 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:19:58.354 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.057 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:58.334 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.060 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:58.386 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.060 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:58.337 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.063 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:58.390 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.073 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:19:58.350 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:03.080 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:19:58.407 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:07.977 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:03.304 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.029 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:03.355 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.041 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:03.368 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.073 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:03.349 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.077 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:03.354 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.079 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:03.405 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.081 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:03.408 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.087 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:03.364 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:08.092 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:03.419 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.063 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:18.389 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.064 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:18.391 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.078 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:18.405 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.109 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:18.385 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.110 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:18.387 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.115 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:18.442 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.118 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:18.445 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.124 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:18.400 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:23.134 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:18.461 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.206 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:23.532 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.209 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:23.536 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.220 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:23.547 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.258 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:23.534 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.260 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:23.586 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.260 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:23.537 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.261 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:23.588 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.270 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:23.547 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:28.272 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:23.598 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.114 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:33.440 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.116 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:33.442 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.130 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:33.457 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.162 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:33.439 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.164 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:33.440 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.168 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:33.494 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.169 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:33.496 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.176 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:33.452 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:38.181 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:33.507 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.089 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:43.415 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.137 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:43.464 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.165 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:43.492 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.180 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:43.456 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.182 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:43.459 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.193 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:43.470 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.204 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:43.531 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.207 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:43.533 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:48.219 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:43.546 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.179 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:53.506 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.182 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:53.508 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.195 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:20:53.522 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.206 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:53.483 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.209 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:53.485 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.219 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:20:53.496 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.231 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:53.558 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.233 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:53.560 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:17:58.249 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:20:53.576 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.217 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:03.544 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.220 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:03.546 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.232 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:03.559 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.265 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:03.541 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.266 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:03.542 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.270 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:03.597 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.273 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:03.600 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.276 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:03.553 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:08.286 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:03.613 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.235 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:13.561 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.237 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:13.564 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.251 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:13.578 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.282 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:13.559 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.284 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:13.560 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.295 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:13.571 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.297 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:13.624 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.300 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:13.627 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:18.313 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:13.640 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.261 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:23.587 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.263 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:23.590 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.274 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:23.600 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.305 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:23.581 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.308 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:23.584 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.310 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:23.637 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.314 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:23.640 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.318 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:23.595 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:28.325 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:23.652 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.284 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:33.560 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.284 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:33.610 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.287 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:33.564 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.288 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:33.615 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.299 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:33.575 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.301 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:33.627 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.341 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:33.668 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.345 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:33.672 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:38.360 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:33.687 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.310 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:43.633 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.310 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:43.636 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.323 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:43.649 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.355 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:43.631 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.356 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:43.632 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.356 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:43.683 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.362 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:43.688 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.366 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:43.642 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:48.373 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:43.700 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.362 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:53.688 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.364 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:53.691 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.382 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:53.708 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.406 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:53.683 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.409 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:53.685 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.417 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:53.744 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.420 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:53.696 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.421 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:53.748 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:18:58.434 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:53.761 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.060 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:56.386 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.064 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:56.390 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.069 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:56.396 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.069 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:56.345 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.071 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:56.348 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.072 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:56.399 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.081 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:21:56.407 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.088 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:21:56.364 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:01.091 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:21:56.418 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.378 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:08.704 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.380 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:08.707 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.395 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:08.721 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.426 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:08.703 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.428 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:08.705 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.441 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:08.717 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.444 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:08.771 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.446 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:08.773 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:13.457 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:08.784 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.384 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:13.711 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.386 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:13.713 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.395 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:13.722 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.429 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:13.705 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.431 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:13.708 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.437 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:13.764 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.438 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:13.765 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.441 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:13.718 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:18.450 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:13.776 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.390 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:28.716 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.435 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:28.712 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.437 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:28.713 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.450 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:28.726 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.451 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:28.778 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.469 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:28.795 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.489 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:28.816 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.490 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:28.817 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:33.508 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:28.835 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.453 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:33.780 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.456 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:33.782 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.467 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:33.793 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.498 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:33.775 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.500 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:33.827 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.503 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:33.780 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.506 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:33.832 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.515 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:33.791 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:38.518 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:33.844 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.487 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:48.813 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.489 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:48.815 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.502 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:48.828 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.537 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:48.813 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.538 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:48.864 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.538 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:48.814 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.539 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:48.866 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.550 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:48.826 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:53.552 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:48.879 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.502 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:53.828 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.504 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:53.831 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.513 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:22:53.840 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.549 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:53.825 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.549 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:53.826 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.558 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:22:53.835 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.583 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:53.909 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.584 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:53.910 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:19:58.593 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:22:53.920 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.533 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:08.859 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.536 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:08.863 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.551 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:08.878 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.580 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:08.856 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.584 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:08.860 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.597 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:08.873 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.598 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:08.925 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.601 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:08.928 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:13.616 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:08.942 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.556 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:13.883 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.559 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:13.885 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.570 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:13.897 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.603 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:13.879 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.607 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:13.884 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.618 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:13.894 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.628 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:13.955 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.633 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:13.959 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.645 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:13.971 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.835 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:14.161 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.836 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:14.163 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.847 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:14.174 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.849 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:14.126 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.850 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:14.127 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.859 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:14.135 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.900 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:14.227 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.902 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:14.229 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:18.911 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:14.238 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.605 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:28.931 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.607 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:28.933 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.620 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:28.947 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.653 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:28.929 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.655 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:28.931 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.658 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:28.984 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.659 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:28.986 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.667 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:28.944 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:33.673 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:29.000 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.625 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:33.952 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.628 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:33.955 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.639 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:33.966 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.673 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:33.950 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.676 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:33.953 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.686 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:34.012 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.688 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:33.965 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.689 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:34.016 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:38.702 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:34.028 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.647 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:48.974 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.651 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:48.978 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.670 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:48.997 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.700 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:48.976 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.701 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:48.977 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.713 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:48.989 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.732 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:49.059 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.736 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:49.063 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:53.750 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:49.077 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.662 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:53.989 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.664 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:53.991 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.674 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:23:54.001 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.711 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:53.987 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.712 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:53.988 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.715 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:54.042 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.717 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:54.044 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.721 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:23:53.997 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:20:58.726 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:23:54.053 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.648 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:08.974 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.697 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:09.024 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.718 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:09.045 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.742 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:09.019 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.745 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:09.021 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.745 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:09.072 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.749 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:09.076 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.758 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:09.035 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:13.762 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:09.089 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.712 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:14.038 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.713 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:14.040 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.726 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:14.052 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.756 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:14.033 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.760 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:14.037 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.763 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:14.089 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.764 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:14.091 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.770 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:14.046 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:18.774 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:14.101 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.760 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:29.086 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.762 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:29.088 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.779 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:29.105 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.813 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:29.139 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.816 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:29.143 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.817 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:29.093 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.818 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:29.094 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.830 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:29.106 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:33.830 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:29.157 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.801 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:34.127 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.804 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:34.130 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.813 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:34.140 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.847 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:34.123 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.848 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:34.125 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.852 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:34.179 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.854 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:34.181 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.859 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:34.135 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:38.865 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:34.192 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.824 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:49.150 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.828 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:49.155 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.849 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:49.176 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.875 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:49.152 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.876 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:49.153 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.884 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:49.211 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.886 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:49.213 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.890 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:49.166 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:53.899 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:49.225 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.824 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:54.150 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.826 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:54.153 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.837 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:24:54.164 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.869 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:54.145 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.872 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:54.148 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.881 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:24:54.158 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.898 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:54.225 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.902 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:54.229 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:21:58.913 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:24:54.240 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.923 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:07.250 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.927 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:07.254 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.933 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:07.209 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.933 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:07.260 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.934 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:07.211 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.936 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:07.263 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.947 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:07.274 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.952 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:07.229 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:11.962 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:07.289 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.865 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:09.192 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.867 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:09.194 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.879 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:09.206 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.912 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:09.189 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.913 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:09.239 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.915 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:09.192 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.917 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:09.243 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.925 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:09.201 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:13.928 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:09.255 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.879 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:14.206 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.881 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:14.208 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.891 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:14.218 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.928 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:14.205 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.930 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:14.206 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.941 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:14.217 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.948 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:14.275 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.950 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:14.277 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:18.961 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:14.288 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.911 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:29.237 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.913 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:29.240 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.930 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:29.257 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.958 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:29.234 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.961 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:29.237 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.964 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:29.291 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.967 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:29.294 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.973 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:29.249 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:33.987 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:29.314 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.881 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:34.207 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.929 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:34.256 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.943 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:34.270 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.973 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:34.249 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.976 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:34.252 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.986 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:34.313 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.987 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:34.264 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:38.989 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:34.316 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:39.002 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:34.329 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:53.980 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:49.306 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:53.984 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:49.311 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.000 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:49.326 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.031 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:49.307 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.033 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:49.309 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.048 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:49.325 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.054 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:49.381 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.055 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:49.382 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:54.068 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:49.395 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:58.976 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:54.303 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:58.980 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:54.307 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:58.996 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:25:54.323 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.025 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:54.301 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.027 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:54.303 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.028 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:54.355 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.031 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:54.358 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.037 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:25:54.313 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:22:59.045 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:25:54.372 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.018 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:09.345 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.021 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:09.348 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.039 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:09.366 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.079 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:09.355 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.081 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:09.358 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.082 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:09.408 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.087 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:09.414 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.095 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:09.371 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:14.106 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:09.433 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.007 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:14.334 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.057 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:14.383 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.068 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:14.395 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.101 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:14.377 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.103 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:14.380 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.114 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:14.390 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.123 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:14.450 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.126 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:14.453 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:19.140 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:14.467 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.078 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:29.404 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.084 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:29.411 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.103 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:29.429 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.129 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:29.405 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.131 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:29.408 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.138 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:29.465 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.140 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:29.466 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.146 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:29.421 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:34.153 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:29.480 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.092 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:34.419 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.097 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:34.424 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.109 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:34.436 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.146 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:34.422 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.150 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:34.426 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.155 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:34.482 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.156 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:34.483 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.160 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:34.436 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:39.167 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:34.493 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.127 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:49.453 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.129 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:49.455 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.142 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:49.469 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.185 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:49.461 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.186 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:49.513 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.187 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:49.463 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.187 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:49.514 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.198 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:49.475 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:54.205 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:49.531 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.140 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:54.466 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.142 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:54.469 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.153 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:26:54.479 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.190 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:54.467 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.192 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:54.468 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.194 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:54.520 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.195 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:54.522 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.209 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:26:54.536 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:23:59.217 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:26:54.493 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.175 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:09.502 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.178 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:09.505 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.193 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:09.520 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.230 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:09.507 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.232 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:09.509 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.244 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:09.521 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.258 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:09.585 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.261 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:09.588 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:14.278 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:09.605 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.210 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:14.537 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.213 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:14.540 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.222 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:14.549 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.258 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:14.534 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.259 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:14.586 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.260 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:14.536 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.263 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:14.589 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.270 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:14.547 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:19.275 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:14.601 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.220 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:29.547 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.226 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:29.552 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.241 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:29.568 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.273 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:29.599 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.274 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:29.551 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.276 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:29.602 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.279 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:29.555 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.290 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:29.617 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:34.291 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:29.568 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.237 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:34.564 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.241 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:34.568 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.253 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:34.579 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.292 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:34.619 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.295 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:34.571 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.295 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:34.621 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.297 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:34.574 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.305 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:34.632 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:39.308 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:34.584 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.226 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:49.552 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.276 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:49.552 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.277 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:49.553 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.280 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:49.607 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.294 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:49.570 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.318 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:49.644 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.330 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:49.657 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.333 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:49.660 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:54.352 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:49.678 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.239 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:54.565 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.290 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:54.616 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.302 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:27:54.629 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.336 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:54.613 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.339 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:54.615 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.340 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:54.667 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.345 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:54.672 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.348 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:27:54.625 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:24:59.358 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:27:54.685 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.277 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:09.603 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.326 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:09.652 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.341 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:09.668 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.372 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:09.649 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.374 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:09.650 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.376 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:09.703 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.378 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:09.705 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.386 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:09.662 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:14.392 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:09.719 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.340 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:14.666 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.341 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:14.668 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.351 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:14.678 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.387 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:14.663 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.388 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:14.664 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.398 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:14.673 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.413 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:14.739 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.414 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:14.741 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:19.425 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:14.751 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.880 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:17.207 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.885 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:17.212 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.892 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:17.218 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.892 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:17.168 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.893 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:17.170 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.894 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:17.221 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.904 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:17.231 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.912 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:17.188 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:21.915 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:17.242 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.383 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:29.709 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.387 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:29.713 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.401 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:29.728 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.431 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:29.708 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.434 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:29.710 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.446 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:29.723 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.458 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:29.785 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.462 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:29.788 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:34.475 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:29.801 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.404 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:34.731 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.406 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:34.733 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.419 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:34.746 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.451 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:34.728 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.454 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:34.730 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.459 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:34.786 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.463 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:34.790 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.464 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:34.740 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:39.476 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:34.803 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.435 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:49.761 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.439 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:49.766 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.455 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:49.781 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.486 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:49.762 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.490 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:49.766 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.493 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:49.819 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.494 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:49.821 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.507 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:49.783 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:25:54.509 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:49.836 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.458 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:59.784 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.462 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:59.788 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.475 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:28:59.801 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.505 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:59.781 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.507 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:59.784 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.510 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:59.837 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.512 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:59.839 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.518 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:28:59.795 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:04.524 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:28:59.851 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.487 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:09.813 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.490 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:09.817 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.505 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:09.832 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.534 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:09.811 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.535 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:09.812 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.544 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:09.870 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.546 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:09.873 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.546 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:09.823 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:14.558 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:09.884 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.523 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:19.849 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.525 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:19.852 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.540 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:19.867 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.565 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:19.841 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.567 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:19.844 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.578 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:19.854 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.581 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:19.908 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.582 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:19.909 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:24.594 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:19.920 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.548 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:29.874 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.550 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:29.877 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.562 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:29.889 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.597 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:29.873 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.598 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:29.874 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.608 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:29.884 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.608 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:29.935 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.609 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:29.936 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:34.621 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:29.947 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.567 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:39.893 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.570 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:39.897 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.583 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:39.910 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.617 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:39.893 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.618 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:39.944 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.619 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:39.896 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.621 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:39.948 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.630 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:39.906 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:44.632 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:39.959 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.595 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:49.921 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.597 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:49.924 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.613 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:49.940 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.642 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:49.918 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.645 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:49.922 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.647 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:49.973 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.649 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:49.976 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.656 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:49.932 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:26:54.661 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:29:49.988 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.635 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:59.962 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.638 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:59.964 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.649 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:29:59.976 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.677 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:59.954 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.680 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:59.956 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.691 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:29:59.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.716 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:00.043 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.720 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:00.047 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:04.732 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:00.059 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.645 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:09.971 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.647 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:09.974 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.658 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:09.984 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.687 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:09.963 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.691 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:09.967 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.699 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:10.026 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.700 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:10.027 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.701 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:09.978 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:14.712 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:10.039 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.672 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:19.998 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.674 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:20.000 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.689 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:20.015 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.721 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:19.997 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.722 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:19.999 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.723 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:20.050 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.726 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:20.053 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.732 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:20.009 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:24.739 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:20.066 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.699 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:30.025 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.700 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:30.027 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.719 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:30.045 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.743 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:30.019 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.745 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:30.022 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.759 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:30.035 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.776 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:30.103 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.780 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:30.107 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:34.794 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:30.121 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.719 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:40.046 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.721 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:40.048 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.732 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:40.059 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.761 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:40.038 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.763 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:40.039 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.772 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:40.099 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.773 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:40.049 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.774 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:40.100 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:44.784 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:40.111 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.759 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:55.085 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.760 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:55.087 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.773 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:30:55.100 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.807 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:55.083 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.808 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:55.085 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.811 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:55.138 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.813 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:55.140 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.820 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:30:55.097 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:27:59.828 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:30:55.154 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.774 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:00.101 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.776 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:00.103 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.787 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:00.113 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.817 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:00.093 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.819 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:00.095 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.827 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:00.154 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.829 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:00.105 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.830 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:00.156 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:04.840 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:00.167 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.839 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:15.165 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.841 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:15.167 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.854 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:15.180 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.886 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:15.163 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.887 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:15.164 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.892 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:15.219 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.893 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:15.220 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.900 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:15.176 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:19.907 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:15.234 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.863 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:20.189 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.865 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:20.192 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.880 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:20.207 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.908 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:20.185 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.911 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:20.187 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.918 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:20.245 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.920 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:20.197 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.921 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:20.248 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:24.936 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:20.263 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.124 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:29.450 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.127 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:29.454 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.132 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:29.409 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.133 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:29.460 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.134 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:29.411 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.135 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:29.462 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.145 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:29.472 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.151 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:29.427 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:34.154 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:29.481 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.875 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:35.201 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.877 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:35.203 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.887 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:35.214 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.921 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:35.197 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.924 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:35.200 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.927 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:35.254 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.929 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:35.255 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.934 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:35.210 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:39.942 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:35.269 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.894 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:40.220 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.896 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:40.223 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.921 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:40.248 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.942 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:40.218 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.944 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:40.220 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.948 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:40.275 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.950 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:40.277 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.954 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:40.231 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:44.964 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:40.291 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.922 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:55.248 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.925 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:55.252 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.941 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:31:55.268 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.970 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:55.246 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.973 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:55.249 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.977 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:55.304 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.979 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:55.306 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.985 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:31:55.261 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:28:59.998 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:31:55.324 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:04.965 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:00.291 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:04.967 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:00.294 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:04.977 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:00.304 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.012 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:00.289 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.014 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:00.290 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.019 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:00.346 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.021 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:00.348 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.023 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:00.300 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:05.031 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:00.358 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:19.985 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:15.311 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:19.986 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:15.313 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.004 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:15.331 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.032 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:15.308 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.033 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:15.309 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.045 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:15.321 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.054 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:15.381 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.059 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:15.386 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:20.073 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:15.400 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.002 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:20.329 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.004 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:20.331 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.013 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:20.340 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.051 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:20.327 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.054 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:20.330 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.056 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:20.383 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.058 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:20.385 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.063 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:20.339 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:25.070 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:20.397 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.043 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:35.370 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.047 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:35.374 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.069 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:35.396 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.093 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:35.369 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.095 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:35.372 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.103 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:35.430 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.106 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:35.433 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.108 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:35.384 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:40.121 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:35.447 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.063 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:40.339 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.064 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:40.391 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.066 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:40.393 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.068 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:40.345 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.084 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:40.410 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.089 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:40.366 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.122 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:40.448 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.125 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:40.452 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:29:45.139 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:40.466 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.106 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:55.433 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.109 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:55.435 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.123 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:32:55.450 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.158 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:55.434 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.159 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:55.436 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.161 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:55.487 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.162 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:55.489 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.172 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:32:55.448 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:00.176 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:32:55.503 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.130 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:00.457 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.133 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:00.460 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.150 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:00.477 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.180 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:00.456 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.181 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:00.458 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.191 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:00.468 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.222 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:00.549 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.225 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:00.551 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:05.240 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:00.567 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.172 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:15.498 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.173 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:15.500 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.186 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:15.513 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.221 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:15.548 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.223 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:15.499 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.223 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:15.550 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.224 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:15.501 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.236 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:15.513 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:20.239 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:15.566 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.144 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:20.470 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.189 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:20.465 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.190 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:20.466 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.192 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:20.519 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.201 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:20.477 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.206 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:20.533 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.259 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:20.585 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.260 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:20.587 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:25.277 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:20.603 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.179 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:35.505 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.240 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:35.567 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.254 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:35.581 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.285 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:35.561 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.288 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:35.614 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.289 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:35.566 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.290 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:35.617 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.302 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:35.578 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:40.305 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:35.632 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.246 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:45.573 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.253 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:45.580 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.265 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:45.591 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.297 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:45.573 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.299 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:45.575 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.310 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:45.586 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.322 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:45.648 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.326 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:45.653 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:30:50.342 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:45.669 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.227 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:55.553 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.275 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:55.601 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.276 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:55.553 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.278 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:55.555 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.290 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:33:55.616 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.291 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:33:55.567 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.324 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:55.650 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.327 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:55.654 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:00.342 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:33:55.668 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.253 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:05.580 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.304 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:05.630 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.316 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:05.642 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.350 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:05.623 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.350 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:05.626 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.361 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:05.637 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.369 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:05.696 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.375 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:05.701 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:10.391 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:05.717 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.301 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:25.627 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.350 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:25.677 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.367 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:25.694 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.394 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:25.670 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.396 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:25.672 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.397 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:25.723 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.400 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:25.727 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.410 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:25.686 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:30.418 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:25.745 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.397 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:35.724 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.399 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:35.726 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.415 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:35.741 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.447 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:35.723 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.448 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:35.775 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.449 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:35.726 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.451 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:35.778 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.460 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:35.737 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:40.463 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:35.790 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.826 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:40.151 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.829 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:40.156 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.834 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:40.111 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.836 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:40.113 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.840 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:40.167 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.843 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:40.170 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.853 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:40.130 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.854 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:40.181 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:44.864 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:40.190 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.407 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:45.734 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.410 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:45.736 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.422 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:45.749 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.456 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:45.732 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.457 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:45.733 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.466 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:45.792 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.466 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:45.742 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.467 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:45.793 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:31:50.477 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:45.803 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.425 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:55.751 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.428 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:55.755 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.441 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:34:55.767 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.474 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:55.801 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.481 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:55.808 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.485 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:55.762 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.489 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:55.766 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.495 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:34:55.822 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:00.500 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:34:55.776 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.403 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:05.729 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.446 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:05.722 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.447 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:05.723 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.449 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:05.776 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.464 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:05.741 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.466 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:05.792 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.500 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:05.826 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.502 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:05.829 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:10.514 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:05.841 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.475 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:15.802 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.476 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:15.803 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.487 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:15.814 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.518 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:15.794 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.520 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:15.797 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.522 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:15.849 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.525 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:15.852 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.531 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:15.807 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:20.541 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:15.868 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.497 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:25.773 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.498 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:25.775 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.508 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:25.835 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.511 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:25.837 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.517 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:25.794 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.525 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:25.852 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.561 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:25.887 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.563 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:25.890 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:30.576 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:25.902 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.528 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:35.855 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.532 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:35.858 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.546 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:35.873 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.576 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:35.852 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.578 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:35.854 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.579 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:35.906 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.582 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:35.909 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.593 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:35.920 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:40.594 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:35.869 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.575 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:45.902 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.578 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:45.905 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.590 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:45.917 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.625 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:45.900 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.626 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:45.901 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.627 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:45.954 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.629 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:45.956 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.636 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:45.912 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:32:50.640 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:45.967 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.573 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:55.900 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.578 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:55.905 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.590 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:35:55.917 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.622 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:55.898 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.623 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:55.900 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.627 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:55.954 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.630 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:55.957 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.634 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:35:55.910 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:00.641 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:35:55.968 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.606 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:05.933 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.608 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:05.935 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.621 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:05.946 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.648 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:05.924 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.651 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:05.927 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.655 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:05.982 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.656 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:05.983 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.662 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:05.938 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:10.667 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:05.994 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.631 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:15.957 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.633 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:15.960 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.650 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:15.977 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.676 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:15.952 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.680 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:15.956 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.684 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:16.011 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.689 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:16.015 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.691 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:15.967 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:20.706 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:16.031 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.633 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:25.959 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.676 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:25.952 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.677 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:25.953 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.683 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:26.010 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:25.966 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.699 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:26.026 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.734 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:26.060 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.735 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:26.062 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:30.751 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:26.078 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.709 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:36.036 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.711 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:36.038 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.721 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:36.048 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.737 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:36.014 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.740 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:36.016 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.751 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:36.028 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.759 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:36.085 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.761 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:36.087 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:40.771 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:36.098 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.719 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:46.046 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.721 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:46.047 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.745 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:46.071 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.762 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:46.038 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.765 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:46.042 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.771 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:46.098 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.773 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:46.099 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.776 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:46.052 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:33:50.784 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:46.110 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.746 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:56.072 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.748 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:56.075 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.761 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:36:56.088 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.793 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:56.069 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.796 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:56.072 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.798 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:56.125 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.801 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:56.128 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.807 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:36:56.083 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:00.814 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:36:56.140 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.724 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:06.051 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.768 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:06.044 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.769 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:06.046 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.779 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:06.055 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.805 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:06.130 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.817 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:06.144 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.856 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:06.182 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.859 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:06.186 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:10.873 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:06.199 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.819 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:21.145 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.824 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:21.150 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.842 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:21.168 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.869 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:21.145 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.870 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:21.146 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.875 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:21.202 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.878 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:21.205 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.882 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:21.159 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:25.893 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:21.220 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.846 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:26.172 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.847 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:26.174 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.861 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:26.188 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.894 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:26.171 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.897 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:26.173 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.907 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:26.183 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.922 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:26.248 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.925 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:26.252 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:30.938 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:26.264 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.864 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:41.140 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.865 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:41.141 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.866 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:41.192 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.870 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:41.196 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.878 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:41.155 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.892 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:41.218 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.917 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:41.244 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.924 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:41.250 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:45.936 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:41.263 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.886 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:46.213 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.890 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:46.217 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.904 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:46.230 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.940 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:46.216 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.943 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:46.219 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.953 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:46.229 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.965 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:46.292 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.982 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:46.308 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:50.992 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:46.319 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.154 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:51.481 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.157 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:51.484 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.162 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:51.489 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.163 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:51.440 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.166 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:51.492 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.166 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:51.442 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.173 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:37:51.500 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.182 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:37:51.509 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:34:56.183 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:37:51.459 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.916 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:01.243 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.919 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:01.246 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.930 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:01.257 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.963 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:01.290 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.968 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:01.294 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.980 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:01.306 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.985 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:01.261 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.986 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:01.262 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:05.996 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:01.272 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.931 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:06.258 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.932 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:06.259 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.942 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:06.269 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.978 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:06.254 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.979 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:06.255 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.982 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:06.309 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.983 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:06.310 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.989 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:06.265 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:10.994 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:06.321 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:25.921 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:21.247 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:25.970 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:21.297 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:25.985 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:21.312 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.015 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:21.291 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.017 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:21.293 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.030 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:21.306 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.041 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:21.368 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.042 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:21.369 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:26.060 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:21.387 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:30.984 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:26.310 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:30.986 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:26.312 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:30.995 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:26.322 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.035 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:26.311 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.036 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:26.312 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.037 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:26.363 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.038 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:26.365 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.045 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:26.322 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:31.048 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:26.374 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.020 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:41.347 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.024 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:41.351 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.039 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:41.366 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.070 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:41.346 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.073 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:41.349 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.084 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:41.411 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.085 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:41.361 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.087 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:41.414 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:46.103 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:41.429 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.032 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:46.358 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.036 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:46.363 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.047 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:38:46.373 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.086 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:46.412 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.091 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:46.367 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.092 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:46.418 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.092 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:46.368 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.103 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:38:46.379 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:35:51.105 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:38:46.432 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.073 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:01.400 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.075 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:01.402 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.089 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:01.415 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.127 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:01.403 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.127 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:01.454 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.128 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:01.404 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.128 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:01.455 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.140 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:01.416 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:06.141 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:01.468 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.096 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:06.422 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.097 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:06.424 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.107 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:06.433 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.147 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:06.423 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.148 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:06.425 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.158 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:06.434 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.175 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:06.501 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.176 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:06.503 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:11.189 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:06.516 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.119 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:21.445 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.121 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:21.448 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.136 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:21.463 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.168 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:21.444 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.170 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:21.446 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.171 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:21.498 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.174 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:21.501 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.183 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:21.459 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:26.187 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:21.513 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.131 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:26.458 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.134 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:26.461 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.146 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:26.473 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.179 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:26.455 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.181 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:26.458 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.188 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:26.515 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.191 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:26.518 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.192 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:26.468 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:31.202 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:26.529 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.173 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:41.499 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.177 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:41.504 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.198 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:41.524 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.225 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:41.501 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.228 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:41.504 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.232 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:41.559 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.236 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:41.563 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.240 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:41.517 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:46.250 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:41.577 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.191 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:46.518 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.192 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:46.469 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.194 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:46.521 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.195 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:46.472 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.206 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:39:46.483 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.209 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:39:46.535 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.267 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:46.594 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.273 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:46.599 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:36:51.284 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:39:46.611 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.227 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:01.554 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.229 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:01.556 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.248 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:01.575 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.276 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:01.552 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.279 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:01.556 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.289 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:01.616 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.291 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:01.618 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.292 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:01.568 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:06.306 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:01.633 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.241 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:06.567 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.242 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:06.569 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.254 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:06.581 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.291 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:06.567 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.292 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:06.569 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.294 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:06.621 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.295 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:06.622 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.302 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:06.579 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:11.305 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:06.632 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.283 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:21.610 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.285 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:21.612 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.298 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:21.625 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.337 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:21.614 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.338 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:21.615 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.342 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:21.669 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.344 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:21.671 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.350 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:21.627 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:26.358 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:21.685 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.310 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:26.637 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.312 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:26.639 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.324 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:26.650 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.361 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:26.687 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.362 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:26.689 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.367 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:26.643 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.368 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:26.644 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.374 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:26.701 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:31.380 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:26.656 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.344 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:41.670 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.346 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:41.672 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.364 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:41.691 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.388 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:41.664 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.390 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:41.667 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.393 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:41.720 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.395 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:41.722 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.402 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:41.679 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:46.410 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:41.737 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.307 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:46.634 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.354 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:46.681 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.365 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:40:46.692 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.402 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:46.678 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.406 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:46.682 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.410 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:46.737 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.412 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:46.739 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.416 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:40:46.692 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:37:51.424 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:40:46.750 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.393 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:01.719 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.396 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:01.723 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.409 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:01.736 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.443 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:01.719 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.444 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:01.721 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.445 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:01.772 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.448 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:01.775 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.459 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:01.735 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:06.462 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:01.789 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.644 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:02.971 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.647 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:02.974 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.651 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:02.928 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.653 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:02.930 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.654 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:02.981 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.657 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:02.983 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.665 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:02.992 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.668 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:02.945 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:07.676 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:03.003 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.407 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:06.733 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.410 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:06.737 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.422 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:06.749 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.457 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:06.733 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.459 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:06.736 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.460 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:06.787 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.463 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:06.790 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.468 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:06.745 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:11.477 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:06.803 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.473 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:21.799 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.477 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:21.804 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.495 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:21.821 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.524 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:21.800 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.525 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:21.802 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.527 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:21.854 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.530 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:21.857 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.537 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:21.813 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:26.545 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:21.872 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.471 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:26.798 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.475 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:26.802 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.485 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:26.812 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.521 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:26.848 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.522 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:26.799 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.523 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:26.850 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.524 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:26.800 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.535 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:26.862 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:31.538 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:26.814 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.504 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:41.830 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.519 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:41.846 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.543 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:41.869 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.549 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:41.825 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.553 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:41.829 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.561 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:41.888 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.564 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:41.891 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.567 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:41.843 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:46.580 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:41.907 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.520 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:46.846 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.521 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:46.848 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.531 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:41:46.858 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.571 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:46.847 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.573 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:46.849 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.573 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:46.900 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.577 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:46.904 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.584 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:41:46.860 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:38:51.588 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:41:46.915 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:02.198 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (1378889 ms) 2023-10-11T21:39:02.199 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2023-10-11T21:39:06.550 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:01.877 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.554 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:01.881 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.587 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:01.913 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.601 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:01.878 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.605 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:01.881 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.622 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:01.898 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.623 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:01.949 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.625 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:01.952 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:06.643 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:01.970 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.567 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:06.893 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.569 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:06.896 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.579 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:06.906 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.620 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:06.896 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.621 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:06.897 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.621 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:06.948 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.623 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:06.950 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.633 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:06.909 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:11.634 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:06.960 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.636 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:21.962 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.638 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:21.965 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.652 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:21.979 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.690 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:22.017 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:21.966 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.691 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:21.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.692 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:22.019 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.703 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:21.980 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:26.705 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:22.032 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.638 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:26.964 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.641 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:26.968 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.655 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:26.981 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.689 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:26.965 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.692 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:26.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.694 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:27.021 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.697 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:27.024 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.703 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:26.979 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:31.708 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:27.034 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:42.570 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (40372 ms) 2023-10-11T21:39:42.570 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2023-10-11T21:39:46.661 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:41.988 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.663 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:41.990 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.682 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:42.009 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.713 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:41.990 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.715 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:41.991 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.724 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:42.050 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.734 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:42.010 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.740 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:42.066 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:46.758 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:42.085 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.678 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:47.005 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.682 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:47.009 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.696 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:42:47.023 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.730 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:47.006 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.734 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:47.010 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.737 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:47.064 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.740 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:47.067 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.745 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:42:47.021 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:39:51.751 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:42:47.078 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.725 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:02.052 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.728 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:02.055 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.735 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:02.011 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.738 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:02.015 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.750 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:02.077 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.752 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:02.028 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.782 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:02.109 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.784 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:02.111 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:06.813 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:02.140 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.687 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:07.014 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.738 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:07.064 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.738 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:07.014 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.741 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:07.017 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.752 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:07.079 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.753 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:07.029 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.786 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:07.113 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.791 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:07.118 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:11.806 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:07.133 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.775 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:22.102 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.777 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:22.104 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.795 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:22.122 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.827 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:22.103 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.830 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:22.106 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.836 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:22.163 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.838 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:22.165 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.843 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:22.119 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:26.852 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:22.179 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.785 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:27.112 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.788 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:27.114 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.798 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:27.124 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.838 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:27.165 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.839 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:27.116 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.840 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:27.166 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.840 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:27.117 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.849 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:27.176 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:31.852 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:27.128 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.775 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:42.102 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.828 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:42.154 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.845 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:42.172 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.878 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:42.154 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.879 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:42.206 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.879 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:42.156 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.882 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:42.209 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.894 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:42.170 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:46.898 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:42.225 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.842 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:47.169 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.844 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:47.171 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.855 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:43:47.181 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.890 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:47.217 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.893 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:47.220 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.894 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:47.170 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.895 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:47.171 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.904 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:43:47.231 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:40:51.905 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:43:47.181 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.875 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:02.202 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.879 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:02.206 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.895 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:02.221 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.926 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:02.203 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.929 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:02.206 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.930 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:02.257 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.933 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:02.260 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.943 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:02.219 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:06.947 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:02.274 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.893 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.220 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.895 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.222 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.909 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.235 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.946 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.222 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.948 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.225 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.961 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.237 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.965 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.292 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.968 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.295 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:11.978 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.305 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.281 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.557 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.283 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.560 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.300 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:07.576 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.309 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.636 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.312 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.639 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.340 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.667 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.342 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.669 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.385 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:07.712 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:12.415 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:07.742 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:19.044 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (96474 ms) 2023-10-11T21:41:19.045 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2023-10-11T21:41:27.062 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:22.388 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.065 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:22.392 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.082 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:22.408 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.112 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:22.388 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.112 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:22.389 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.115 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:22.442 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.117 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:22.444 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.128 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:22.405 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:27.141 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:22.468 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:31.994 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:27.320 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:31.996 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:27.323 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.010 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:27.337 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.047 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:27.374 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.047 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:27.323 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.049 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:27.326 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.050 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:27.376 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.060 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:27.387 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:32.061 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:27.336 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.039 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.365 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.042 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.369 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.060 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.387 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.092 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.418 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.094 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.421 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.100 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.376 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.103 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.379 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.115 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.442 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.118 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.394 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.452 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.728 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.453 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.729 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.461 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:44:47.738 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.511 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.837 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.512 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.838 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.521 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:44:47.848 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.529 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.856 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.531 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.858 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:41:52.539 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:44:47.866 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.098 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.424 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.099 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.426 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.113 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.440 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.149 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.476 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.150 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.426 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.150 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.477 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.151 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.427 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.164 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.440 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.165 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.492 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.423 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.750 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.424 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.751 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.433 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:07.760 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.439 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.715 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.440 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.716 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.449 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:07.725 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.469 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.795 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.470 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.797 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:12.478 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:07.805 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.308 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:27.635 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.313 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:27.640 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.334 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:27.661 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.358 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:27.634 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.361 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:27.638 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.379 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:27.656 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.392 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:27.719 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.395 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:27.722 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:32.417 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:27.744 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.191 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.518 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.246 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.573 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.269 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.596 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.293 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.569 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.295 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.571 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.299 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:47.625 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.300 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:47.626 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.313 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.589 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.322 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:47.649 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.605 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.881 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.605 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.882 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.614 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:45:47.890 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.628 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.955 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.629 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.956 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.638 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:45:47.964 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.694 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:48.021 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.695 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:48.022 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:42:52.704 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:45:48.031 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.295 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:07.622 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.299 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:07.626 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.321 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:07.648 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.349 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.625 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.350 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.627 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.351 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:07.677 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.354 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:07.681 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.365 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.642 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.372 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:07.699 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.661 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.937 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.662 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.938 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.670 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:07.946 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.690 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:08.017 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.691 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:08.018 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.703 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:08.030 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.711 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:08.038 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.713 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:08.040 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:12.724 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:08.051 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.347 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:27.674 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.349 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:27.676 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.365 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:27.692 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.401 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.677 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.402 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.679 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.403 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:27.729 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.404 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:27.731 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.417 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.693 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.418 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:27.745 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.711 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.987 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.711 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.988 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.719 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:27.996 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.754 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:28.080 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.755 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:28.082 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.760 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:28.087 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.762 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:28.089 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.764 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:28.090 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:32.772 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:28.099 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:42.665 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (143621 ms) 2023-10-11T21:43:42.665 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 22 tests from TestCls2PCQueue (2667191 ms total) 2023-10-11T21:43:42.666 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:43:42.666 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:43:42.666 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 22 tests from 1 test suite ran. (2667191 ms total) 2023-10-11T21:43:42.666 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 22 tests. 2023-10-11T21:43:42.667 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:43:42.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:43:42.740 INFO:tasks.workunit:Running workunit cls/test_cls_cas.sh... 2023-10-11T21:43:42.741 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_cas.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cas.sh 2023-10-11T21:43:42.815 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:43:42.815 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 6 tests from 2 test suites. 2023-10-11T21:43:42.816 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:43:42.816 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 5 tests from cls_cas 2023-10-11T21:43:42.816 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_cas.get_put 2023-10-11T21:43:45.894 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_cas.get_put (3079 ms) 2023-10-11T21:43:45.894 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_cas.wrong_put 2023-10-11T21:43:48.526 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_cas.wrong_put (2632 ms) 2023-10-11T21:43:48.527 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_cas.dup_get 2023-10-11T21:43:51.816 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_cas.dup_get (3290 ms) 2023-10-11T21:43:51.817 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_cas.dup_put 2023-10-11T21:43:52.439 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:47.766 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.441 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:47.768 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.467 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:47.794 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.485 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:47.761 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.488 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:47.764 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.497 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:47.824 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.498 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:47.825 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.512 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:47.788 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.522 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:47.849 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.834 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:48.111 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.835 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:48.112 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.845 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:46:48.121 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.949 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:48.275 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.950 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:48.277 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.955 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:48.282 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.960 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:48.286 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.964 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:46:48.291 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:52.973 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:46:48.300 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:43:54.928 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_cas.dup_put (3112 ms) 2023-10-11T21:43:54.928 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_cas.get_wrong_data 2023-10-11T21:44:04.753 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_cas.get_wrong_data (9824 ms) 2023-10-11T21:44:04.754 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 5 tests from cls_cas (21937 ms total) 2023-10-11T21:44:04.754 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:44:04.754 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 1 test from chunk_refs_t 2023-10-11T21:44:04.754 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] chunk_refs_t.size 2023-10-11T21:44:04.754 INFO:tasks.workunit.client.0.smithi022.stdout:1 60 by_object 2023-10-11T21:44:04.755 INFO:tasks.workunit.client.0.smithi022.stdout:2 103 by_object 2023-10-11T21:44:04.755 INFO:tasks.workunit.client.0.smithi022.stdout:4 189 by_object 2023-10-11T21:44:04.755 INFO:tasks.workunit.client.0.smithi022.stdout:8 361 by_object 2023-10-11T21:44:04.755 INFO:tasks.workunit.client.0.smithi022.stdout:16 112 by_hash(32 bits) 2023-10-11T21:44:04.755 INFO:tasks.workunit.client.0.smithi022.stdout:32 208 by_hash(32 bits) 2023-10-11T21:44:04.756 INFO:tasks.workunit.client.0.smithi022.stdout:64 400 by_hash(32 bits) 2023-10-11T21:44:04.756 INFO:tasks.workunit.client.0.smithi022.stdout:128 509 by_hash(10 bits) 2023-10-11T21:44:04.756 INFO:tasks.workunit.client.0.smithi022.stdout:256 499 by_hash(7 bits) 2023-10-11T21:44:04.756 INFO:tasks.workunit.client.0.smithi022.stdout:512 462 by_hash(5 bits) 2023-10-11T21:44:04.757 INFO:tasks.workunit.client.0.smithi022.stdout:1024 466 by_hash(5 bits) 2023-10-11T21:44:04.757 INFO:tasks.workunit.client.0.smithi022.stdout:2048 466 by_hash(5 bits) 2023-10-11T21:44:04.758 INFO:tasks.workunit.client.0.smithi022.stdout:4096 470 by_hash(5 bits) 2023-10-11T21:44:04.758 INFO:tasks.workunit.client.0.smithi022.stdout:8192 498 by_hash(4 bits) 2023-10-11T21:44:04.758 INFO:tasks.workunit.client.0.smithi022.stdout:16384 278 by_hash(3 bits) 2023-10-11T21:44:04.759 INFO:tasks.workunit.client.0.smithi022.stdout:32768 337 by_hash(2 bits) 2023-10-11T21:44:04.763 INFO:tasks.workunit.client.0.smithi022.stdout:65536 367 by_hash(2 bits) 2023-10-11T21:44:04.771 INFO:tasks.workunit.client.0.smithi022.stdout:131072 387 by_hash(1 bits) 2023-10-11T21:44:04.786 INFO:tasks.workunit.client.0.smithi022.stdout:262144 331 by_pool 2023-10-11T21:44:04.815 INFO:tasks.workunit.client.0.smithi022.stdout:524288 21 count 2023-10-11T21:44:04.868 INFO:tasks.workunit.client.0.smithi022.stdout:1048576 21 count 2023-10-11T21:44:04.986 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] chunk_refs_t.size (234 ms) 2023-10-11T21:44:04.986 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 1 test from chunk_refs_t (234 ms total) 2023-10-11T21:44:04.987 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:44:04.987 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:44:04.987 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 6 tests from 2 test suites ran. (22171 ms total) 2023-10-11T21:44:04.987 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 6 tests. 2023-10-11T21:44:04.988 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:44:04.989 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:44:05.059 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2023-10-11T21:44:05.059 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2023-10-11T21:44:05.129 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:44:05.130 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 31 tests from 1 test suite. 2023-10-11T21:44:05.130 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:44:06.817 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 31 tests from CmpOmap 2023-10-11T21:44:06.818 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2023-10-11T21:44:06.848 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:02.174 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.851 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:02.178 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.861 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.137 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.864 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.140 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.885 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.212 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.887 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.214 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.889 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:02.216 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.899 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.176 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:06.926 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.253 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.533 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.809 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.535 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.862 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.541 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.868 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.583 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.859 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.592 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:02.868 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.609 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:02.936 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.682 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:03.008 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.686 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:03.013 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:07.768 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:03.094 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:08.277 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (1460 ms) 2023-10-11T21:44:08.278 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2023-10-11T21:44:08.367 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (90 ms) 2023-10-11T21:44:08.367 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2023-10-11T21:44:08.447 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (80 ms) 2023-10-11T21:44:08.448 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2023-10-11T21:44:08.536 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (89 ms) 2023-10-11T21:44:08.537 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_str 2023-10-11T21:44:08.713 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_str (178 ms) 2023-10-11T21:44:08.714 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2023-10-11T21:44:08.861 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_u64 (147 ms) 2023-10-11T21:44:08.861 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2023-10-11T21:44:12.557 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:07.884 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.560 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:07.887 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.570 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:07.897 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.606 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:07.883 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.607 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:07.884 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.612 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:07.939 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.614 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:07.941 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.617 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:07.894 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:12.629 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:07.955 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.604 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:22.931 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.606 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:22.933 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.620 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:22.946 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.653 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:22.929 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.656 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:22.932 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.661 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:22.988 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.662 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:22.989 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.670 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:22.946 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:27.676 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:23.003 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.640 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:27.966 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.641 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:27.968 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.651 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:27.978 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:27.966 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.692 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:27.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.695 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:28.022 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.698 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:28.024 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.702 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:27.979 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:32.712 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:28.038 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:39.241 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:39.236+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:40.253 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:40.251+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:41.281 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:41.279+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:42.295 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:42.293+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:42.591 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:37.918 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.637 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:37.914 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.638 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:37.915 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.649 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:37.976 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.650 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:37.927 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.666 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:37.992 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.701 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:38.028 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.702 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:38.029 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:42.719 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:38.046 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:43.302 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:43.301+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:44.289 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:44.287+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:45.299 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:45.297+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:46.273 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:46.271+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:47.294 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:47.292+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:48.344 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:48.342+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:49.386 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:49.384+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:50.403 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:50.402+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:51.434 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:51.432+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:52.478 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:52.476+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:52.669 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:47.996 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.671 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:47.998 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.690 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:48.017 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.714 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:47.990 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.716 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:47.993 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.726 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:48.052 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.729 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:48.006 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.739 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:48.066 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:52.755 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:48.082 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:53.483 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:53.482+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:54.513 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:54.512+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:55.487 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:55.484+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:56.467 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:44:56.464+0000 f25a640 -1 osd.6 142 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4582.0:68 30.18 30.19f15cb8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e141) 2023-10-11T21:44:56.708 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (47847 ms) 2023-10-11T21:44:56.708 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2023-10-11T21:44:56.802 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (94 ms) 2023-10-11T21:44:56.802 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2023-10-11T21:44:56.863 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (61 ms) 2023-10-11T21:44:56.864 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2023-10-11T21:44:56.961 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (98 ms) 2023-10-11T21:44:56.962 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2023-10-11T21:44:56.962 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2023-10-11T21:44:56.962 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2023-10-11T21:44:56.963 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2023-10-11T21:44:56.963 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2023-10-11T21:44:57.148 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (185 ms) 2023-10-11T21:44:57.148 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2023-10-11T21:44:57.351 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (203 ms) 2023-10-11T21:44:57.351 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2023-10-11T21:44:57.521 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (171 ms) 2023-10-11T21:44:57.522 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2023-10-11T21:44:57.732 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:53.059 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.735 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:53.011 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.736 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:53.013 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.738 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:53.065 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.751 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:47:53.028 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.753 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:47:53.080 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.799 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:53.126 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.804 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (283 ms) 2023-10-11T21:44:57.805 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2023-10-11T21:44:57.805 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:53.132 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:57.822 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:47:53.149 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:44:58.106 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_str (301 ms) 2023-10-11T21:44:58.107 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2023-10-11T21:44:58.305 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (199 ms) 2023-10-11T21:44:58.306 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2023-10-11T21:44:58.355 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (50 ms) 2023-10-11T21:44:58.356 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2023-10-11T21:44:58.422 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (67 ms) 2023-10-11T21:44:58.422 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2023-10-11T21:44:58.423 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2023-10-11T21:44:58.423 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2023-10-11T21:44:58.423 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2023-10-11T21:44:58.423 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2023-10-11T21:44:58.560 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (136 ms) 2023-10-11T21:44:58.560 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2023-10-11T21:44:58.684 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (124 ms) 2023-10-11T21:44:58.685 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2023-10-11T21:44:58.842 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (158 ms) 2023-10-11T21:44:58.842 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2023-10-11T21:44:59.115 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (273 ms) 2023-10-11T21:44:59.115 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2023-10-11T21:44:59.272 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (157 ms) 2023-10-11T21:44:59.272 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2023-10-11T21:44:59.331 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (59 ms) 2023-10-11T21:44:59.332 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2023-10-11T21:44:59.332 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2023-10-11T21:44:59.332 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2023-10-11T21:44:59.333 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2023-10-11T21:44:59.333 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2023-10-11T21:44:59.499 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (166 ms) 2023-10-11T21:44:59.499 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 31 tests from CmpOmap (52682 ms total) 2023-10-11T21:44:59.500 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:44:59.500 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:45:00.046 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 31 tests from 1 test suite ran. (54917 ms total) 2023-10-11T21:45:00.047 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 31 tests. 2023-10-11T21:45:00.049 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:45:00.049 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:45:00.128 INFO:tasks.workunit:Running workunit cls/test_cls_hello.sh... 2023-10-11T21:45:00.128 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_hello.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_hello.sh 2023-10-11T21:45:00.201 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:45:00.201 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 6 tests from 1 test suite. 2023-10-11T21:45:00.202 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:45:00.202 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 6 tests from ClsHello 2023-10-11T21:45:00.202 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.SayHello 2023-10-11T21:45:03.775 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.SayHello (3574 ms) 2023-10-11T21:45:03.776 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.RecordHello 2023-10-11T21:45:07.019 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.RecordHello (3244 ms) 2023-10-11T21:45:07.019 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.WriteReturnData 2023-10-11T21:45:08.861 INFO:tasks.workunit.client.0.smithi022.stdout:require_osd_release = reef 2023-10-11T21:45:09.094 INFO:tasks.workunit.client.0.smithi022.stdout:0 2023-10-11T21:45:09.125 INFO:tasks.workunit.client.0.smithi022.stdout:1 2023-10-11T21:45:09.148 INFO:tasks.workunit.client.0.smithi022.stdout:2 2023-10-11T21:45:09.169 INFO:tasks.workunit.client.0.smithi022.stdout:3 2023-10-11T21:45:09.190 INFO:tasks.workunit.client.0.smithi022.stdout:4 2023-10-11T21:45:09.209 INFO:tasks.workunit.client.0.smithi022.stdout:5 2023-10-11T21:45:09.228 INFO:tasks.workunit.client.0.smithi022.stdout:6 2023-10-11T21:45:09.246 INFO:tasks.workunit.client.0.smithi022.stdout:7 2023-10-11T21:45:09.270 INFO:tasks.workunit.client.0.smithi022.stdout:8 2023-10-11T21:45:09.287 INFO:tasks.workunit.client.0.smithi022.stdout:9 2023-10-11T21:45:09.305 INFO:tasks.workunit.client.0.smithi022.stdout:10 2023-10-11T21:45:09.324 INFO:tasks.workunit.client.0.smithi022.stdout:11 2023-10-11T21:45:09.342 INFO:tasks.workunit.client.0.smithi022.stdout:12 2023-10-11T21:45:09.363 INFO:tasks.workunit.client.0.smithi022.stdout:13 2023-10-11T21:45:09.383 INFO:tasks.workunit.client.0.smithi022.stdout:14 2023-10-11T21:45:09.401 INFO:tasks.workunit.client.0.smithi022.stdout:15 2023-10-11T21:45:09.419 INFO:tasks.workunit.client.0.smithi022.stdout:16 2023-10-11T21:45:09.437 INFO:tasks.workunit.client.0.smithi022.stdout:17 2023-10-11T21:45:09.459 INFO:tasks.workunit.client.0.smithi022.stdout:18 2023-10-11T21:45:09.478 INFO:tasks.workunit.client.0.smithi022.stdout:19 2023-10-11T21:45:09.495 INFO:tasks.workunit.client.0.smithi022.stdout:20 2023-10-11T21:45:09.513 INFO:tasks.workunit.client.0.smithi022.stdout:21 2023-10-11T21:45:09.533 INFO:tasks.workunit.client.0.smithi022.stdout:22 2023-10-11T21:45:09.551 INFO:tasks.workunit.client.0.smithi022.stdout:23 2023-10-11T21:45:09.570 INFO:tasks.workunit.client.0.smithi022.stdout:24 2023-10-11T21:45:09.588 INFO:tasks.workunit.client.0.smithi022.stdout:25 2023-10-11T21:45:09.607 INFO:tasks.workunit.client.0.smithi022.stdout:26 2023-10-11T21:45:09.626 INFO:tasks.workunit.client.0.smithi022.stdout:27 2023-10-11T21:45:09.645 INFO:tasks.workunit.client.0.smithi022.stdout:28 2023-10-11T21:45:09.664 INFO:tasks.workunit.client.0.smithi022.stdout:29 2023-10-11T21:45:09.681 INFO:tasks.workunit.client.0.smithi022.stdout:30 2023-10-11T21:45:09.699 INFO:tasks.workunit.client.0.smithi022.stdout:31 2023-10-11T21:45:09.731 INFO:tasks.workunit.client.0.smithi022.stdout:32 2023-10-11T21:45:09.750 INFO:tasks.workunit.client.0.smithi022.stdout:33 2023-10-11T21:45:09.770 INFO:tasks.workunit.client.0.smithi022.stdout:34 2023-10-11T21:45:09.790 INFO:tasks.workunit.client.0.smithi022.stdout:35 2023-10-11T21:45:09.833 INFO:tasks.workunit.client.0.smithi022.stdout:36 2023-10-11T21:45:09.908 INFO:tasks.workunit.client.0.smithi022.stdout:37 2023-10-11T21:45:09.928 INFO:tasks.workunit.client.0.smithi022.stdout:38 2023-10-11T21:45:09.945 INFO:tasks.workunit.client.0.smithi022.stdout:39 2023-10-11T21:45:09.965 INFO:tasks.workunit.client.0.smithi022.stdout:40 2023-10-11T21:45:09.985 INFO:tasks.workunit.client.0.smithi022.stdout:41 2023-10-11T21:45:10.004 INFO:tasks.workunit.client.0.smithi022.stdout:42 2023-10-11T21:45:10.026 INFO:tasks.workunit.client.0.smithi022.stdout:43 2023-10-11T21:45:10.049 INFO:tasks.workunit.client.0.smithi022.stdout:44 2023-10-11T21:45:10.069 INFO:tasks.workunit.client.0.smithi022.stdout:45 2023-10-11T21:45:10.091 INFO:tasks.workunit.client.0.smithi022.stdout:46 2023-10-11T21:45:10.112 INFO:tasks.workunit.client.0.smithi022.stdout:47 2023-10-11T21:45:10.131 INFO:tasks.workunit.client.0.smithi022.stdout:48 2023-10-11T21:45:10.151 INFO:tasks.workunit.client.0.smithi022.stdout:49 2023-10-11T21:45:10.182 INFO:tasks.workunit.client.0.smithi022.stdout:50 2023-10-11T21:45:10.202 INFO:tasks.workunit.client.0.smithi022.stdout:51 2023-10-11T21:45:10.223 INFO:tasks.workunit.client.0.smithi022.stdout:52 2023-10-11T21:45:10.243 INFO:tasks.workunit.client.0.smithi022.stdout:53 2023-10-11T21:45:10.263 INFO:tasks.workunit.client.0.smithi022.stdout:54 2023-10-11T21:45:10.282 INFO:tasks.workunit.client.0.smithi022.stdout:55 2023-10-11T21:45:10.302 INFO:tasks.workunit.client.0.smithi022.stdout:56 2023-10-11T21:45:10.321 INFO:tasks.workunit.client.0.smithi022.stdout:57 2023-10-11T21:45:10.344 INFO:tasks.workunit.client.0.smithi022.stdout:58 2023-10-11T21:45:10.364 INFO:tasks.workunit.client.0.smithi022.stdout:59 2023-10-11T21:45:10.385 INFO:tasks.workunit.client.0.smithi022.stdout:60 2023-10-11T21:45:10.404 INFO:tasks.workunit.client.0.smithi022.stdout:61 2023-10-11T21:45:10.424 INFO:tasks.workunit.client.0.smithi022.stdout:62 2023-10-11T21:45:10.443 INFO:tasks.workunit.client.0.smithi022.stdout:63 2023-10-11T21:45:10.465 INFO:tasks.workunit.client.0.smithi022.stdout:64 2023-10-11T21:45:10.484 INFO:tasks.workunit.client.0.smithi022.stdout:65 2023-10-11T21:45:10.504 INFO:tasks.workunit.client.0.smithi022.stdout:66 2023-10-11T21:45:10.524 INFO:tasks.workunit.client.0.smithi022.stdout:67 2023-10-11T21:45:10.543 INFO:tasks.workunit.client.0.smithi022.stdout:68 2023-10-11T21:45:10.563 INFO:tasks.workunit.client.0.smithi022.stdout:69 2023-10-11T21:45:10.589 INFO:tasks.workunit.client.0.smithi022.stdout:70 2023-10-11T21:45:10.610 INFO:tasks.workunit.client.0.smithi022.stdout:71 2023-10-11T21:45:10.631 INFO:tasks.workunit.client.0.smithi022.stdout:72 2023-10-11T21:45:10.649 INFO:tasks.workunit.client.0.smithi022.stdout:73 2023-10-11T21:45:10.669 INFO:tasks.workunit.client.0.smithi022.stdout:74 2023-10-11T21:45:10.688 INFO:tasks.workunit.client.0.smithi022.stdout:75 2023-10-11T21:45:10.707 INFO:tasks.workunit.client.0.smithi022.stdout:76 2023-10-11T21:45:10.726 INFO:tasks.workunit.client.0.smithi022.stdout:77 2023-10-11T21:45:10.742 INFO:tasks.workunit.client.0.smithi022.stdout:78 2023-10-11T21:45:10.761 INFO:tasks.workunit.client.0.smithi022.stdout:79 2023-10-11T21:45:10.778 INFO:tasks.workunit.client.0.smithi022.stdout:80 2023-10-11T21:45:10.797 INFO:tasks.workunit.client.0.smithi022.stdout:81 2023-10-11T21:45:10.817 INFO:tasks.workunit.client.0.smithi022.stdout:82 2023-10-11T21:45:10.837 INFO:tasks.workunit.client.0.smithi022.stdout:83 2023-10-11T21:45:10.856 INFO:tasks.workunit.client.0.smithi022.stdout:84 2023-10-11T21:45:10.877 INFO:tasks.workunit.client.0.smithi022.stdout:85 2023-10-11T21:45:10.896 INFO:tasks.workunit.client.0.smithi022.stdout:86 2023-10-11T21:45:10.918 INFO:tasks.workunit.client.0.smithi022.stdout:87 2023-10-11T21:45:10.942 INFO:tasks.workunit.client.0.smithi022.stdout:88 2023-10-11T21:45:10.966 INFO:tasks.workunit.client.0.smithi022.stdout:89 2023-10-11T21:45:10.987 INFO:tasks.workunit.client.0.smithi022.stdout:90 2023-10-11T21:45:11.011 INFO:tasks.workunit.client.0.smithi022.stdout:91 2023-10-11T21:45:11.033 INFO:tasks.workunit.client.0.smithi022.stdout:92 2023-10-11T21:45:11.055 INFO:tasks.workunit.client.0.smithi022.stdout:93 2023-10-11T21:45:11.077 INFO:tasks.workunit.client.0.smithi022.stdout:94 2023-10-11T21:45:11.098 INFO:tasks.workunit.client.0.smithi022.stdout:95 2023-10-11T21:45:11.116 INFO:tasks.workunit.client.0.smithi022.stdout:96 2023-10-11T21:45:11.136 INFO:tasks.workunit.client.0.smithi022.stdout:97 2023-10-11T21:45:11.156 INFO:tasks.workunit.client.0.smithi022.stdout:98 2023-10-11T21:45:11.175 INFO:tasks.workunit.client.0.smithi022.stdout:99 2023-10-11T21:45:11.194 INFO:tasks.workunit.client.0.smithi022.stdout:100 2023-10-11T21:45:11.214 INFO:tasks.workunit.client.0.smithi022.stdout:101 2023-10-11T21:45:11.234 INFO:tasks.workunit.client.0.smithi022.stdout:102 2023-10-11T21:45:11.254 INFO:tasks.workunit.client.0.smithi022.stdout:103 2023-10-11T21:45:11.272 INFO:tasks.workunit.client.0.smithi022.stdout:104 2023-10-11T21:45:11.290 INFO:tasks.workunit.client.0.smithi022.stdout:105 2023-10-11T21:45:11.307 INFO:tasks.workunit.client.0.smithi022.stdout:106 2023-10-11T21:45:11.327 INFO:tasks.workunit.client.0.smithi022.stdout:107 2023-10-11T21:45:11.346 INFO:tasks.workunit.client.0.smithi022.stdout:108 2023-10-11T21:45:11.364 INFO:tasks.workunit.client.0.smithi022.stdout:109 2023-10-11T21:45:11.386 INFO:tasks.workunit.client.0.smithi022.stdout:110 2023-10-11T21:45:11.406 INFO:tasks.workunit.client.0.smithi022.stdout:111 2023-10-11T21:45:11.425 INFO:tasks.workunit.client.0.smithi022.stdout:112 2023-10-11T21:45:11.444 INFO:tasks.workunit.client.0.smithi022.stdout:113 2023-10-11T21:45:11.465 INFO:tasks.workunit.client.0.smithi022.stdout:114 2023-10-11T21:45:11.483 INFO:tasks.workunit.client.0.smithi022.stdout:115 2023-10-11T21:45:11.503 INFO:tasks.workunit.client.0.smithi022.stdout:116 2023-10-11T21:45:11.523 INFO:tasks.workunit.client.0.smithi022.stdout:117 2023-10-11T21:45:11.542 INFO:tasks.workunit.client.0.smithi022.stdout:118 2023-10-11T21:45:11.560 INFO:tasks.workunit.client.0.smithi022.stdout:119 2023-10-11T21:45:11.578 INFO:tasks.workunit.client.0.smithi022.stdout:120 2023-10-11T21:45:11.597 INFO:tasks.workunit.client.0.smithi022.stdout:121 2023-10-11T21:45:11.617 INFO:tasks.workunit.client.0.smithi022.stdout:122 2023-10-11T21:45:11.637 INFO:tasks.workunit.client.0.smithi022.stdout:123 2023-10-11T21:45:11.657 INFO:tasks.workunit.client.0.smithi022.stdout:124 2023-10-11T21:45:11.676 INFO:tasks.workunit.client.0.smithi022.stdout:125 2023-10-11T21:45:11.696 INFO:tasks.workunit.client.0.smithi022.stdout:126 2023-10-11T21:45:11.715 INFO:tasks.workunit.client.0.smithi022.stdout:127 2023-10-11T21:45:11.733 INFO:tasks.workunit.client.0.smithi022.stdout:128 2023-10-11T21:45:11.753 INFO:tasks.workunit.client.0.smithi022.stdout:129 2023-10-11T21:45:11.772 INFO:tasks.workunit.client.0.smithi022.stdout:130 2023-10-11T21:45:11.791 INFO:tasks.workunit.client.0.smithi022.stdout:131 2023-10-11T21:45:11.809 INFO:tasks.workunit.client.0.smithi022.stdout:132 2023-10-11T21:45:11.834 INFO:tasks.workunit.client.0.smithi022.stdout:133 2023-10-11T21:45:11.853 INFO:tasks.workunit.client.0.smithi022.stdout:134 2023-10-11T21:45:11.887 INFO:tasks.workunit.client.0.smithi022.stdout:135 2023-10-11T21:45:11.945 INFO:tasks.workunit.client.0.smithi022.stdout:136 2023-10-11T21:45:11.966 INFO:tasks.workunit.client.0.smithi022.stdout:137 2023-10-11T21:45:11.985 INFO:tasks.workunit.client.0.smithi022.stdout:138 2023-10-11T21:45:12.004 INFO:tasks.workunit.client.0.smithi022.stdout:139 2023-10-11T21:45:12.027 INFO:tasks.workunit.client.0.smithi022.stdout:140 2023-10-11T21:45:12.051 INFO:tasks.workunit.client.0.smithi022.stdout:141 2023-10-11T21:45:12.075 INFO:tasks.workunit.client.0.smithi022.stdout:142 2023-10-11T21:45:12.096 INFO:tasks.workunit.client.0.smithi022.stdout:143 2023-10-11T21:45:12.117 INFO:tasks.workunit.client.0.smithi022.stdout:144 2023-10-11T21:45:12.138 INFO:tasks.workunit.client.0.smithi022.stdout:145 2023-10-11T21:45:12.158 INFO:tasks.workunit.client.0.smithi022.stdout:146 2023-10-11T21:45:12.184 INFO:tasks.workunit.client.0.smithi022.stdout:147 2023-10-11T21:45:12.206 INFO:tasks.workunit.client.0.smithi022.stdout:148 2023-10-11T21:45:12.227 INFO:tasks.workunit.client.0.smithi022.stdout:149 2023-10-11T21:45:12.245 INFO:tasks.workunit.client.0.smithi022.stdout:150 2023-10-11T21:45:12.264 INFO:tasks.workunit.client.0.smithi022.stdout:151 2023-10-11T21:45:12.285 INFO:tasks.workunit.client.0.smithi022.stdout:152 2023-10-11T21:45:12.303 INFO:tasks.workunit.client.0.smithi022.stdout:153 2023-10-11T21:45:12.323 INFO:tasks.workunit.client.0.smithi022.stdout:154 2023-10-11T21:45:12.342 INFO:tasks.workunit.client.0.smithi022.stdout:155 2023-10-11T21:45:12.396 INFO:tasks.workunit.client.0.smithi022.stdout:156 2023-10-11T21:45:12.418 INFO:tasks.workunit.client.0.smithi022.stdout:157 2023-10-11T21:45:12.439 INFO:tasks.workunit.client.0.smithi022.stdout:158 2023-10-11T21:45:12.459 INFO:tasks.workunit.client.0.smithi022.stdout:159 2023-10-11T21:45:12.480 INFO:tasks.workunit.client.0.smithi022.stdout:160 2023-10-11T21:45:12.500 INFO:tasks.workunit.client.0.smithi022.stdout:161 2023-10-11T21:45:12.519 INFO:tasks.workunit.client.0.smithi022.stdout:162 2023-10-11T21:45:12.537 INFO:tasks.workunit.client.0.smithi022.stdout:163 2023-10-11T21:45:12.558 INFO:tasks.workunit.client.0.smithi022.stdout:164 2023-10-11T21:45:12.577 INFO:tasks.workunit.client.0.smithi022.stdout:165 2023-10-11T21:45:12.597 INFO:tasks.workunit.client.0.smithi022.stdout:166 2023-10-11T21:45:12.615 INFO:tasks.workunit.client.0.smithi022.stdout:167 2023-10-11T21:45:12.635 INFO:tasks.workunit.client.0.smithi022.stdout:168 2023-10-11T21:45:12.654 INFO:tasks.workunit.client.0.smithi022.stdout:169 2023-10-11T21:45:12.673 INFO:tasks.workunit.client.0.smithi022.stdout:170 2023-10-11T21:45:12.693 INFO:tasks.workunit.client.0.smithi022.stdout:171 2023-10-11T21:45:12.713 INFO:tasks.workunit.client.0.smithi022.stdout:172 2023-10-11T21:45:12.734 INFO:tasks.workunit.client.0.smithi022.stdout:173 2023-10-11T21:45:12.755 INFO:tasks.workunit.client.0.smithi022.stdout:174 2023-10-11T21:45:12.775 INFO:tasks.workunit.client.0.smithi022.stdout:175 2023-10-11T21:45:12.796 INFO:tasks.workunit.client.0.smithi022.stdout:176 2023-10-11T21:45:12.819 INFO:tasks.workunit.client.0.smithi022.stdout:177 2023-10-11T21:45:12.840 INFO:tasks.workunit.client.0.smithi022.stdout:178 2023-10-11T21:45:12.861 INFO:tasks.workunit.client.0.smithi022.stdout:179 2023-10-11T21:45:12.875 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:08.202 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.876 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:08.203 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.883 INFO:tasks.workunit.client.0.smithi022.stdout:180 2023-10-11T21:45:12.902 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:08.228 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.902 INFO:tasks.workunit.client.0.smithi022.stdout:181 2023-10-11T21:45:12.925 INFO:tasks.workunit.client.0.smithi022.stdout:182 2023-10-11T21:45:12.926 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:08.202 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.928 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:08.204 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.933 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:08.260 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.935 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:08.262 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.945 INFO:tasks.workunit.client.0.smithi022.stdout:183 2023-10-11T21:45:12.954 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:08.230 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.962 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:08.289 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:12.967 INFO:tasks.workunit.client.0.smithi022.stdout:184 2023-10-11T21:45:12.987 INFO:tasks.workunit.client.0.smithi022.stdout:185 2023-10-11T21:45:13.011 INFO:tasks.workunit.client.0.smithi022.stdout:186 2023-10-11T21:45:13.032 INFO:tasks.workunit.client.0.smithi022.stdout:187 2023-10-11T21:45:13.055 INFO:tasks.workunit.client.0.smithi022.stdout:188 2023-10-11T21:45:13.079 INFO:tasks.workunit.client.0.smithi022.stdout:189 2023-10-11T21:45:13.100 INFO:tasks.workunit.client.0.smithi022.stdout:190 2023-10-11T21:45:13.121 INFO:tasks.workunit.client.0.smithi022.stdout:191 2023-10-11T21:45:13.141 INFO:tasks.workunit.client.0.smithi022.stdout:192 2023-10-11T21:45:13.164 INFO:tasks.workunit.client.0.smithi022.stdout:193 2023-10-11T21:45:13.187 INFO:tasks.workunit.client.0.smithi022.stdout:194 2023-10-11T21:45:13.211 INFO:tasks.workunit.client.0.smithi022.stdout:195 2023-10-11T21:45:13.257 INFO:tasks.workunit.client.0.smithi022.stdout:196 2023-10-11T21:45:13.288 INFO:tasks.workunit.client.0.smithi022.stdout:197 2023-10-11T21:45:13.313 INFO:tasks.workunit.client.0.smithi022.stdout:198 2023-10-11T21:45:13.338 INFO:tasks.workunit.client.0.smithi022.stdout:199 2023-10-11T21:45:13.359 INFO:tasks.workunit.client.0.smithi022.stdout:200 2023-10-11T21:45:13.381 INFO:tasks.workunit.client.0.smithi022.stdout:201 2023-10-11T21:45:13.402 INFO:tasks.workunit.client.0.smithi022.stdout:202 2023-10-11T21:45:13.423 INFO:tasks.workunit.client.0.smithi022.stdout:203 2023-10-11T21:45:13.443 INFO:tasks.workunit.client.0.smithi022.stdout:204 2023-10-11T21:45:13.463 INFO:tasks.workunit.client.0.smithi022.stdout:205 2023-10-11T21:45:13.485 INFO:tasks.workunit.client.0.smithi022.stdout:206 2023-10-11T21:45:13.505 INFO:tasks.workunit.client.0.smithi022.stdout:207 2023-10-11T21:45:13.525 INFO:tasks.workunit.client.0.smithi022.stdout:208 2023-10-11T21:45:13.545 INFO:tasks.workunit.client.0.smithi022.stdout:209 2023-10-11T21:45:13.564 INFO:tasks.workunit.client.0.smithi022.stdout:210 2023-10-11T21:45:13.583 INFO:tasks.workunit.client.0.smithi022.stdout:211 2023-10-11T21:45:13.604 INFO:tasks.workunit.client.0.smithi022.stdout:212 2023-10-11T21:45:13.624 INFO:tasks.workunit.client.0.smithi022.stdout:213 2023-10-11T21:45:13.655 INFO:tasks.workunit.client.0.smithi022.stdout:214 2023-10-11T21:45:13.676 INFO:tasks.workunit.client.0.smithi022.stdout:215 2023-10-11T21:45:13.696 INFO:tasks.workunit.client.0.smithi022.stdout:216 2023-10-11T21:45:13.715 INFO:tasks.workunit.client.0.smithi022.stdout:217 2023-10-11T21:45:13.735 INFO:tasks.workunit.client.0.smithi022.stdout:218 2023-10-11T21:45:13.756 INFO:tasks.workunit.client.0.smithi022.stdout:219 2023-10-11T21:45:13.774 INFO:tasks.workunit.client.0.smithi022.stdout:220 2023-10-11T21:45:13.796 INFO:tasks.workunit.client.0.smithi022.stdout:221 2023-10-11T21:45:13.817 INFO:tasks.workunit.client.0.smithi022.stdout:222 2023-10-11T21:45:13.837 INFO:tasks.workunit.client.0.smithi022.stdout:223 2023-10-11T21:45:13.856 INFO:tasks.workunit.client.0.smithi022.stdout:224 2023-10-11T21:45:13.875 INFO:tasks.workunit.client.0.smithi022.stdout:225 2023-10-11T21:45:13.895 INFO:tasks.workunit.client.0.smithi022.stdout:226 2023-10-11T21:45:13.915 INFO:tasks.workunit.client.0.smithi022.stdout:227 2023-10-11T21:45:13.935 INFO:tasks.workunit.client.0.smithi022.stdout:228 2023-10-11T21:45:13.955 INFO:tasks.workunit.client.0.smithi022.stdout:229 2023-10-11T21:45:13.974 INFO:tasks.workunit.client.0.smithi022.stdout:230 2023-10-11T21:45:13.994 INFO:tasks.workunit.client.0.smithi022.stdout:231 2023-10-11T21:45:14.013 INFO:tasks.workunit.client.0.smithi022.stdout:232 2023-10-11T21:45:14.032 INFO:tasks.workunit.client.0.smithi022.stdout:233 2023-10-11T21:45:14.051 INFO:tasks.workunit.client.0.smithi022.stdout:234 2023-10-11T21:45:14.070 INFO:tasks.workunit.client.0.smithi022.stdout:235 2023-10-11T21:45:14.091 INFO:tasks.workunit.client.0.smithi022.stdout:236 2023-10-11T21:45:14.110 INFO:tasks.workunit.client.0.smithi022.stdout:237 2023-10-11T21:45:14.131 INFO:tasks.workunit.client.0.smithi022.stdout:238 2023-10-11T21:45:14.156 INFO:tasks.workunit.client.0.smithi022.stdout:239 2023-10-11T21:45:14.209 INFO:tasks.workunit.client.0.smithi022.stdout:240 2023-10-11T21:45:14.233 INFO:tasks.workunit.client.0.smithi022.stdout:241 2023-10-11T21:45:14.255 INFO:tasks.workunit.client.0.smithi022.stdout:242 2023-10-11T21:45:14.276 INFO:tasks.workunit.client.0.smithi022.stdout:243 2023-10-11T21:45:14.298 INFO:tasks.workunit.client.0.smithi022.stdout:244 2023-10-11T21:45:14.320 INFO:tasks.workunit.client.0.smithi022.stdout:245 2023-10-11T21:45:14.342 INFO:tasks.workunit.client.0.smithi022.stdout:246 2023-10-11T21:45:14.362 INFO:tasks.workunit.client.0.smithi022.stdout:247 2023-10-11T21:45:14.382 INFO:tasks.workunit.client.0.smithi022.stdout:248 2023-10-11T21:45:14.403 INFO:tasks.workunit.client.0.smithi022.stdout:249 2023-10-11T21:45:14.422 INFO:tasks.workunit.client.0.smithi022.stdout:250 2023-10-11T21:45:14.441 INFO:tasks.workunit.client.0.smithi022.stdout:251 2023-10-11T21:45:14.461 INFO:tasks.workunit.client.0.smithi022.stdout:252 2023-10-11T21:45:14.482 INFO:tasks.workunit.client.0.smithi022.stdout:253 2023-10-11T21:45:14.505 INFO:tasks.workunit.client.0.smithi022.stdout:254 2023-10-11T21:45:14.526 INFO:tasks.workunit.client.0.smithi022.stdout:255 2023-10-11T21:45:14.545 INFO:tasks.workunit.client.0.smithi022.stdout:256 2023-10-11T21:45:14.564 INFO:tasks.workunit.client.0.smithi022.stdout:257 2023-10-11T21:45:14.585 INFO:tasks.workunit.client.0.smithi022.stdout:258 2023-10-11T21:45:14.604 INFO:tasks.workunit.client.0.smithi022.stdout:259 2023-10-11T21:45:14.623 INFO:tasks.workunit.client.0.smithi022.stdout:260 2023-10-11T21:45:14.646 INFO:tasks.workunit.client.0.smithi022.stdout:261 2023-10-11T21:45:14.668 INFO:tasks.workunit.client.0.smithi022.stdout:262 2023-10-11T21:45:14.689 INFO:tasks.workunit.client.0.smithi022.stdout:263 2023-10-11T21:45:14.708 INFO:tasks.workunit.client.0.smithi022.stdout:264 2023-10-11T21:45:14.733 INFO:tasks.workunit.client.0.smithi022.stdout:265 2023-10-11T21:45:14.754 INFO:tasks.workunit.client.0.smithi022.stdout:266 2023-10-11T21:45:14.775 INFO:tasks.workunit.client.0.smithi022.stdout:267 2023-10-11T21:45:14.796 INFO:tasks.workunit.client.0.smithi022.stdout:268 2023-10-11T21:45:14.816 INFO:tasks.workunit.client.0.smithi022.stdout:269 2023-10-11T21:45:14.837 INFO:tasks.workunit.client.0.smithi022.stdout:270 2023-10-11T21:45:14.858 INFO:tasks.workunit.client.0.smithi022.stdout:271 2023-10-11T21:45:14.885 INFO:tasks.workunit.client.0.smithi022.stdout:272 2023-10-11T21:45:14.907 INFO:tasks.workunit.client.0.smithi022.stdout:273 2023-10-11T21:45:14.928 INFO:tasks.workunit.client.0.smithi022.stdout:274 2023-10-11T21:45:14.949 INFO:tasks.workunit.client.0.smithi022.stdout:275 2023-10-11T21:45:14.970 INFO:tasks.workunit.client.0.smithi022.stdout:276 2023-10-11T21:45:14.990 INFO:tasks.workunit.client.0.smithi022.stdout:277 2023-10-11T21:45:15.009 INFO:tasks.workunit.client.0.smithi022.stdout:278 2023-10-11T21:45:15.029 INFO:tasks.workunit.client.0.smithi022.stdout:279 2023-10-11T21:45:15.051 INFO:tasks.workunit.client.0.smithi022.stdout:280 2023-10-11T21:45:15.076 INFO:tasks.workunit.client.0.smithi022.stdout:281 2023-10-11T21:45:15.097 INFO:tasks.workunit.client.0.smithi022.stdout:282 2023-10-11T21:45:15.117 INFO:tasks.workunit.client.0.smithi022.stdout:283 2023-10-11T21:45:15.138 INFO:tasks.workunit.client.0.smithi022.stdout:284 2023-10-11T21:45:15.158 INFO:tasks.workunit.client.0.smithi022.stdout:285 2023-10-11T21:45:15.179 INFO:tasks.workunit.client.0.smithi022.stdout:286 2023-10-11T21:45:15.200 INFO:tasks.workunit.client.0.smithi022.stdout:287 2023-10-11T21:45:15.220 INFO:tasks.workunit.client.0.smithi022.stdout:288 2023-10-11T21:45:15.240 INFO:tasks.workunit.client.0.smithi022.stdout:289 2023-10-11T21:45:15.262 INFO:tasks.workunit.client.0.smithi022.stdout:290 2023-10-11T21:45:15.283 INFO:tasks.workunit.client.0.smithi022.stdout:291 2023-10-11T21:45:15.306 INFO:tasks.workunit.client.0.smithi022.stdout:292 2023-10-11T21:45:15.328 INFO:tasks.workunit.client.0.smithi022.stdout:293 2023-10-11T21:45:15.352 INFO:tasks.workunit.client.0.smithi022.stdout:294 2023-10-11T21:45:15.375 INFO:tasks.workunit.client.0.smithi022.stdout:295 2023-10-11T21:45:15.401 INFO:tasks.workunit.client.0.smithi022.stdout:296 2023-10-11T21:45:15.423 INFO:tasks.workunit.client.0.smithi022.stdout:297 2023-10-11T21:45:15.445 INFO:tasks.workunit.client.0.smithi022.stdout:298 2023-10-11T21:45:15.466 INFO:tasks.workunit.client.0.smithi022.stdout:299 2023-10-11T21:45:15.487 INFO:tasks.workunit.client.0.smithi022.stdout:300 2023-10-11T21:45:15.509 INFO:tasks.workunit.client.0.smithi022.stdout:301 2023-10-11T21:45:15.530 INFO:tasks.workunit.client.0.smithi022.stdout:302 2023-10-11T21:45:15.555 INFO:tasks.workunit.client.0.smithi022.stdout:303 2023-10-11T21:45:15.574 INFO:tasks.workunit.client.0.smithi022.stdout:304 2023-10-11T21:45:15.594 INFO:tasks.workunit.client.0.smithi022.stdout:305 2023-10-11T21:45:15.616 INFO:tasks.workunit.client.0.smithi022.stdout:306 2023-10-11T21:45:15.637 INFO:tasks.workunit.client.0.smithi022.stdout:307 2023-10-11T21:45:15.659 INFO:tasks.workunit.client.0.smithi022.stdout:308 2023-10-11T21:45:15.679 INFO:tasks.workunit.client.0.smithi022.stdout:309 2023-10-11T21:45:15.700 INFO:tasks.workunit.client.0.smithi022.stdout:310 2023-10-11T21:45:15.720 INFO:tasks.workunit.client.0.smithi022.stdout:311 2023-10-11T21:45:15.741 INFO:tasks.workunit.client.0.smithi022.stdout:312 2023-10-11T21:45:15.760 INFO:tasks.workunit.client.0.smithi022.stdout:313 2023-10-11T21:45:15.783 INFO:tasks.workunit.client.0.smithi022.stdout:314 2023-10-11T21:45:15.803 INFO:tasks.workunit.client.0.smithi022.stdout:315 2023-10-11T21:45:15.823 INFO:tasks.workunit.client.0.smithi022.stdout:316 2023-10-11T21:45:15.849 INFO:tasks.workunit.client.0.smithi022.stdout:317 2023-10-11T21:45:15.871 INFO:tasks.workunit.client.0.smithi022.stdout:318 2023-10-11T21:45:15.892 INFO:tasks.workunit.client.0.smithi022.stdout:319 2023-10-11T21:45:15.915 INFO:tasks.workunit.client.0.smithi022.stdout:320 2023-10-11T21:45:15.938 INFO:tasks.workunit.client.0.smithi022.stdout:321 2023-10-11T21:45:15.958 INFO:tasks.workunit.client.0.smithi022.stdout:322 2023-10-11T21:45:15.992 INFO:tasks.workunit.client.0.smithi022.stdout:323 2023-10-11T21:45:16.014 INFO:tasks.workunit.client.0.smithi022.stdout:324 2023-10-11T21:45:16.034 INFO:tasks.workunit.client.0.smithi022.stdout:325 2023-10-11T21:45:16.057 INFO:tasks.workunit.client.0.smithi022.stdout:326 2023-10-11T21:45:16.077 INFO:tasks.workunit.client.0.smithi022.stdout:327 2023-10-11T21:45:16.098 INFO:tasks.workunit.client.0.smithi022.stdout:328 2023-10-11T21:45:16.121 INFO:tasks.workunit.client.0.smithi022.stdout:329 2023-10-11T21:45:16.141 INFO:tasks.workunit.client.0.smithi022.stdout:330 2023-10-11T21:45:16.161 INFO:tasks.workunit.client.0.smithi022.stdout:331 2023-10-11T21:45:16.182 INFO:tasks.workunit.client.0.smithi022.stdout:332 2023-10-11T21:45:16.203 INFO:tasks.workunit.client.0.smithi022.stdout:333 2023-10-11T21:45:16.224 INFO:tasks.workunit.client.0.smithi022.stdout:334 2023-10-11T21:45:16.243 INFO:tasks.workunit.client.0.smithi022.stdout:335 2023-10-11T21:45:16.264 INFO:tasks.workunit.client.0.smithi022.stdout:336 2023-10-11T21:45:16.286 INFO:tasks.workunit.client.0.smithi022.stdout:337 2023-10-11T21:45:16.308 INFO:tasks.workunit.client.0.smithi022.stdout:338 2023-10-11T21:45:16.329 INFO:tasks.workunit.client.0.smithi022.stdout:339 2023-10-11T21:45:16.349 INFO:tasks.workunit.client.0.smithi022.stdout:340 2023-10-11T21:45:16.370 INFO:tasks.workunit.client.0.smithi022.stdout:341 2023-10-11T21:45:16.392 INFO:tasks.workunit.client.0.smithi022.stdout:342 2023-10-11T21:45:16.411 INFO:tasks.workunit.client.0.smithi022.stdout:343 2023-10-11T21:45:16.433 INFO:tasks.workunit.client.0.smithi022.stdout:344 2023-10-11T21:45:16.458 INFO:tasks.workunit.client.0.smithi022.stdout:345 2023-10-11T21:45:16.479 INFO:tasks.workunit.client.0.smithi022.stdout:346 2023-10-11T21:45:16.500 INFO:tasks.workunit.client.0.smithi022.stdout:347 2023-10-11T21:45:16.523 INFO:tasks.workunit.client.0.smithi022.stdout:348 2023-10-11T21:45:16.544 INFO:tasks.workunit.client.0.smithi022.stdout:349 2023-10-11T21:45:16.565 INFO:tasks.workunit.client.0.smithi022.stdout:350 2023-10-11T21:45:16.587 INFO:tasks.workunit.client.0.smithi022.stdout:351 2023-10-11T21:45:16.607 INFO:tasks.workunit.client.0.smithi022.stdout:352 2023-10-11T21:45:16.630 INFO:tasks.workunit.client.0.smithi022.stdout:353 2023-10-11T21:45:16.653 INFO:tasks.workunit.client.0.smithi022.stdout:354 2023-10-11T21:45:16.677 INFO:tasks.workunit.client.0.smithi022.stdout:355 2023-10-11T21:45:16.699 INFO:tasks.workunit.client.0.smithi022.stdout:356 2023-10-11T21:45:16.721 INFO:tasks.workunit.client.0.smithi022.stdout:357 2023-10-11T21:45:16.741 INFO:tasks.workunit.client.0.smithi022.stdout:358 2023-10-11T21:45:16.761 INFO:tasks.workunit.client.0.smithi022.stdout:359 2023-10-11T21:45:16.784 INFO:tasks.workunit.client.0.smithi022.stdout:360 2023-10-11T21:45:16.809 INFO:tasks.workunit.client.0.smithi022.stdout:361 2023-10-11T21:45:16.830 INFO:tasks.workunit.client.0.smithi022.stdout:362 2023-10-11T21:45:16.853 INFO:tasks.workunit.client.0.smithi022.stdout:363 2023-10-11T21:45:16.875 INFO:tasks.workunit.client.0.smithi022.stdout:364 2023-10-11T21:45:16.897 INFO:tasks.workunit.client.0.smithi022.stdout:365 2023-10-11T21:45:16.918 INFO:tasks.workunit.client.0.smithi022.stdout:366 2023-10-11T21:45:16.940 INFO:tasks.workunit.client.0.smithi022.stdout:367 2023-10-11T21:45:16.959 INFO:tasks.workunit.client.0.smithi022.stdout:368 2023-10-11T21:45:16.981 INFO:tasks.workunit.client.0.smithi022.stdout:369 2023-10-11T21:45:17.002 INFO:tasks.workunit.client.0.smithi022.stdout:370 2023-10-11T21:45:17.022 INFO:tasks.workunit.client.0.smithi022.stdout:371 2023-10-11T21:45:17.045 INFO:tasks.workunit.client.0.smithi022.stdout:372 2023-10-11T21:45:17.067 INFO:tasks.workunit.client.0.smithi022.stdout:373 2023-10-11T21:45:17.089 INFO:tasks.workunit.client.0.smithi022.stdout:374 2023-10-11T21:45:17.111 INFO:tasks.workunit.client.0.smithi022.stdout:375 2023-10-11T21:45:17.132 INFO:tasks.workunit.client.0.smithi022.stdout:376 2023-10-11T21:45:17.153 INFO:tasks.workunit.client.0.smithi022.stdout:377 2023-10-11T21:45:17.174 INFO:tasks.workunit.client.0.smithi022.stdout:378 2023-10-11T21:45:17.196 INFO:tasks.workunit.client.0.smithi022.stdout:379 2023-10-11T21:45:17.218 INFO:tasks.workunit.client.0.smithi022.stdout:380 2023-10-11T21:45:17.241 INFO:tasks.workunit.client.0.smithi022.stdout:381 2023-10-11T21:45:17.263 INFO:tasks.workunit.client.0.smithi022.stdout:382 2023-10-11T21:45:17.282 INFO:tasks.workunit.client.0.smithi022.stdout:383 2023-10-11T21:45:17.303 INFO:tasks.workunit.client.0.smithi022.stdout:384 2023-10-11T21:45:17.325 INFO:tasks.workunit.client.0.smithi022.stdout:385 2023-10-11T21:45:17.347 INFO:tasks.workunit.client.0.smithi022.stdout:386 2023-10-11T21:45:17.369 INFO:tasks.workunit.client.0.smithi022.stdout:387 2023-10-11T21:45:17.390 INFO:tasks.workunit.client.0.smithi022.stdout:388 2023-10-11T21:45:17.409 INFO:tasks.workunit.client.0.smithi022.stdout:389 2023-10-11T21:45:17.432 INFO:tasks.workunit.client.0.smithi022.stdout:390 2023-10-11T21:45:17.455 INFO:tasks.workunit.client.0.smithi022.stdout:391 2023-10-11T21:45:17.476 INFO:tasks.workunit.client.0.smithi022.stdout:392 2023-10-11T21:45:17.496 INFO:tasks.workunit.client.0.smithi022.stdout:393 2023-10-11T21:45:17.519 INFO:tasks.workunit.client.0.smithi022.stdout:394 2023-10-11T21:45:17.541 INFO:tasks.workunit.client.0.smithi022.stdout:395 2023-10-11T21:45:17.571 INFO:tasks.workunit.client.0.smithi022.stdout:396 2023-10-11T21:45:17.609 INFO:tasks.workunit.client.0.smithi022.stdout:397 2023-10-11T21:45:17.632 INFO:tasks.workunit.client.0.smithi022.stdout:398 2023-10-11T21:45:17.655 INFO:tasks.workunit.client.0.smithi022.stdout:399 2023-10-11T21:45:17.678 INFO:tasks.workunit.client.0.smithi022.stdout:400 2023-10-11T21:45:17.698 INFO:tasks.workunit.client.0.smithi022.stdout:401 2023-10-11T21:45:17.720 INFO:tasks.workunit.client.0.smithi022.stdout:402 2023-10-11T21:45:17.747 INFO:tasks.workunit.client.0.smithi022.stdout:403 2023-10-11T21:45:17.774 INFO:tasks.workunit.client.0.smithi022.stdout:404 2023-10-11T21:45:17.802 INFO:tasks.workunit.client.0.smithi022.stdout:405 2023-10-11T21:45:17.829 INFO:tasks.workunit.client.0.smithi022.stdout:406 2023-10-11T21:45:17.853 INFO:tasks.workunit.client.0.smithi022.stdout:407 2023-10-11T21:45:17.876 INFO:tasks.workunit.client.0.smithi022.stdout:408 2023-10-11T21:45:17.898 INFO:tasks.workunit.client.0.smithi022.stdout:409 2023-10-11T21:45:17.919 INFO:tasks.workunit.client.0.smithi022.stdout:410 2023-10-11T21:45:17.941 INFO:tasks.workunit.client.0.smithi022.stdout:411 2023-10-11T21:45:17.966 INFO:tasks.workunit.client.0.smithi022.stdout:412 2023-10-11T21:45:17.993 INFO:tasks.workunit.client.0.smithi022.stdout:413 2023-10-11T21:45:18.016 INFO:tasks.workunit.client.0.smithi022.stdout:414 2023-10-11T21:45:18.039 INFO:tasks.workunit.client.0.smithi022.stdout:415 2023-10-11T21:45:18.060 INFO:tasks.workunit.client.0.smithi022.stdout:416 2023-10-11T21:45:18.081 INFO:tasks.workunit.client.0.smithi022.stdout:417 2023-10-11T21:45:18.103 INFO:tasks.workunit.client.0.smithi022.stdout:418 2023-10-11T21:45:18.123 INFO:tasks.workunit.client.0.smithi022.stdout:419 2023-10-11T21:45:18.144 INFO:tasks.workunit.client.0.smithi022.stdout:420 2023-10-11T21:45:18.166 INFO:tasks.workunit.client.0.smithi022.stdout:421 2023-10-11T21:45:18.186 INFO:tasks.workunit.client.0.smithi022.stdout:422 2023-10-11T21:45:18.208 INFO:tasks.workunit.client.0.smithi022.stdout:423 2023-10-11T21:45:18.233 INFO:tasks.workunit.client.0.smithi022.stdout:424 2023-10-11T21:45:18.255 INFO:tasks.workunit.client.0.smithi022.stdout:425 2023-10-11T21:45:18.277 INFO:tasks.workunit.client.0.smithi022.stdout:426 2023-10-11T21:45:18.300 INFO:tasks.workunit.client.0.smithi022.stdout:427 2023-10-11T21:45:18.321 INFO:tasks.workunit.client.0.smithi022.stdout:428 2023-10-11T21:45:18.342 INFO:tasks.workunit.client.0.smithi022.stdout:429 2023-10-11T21:45:18.364 INFO:tasks.workunit.client.0.smithi022.stdout:430 2023-10-11T21:45:18.387 INFO:tasks.workunit.client.0.smithi022.stdout:431 2023-10-11T21:45:18.407 INFO:tasks.workunit.client.0.smithi022.stdout:432 2023-10-11T21:45:18.429 INFO:tasks.workunit.client.0.smithi022.stdout:433 2023-10-11T21:45:18.450 INFO:tasks.workunit.client.0.smithi022.stdout:434 2023-10-11T21:45:18.472 INFO:tasks.workunit.client.0.smithi022.stdout:435 2023-10-11T21:45:18.496 INFO:tasks.workunit.client.0.smithi022.stdout:436 2023-10-11T21:45:18.517 INFO:tasks.workunit.client.0.smithi022.stdout:437 2023-10-11T21:45:18.545 INFO:tasks.workunit.client.0.smithi022.stdout:438 2023-10-11T21:45:18.586 INFO:tasks.workunit.client.0.smithi022.stdout:439 2023-10-11T21:45:18.629 INFO:tasks.workunit.client.0.smithi022.stdout:440 2023-10-11T21:45:18.657 INFO:tasks.workunit.client.0.smithi022.stdout:441 2023-10-11T21:45:18.701 INFO:tasks.workunit.client.0.smithi022.stdout:442 2023-10-11T21:45:18.727 INFO:tasks.workunit.client.0.smithi022.stdout:443 2023-10-11T21:45:18.754 INFO:tasks.workunit.client.0.smithi022.stdout:444 2023-10-11T21:45:18.777 INFO:tasks.workunit.client.0.smithi022.stdout:445 2023-10-11T21:45:18.803 INFO:tasks.workunit.client.0.smithi022.stdout:446 2023-10-11T21:45:18.828 INFO:tasks.workunit.client.0.smithi022.stdout:447 2023-10-11T21:45:18.851 INFO:tasks.workunit.client.0.smithi022.stdout:448 2023-10-11T21:45:18.884 INFO:tasks.workunit.client.0.smithi022.stdout:449 2023-10-11T21:45:18.908 INFO:tasks.workunit.client.0.smithi022.stdout:450 2023-10-11T21:45:18.934 INFO:tasks.workunit.client.0.smithi022.stdout:451 2023-10-11T21:45:18.957 INFO:tasks.workunit.client.0.smithi022.stdout:452 2023-10-11T21:45:18.980 INFO:tasks.workunit.client.0.smithi022.stdout:453 2023-10-11T21:45:19.001 INFO:tasks.workunit.client.0.smithi022.stdout:454 2023-10-11T21:45:19.022 INFO:tasks.workunit.client.0.smithi022.stdout:455 2023-10-11T21:45:19.043 INFO:tasks.workunit.client.0.smithi022.stdout:456 2023-10-11T21:45:19.067 INFO:tasks.workunit.client.0.smithi022.stdout:457 2023-10-11T21:45:19.091 INFO:tasks.workunit.client.0.smithi022.stdout:458 2023-10-11T21:45:19.112 INFO:tasks.workunit.client.0.smithi022.stdout:459 2023-10-11T21:45:19.135 INFO:tasks.workunit.client.0.smithi022.stdout:460 2023-10-11T21:45:19.157 INFO:tasks.workunit.client.0.smithi022.stdout:461 2023-10-11T21:45:19.178 INFO:tasks.workunit.client.0.smithi022.stdout:462 2023-10-11T21:45:19.199 INFO:tasks.workunit.client.0.smithi022.stdout:463 2023-10-11T21:45:19.222 INFO:tasks.workunit.client.0.smithi022.stdout:464 2023-10-11T21:45:19.244 INFO:tasks.workunit.client.0.smithi022.stdout:465 2023-10-11T21:45:19.270 INFO:tasks.workunit.client.0.smithi022.stdout:466 2023-10-11T21:45:19.292 INFO:tasks.workunit.client.0.smithi022.stdout:467 2023-10-11T21:45:19.314 INFO:tasks.workunit.client.0.smithi022.stdout:468 2023-10-11T21:45:19.337 INFO:tasks.workunit.client.0.smithi022.stdout:469 2023-10-11T21:45:19.359 INFO:tasks.workunit.client.0.smithi022.stdout:470 2023-10-11T21:45:19.382 INFO:tasks.workunit.client.0.smithi022.stdout:471 2023-10-11T21:45:19.404 INFO:tasks.workunit.client.0.smithi022.stdout:472 2023-10-11T21:45:19.432 INFO:tasks.workunit.client.0.smithi022.stdout:473 2023-10-11T21:45:19.454 INFO:tasks.workunit.client.0.smithi022.stdout:474 2023-10-11T21:45:19.475 INFO:tasks.workunit.client.0.smithi022.stdout:475 2023-10-11T21:45:19.496 INFO:tasks.workunit.client.0.smithi022.stdout:476 2023-10-11T21:45:19.518 INFO:tasks.workunit.client.0.smithi022.stdout:477 2023-10-11T21:45:19.541 INFO:tasks.workunit.client.0.smithi022.stdout:478 2023-10-11T21:45:19.562 INFO:tasks.workunit.client.0.smithi022.stdout:479 2023-10-11T21:45:19.582 INFO:tasks.workunit.client.0.smithi022.stdout:480 2023-10-11T21:45:19.605 INFO:tasks.workunit.client.0.smithi022.stdout:481 2023-10-11T21:45:19.628 INFO:tasks.workunit.client.0.smithi022.stdout:482 2023-10-11T21:45:19.649 INFO:tasks.workunit.client.0.smithi022.stdout:483 2023-10-11T21:45:19.670 INFO:tasks.workunit.client.0.smithi022.stdout:484 2023-10-11T21:45:19.691 INFO:tasks.workunit.client.0.smithi022.stdout:485 2023-10-11T21:45:19.713 INFO:tasks.workunit.client.0.smithi022.stdout:486 2023-10-11T21:45:19.734 INFO:tasks.workunit.client.0.smithi022.stdout:487 2023-10-11T21:45:19.757 INFO:tasks.workunit.client.0.smithi022.stdout:488 2023-10-11T21:45:19.781 INFO:tasks.workunit.client.0.smithi022.stdout:489 2023-10-11T21:45:19.804 INFO:tasks.workunit.client.0.smithi022.stdout:490 2023-10-11T21:45:19.827 INFO:tasks.workunit.client.0.smithi022.stdout:491 2023-10-11T21:45:19.850 INFO:tasks.workunit.client.0.smithi022.stdout:492 2023-10-11T21:45:19.875 INFO:tasks.workunit.client.0.smithi022.stdout:493 2023-10-11T21:45:19.899 INFO:tasks.workunit.client.0.smithi022.stdout:494 2023-10-11T21:45:19.922 INFO:tasks.workunit.client.0.smithi022.stdout:495 2023-10-11T21:45:19.945 INFO:tasks.workunit.client.0.smithi022.stdout:496 2023-10-11T21:45:19.966 INFO:tasks.workunit.client.0.smithi022.stdout:497 2023-10-11T21:45:19.988 INFO:tasks.workunit.client.0.smithi022.stdout:498 2023-10-11T21:45:20.011 INFO:tasks.workunit.client.0.smithi022.stdout:499 2023-10-11T21:45:20.034 INFO:tasks.workunit.client.0.smithi022.stdout:500 2023-10-11T21:45:20.059 INFO:tasks.workunit.client.0.smithi022.stdout:501 2023-10-11T21:45:20.084 INFO:tasks.workunit.client.0.smithi022.stdout:502 2023-10-11T21:45:20.108 INFO:tasks.workunit.client.0.smithi022.stdout:503 2023-10-11T21:45:20.132 INFO:tasks.workunit.client.0.smithi022.stdout:504 2023-10-11T21:45:20.153 INFO:tasks.workunit.client.0.smithi022.stdout:505 2023-10-11T21:45:20.174 INFO:tasks.workunit.client.0.smithi022.stdout:506 2023-10-11T21:45:20.197 INFO:tasks.workunit.client.0.smithi022.stdout:507 2023-10-11T21:45:20.221 INFO:tasks.workunit.client.0.smithi022.stdout:508 2023-10-11T21:45:20.243 INFO:tasks.workunit.client.0.smithi022.stdout:509 2023-10-11T21:45:20.264 INFO:tasks.workunit.client.0.smithi022.stdout:510 2023-10-11T21:45:20.286 INFO:tasks.workunit.client.0.smithi022.stdout:511 2023-10-11T21:45:20.308 INFO:tasks.workunit.client.0.smithi022.stdout:512 2023-10-11T21:45:20.331 INFO:tasks.workunit.client.0.smithi022.stdout:513 2023-10-11T21:45:20.354 INFO:tasks.workunit.client.0.smithi022.stdout:514 2023-10-11T21:45:20.376 INFO:tasks.workunit.client.0.smithi022.stdout:515 2023-10-11T21:45:20.399 INFO:tasks.workunit.client.0.smithi022.stdout:516 2023-10-11T21:45:20.420 INFO:tasks.workunit.client.0.smithi022.stdout:517 2023-10-11T21:45:20.442 INFO:tasks.workunit.client.0.smithi022.stdout:518 2023-10-11T21:45:20.465 INFO:tasks.workunit.client.0.smithi022.stdout:519 2023-10-11T21:45:20.488 INFO:tasks.workunit.client.0.smithi022.stdout:520 2023-10-11T21:45:20.510 INFO:tasks.workunit.client.0.smithi022.stdout:521 2023-10-11T21:45:20.534 INFO:tasks.workunit.client.0.smithi022.stdout:522 2023-10-11T21:45:20.557 INFO:tasks.workunit.client.0.smithi022.stdout:523 2023-10-11T21:45:20.578 INFO:tasks.workunit.client.0.smithi022.stdout:524 2023-10-11T21:45:20.601 INFO:tasks.workunit.client.0.smithi022.stdout:525 2023-10-11T21:45:20.629 INFO:tasks.workunit.client.0.smithi022.stdout:526 2023-10-11T21:45:20.651 INFO:tasks.workunit.client.0.smithi022.stdout:527 2023-10-11T21:45:20.674 INFO:tasks.workunit.client.0.smithi022.stdout:528 2023-10-11T21:45:20.701 INFO:tasks.workunit.client.0.smithi022.stdout:529 2023-10-11T21:45:20.725 INFO:tasks.workunit.client.0.smithi022.stdout:530 2023-10-11T21:45:20.748 INFO:tasks.workunit.client.0.smithi022.stdout:531 2023-10-11T21:45:20.772 INFO:tasks.workunit.client.0.smithi022.stdout:532 2023-10-11T21:45:20.795 INFO:tasks.workunit.client.0.smithi022.stdout:533 2023-10-11T21:45:20.819 INFO:tasks.workunit.client.0.smithi022.stdout:534 2023-10-11T21:45:20.846 INFO:tasks.workunit.client.0.smithi022.stdout:535 2023-10-11T21:45:20.870 INFO:tasks.workunit.client.0.smithi022.stdout:536 2023-10-11T21:45:20.895 INFO:tasks.workunit.client.0.smithi022.stdout:537 2023-10-11T21:45:20.918 INFO:tasks.workunit.client.0.smithi022.stdout:538 2023-10-11T21:45:20.943 INFO:tasks.workunit.client.0.smithi022.stdout:539 2023-10-11T21:45:20.970 INFO:tasks.workunit.client.0.smithi022.stdout:540 2023-10-11T21:45:20.992 INFO:tasks.workunit.client.0.smithi022.stdout:541 2023-10-11T21:45:21.018 INFO:tasks.workunit.client.0.smithi022.stdout:542 2023-10-11T21:45:21.042 INFO:tasks.workunit.client.0.smithi022.stdout:543 2023-10-11T21:45:21.065 INFO:tasks.workunit.client.0.smithi022.stdout:544 2023-10-11T21:45:21.089 INFO:tasks.workunit.client.0.smithi022.stdout:545 2023-10-11T21:45:21.112 INFO:tasks.workunit.client.0.smithi022.stdout:546 2023-10-11T21:45:21.133 INFO:tasks.workunit.client.0.smithi022.stdout:547 2023-10-11T21:45:21.157 INFO:tasks.workunit.client.0.smithi022.stdout:548 2023-10-11T21:45:21.181 INFO:tasks.workunit.client.0.smithi022.stdout:549 2023-10-11T21:45:21.204 INFO:tasks.workunit.client.0.smithi022.stdout:550 2023-10-11T21:45:21.226 INFO:tasks.workunit.client.0.smithi022.stdout:551 2023-10-11T21:45:21.248 INFO:tasks.workunit.client.0.smithi022.stdout:552 2023-10-11T21:45:21.272 INFO:tasks.workunit.client.0.smithi022.stdout:553 2023-10-11T21:45:21.294 INFO:tasks.workunit.client.0.smithi022.stdout:554 2023-10-11T21:45:21.319 INFO:tasks.workunit.client.0.smithi022.stdout:555 2023-10-11T21:45:21.343 INFO:tasks.workunit.client.0.smithi022.stdout:556 2023-10-11T21:45:21.364 INFO:tasks.workunit.client.0.smithi022.stdout:557 2023-10-11T21:45:21.389 INFO:tasks.workunit.client.0.smithi022.stdout:558 2023-10-11T21:45:21.411 INFO:tasks.workunit.client.0.smithi022.stdout:559 2023-10-11T21:45:21.436 INFO:tasks.workunit.client.0.smithi022.stdout:560 2023-10-11T21:45:21.464 INFO:tasks.workunit.client.0.smithi022.stdout:561 2023-10-11T21:45:21.489 INFO:tasks.workunit.client.0.smithi022.stdout:562 2023-10-11T21:45:21.512 INFO:tasks.workunit.client.0.smithi022.stdout:563 2023-10-11T21:45:21.537 INFO:tasks.workunit.client.0.smithi022.stdout:564 2023-10-11T21:45:21.561 INFO:tasks.workunit.client.0.smithi022.stdout:565 2023-10-11T21:45:21.584 INFO:tasks.workunit.client.0.smithi022.stdout:566 2023-10-11T21:45:21.605 INFO:tasks.workunit.client.0.smithi022.stdout:567 2023-10-11T21:45:21.630 INFO:tasks.workunit.client.0.smithi022.stdout:568 2023-10-11T21:45:21.654 INFO:tasks.workunit.client.0.smithi022.stdout:569 2023-10-11T21:45:21.677 INFO:tasks.workunit.client.0.smithi022.stdout:570 2023-10-11T21:45:21.699 INFO:tasks.workunit.client.0.smithi022.stdout:571 2023-10-11T21:45:21.726 INFO:tasks.workunit.client.0.smithi022.stdout:572 2023-10-11T21:45:21.749 INFO:tasks.workunit.client.0.smithi022.stdout:573 2023-10-11T21:45:21.771 INFO:tasks.workunit.client.0.smithi022.stdout:574 2023-10-11T21:45:21.793 INFO:tasks.workunit.client.0.smithi022.stdout:575 2023-10-11T21:45:21.816 INFO:tasks.workunit.client.0.smithi022.stdout:576 2023-10-11T21:45:21.842 INFO:tasks.workunit.client.0.smithi022.stdout:577 2023-10-11T21:45:21.868 INFO:tasks.workunit.client.0.smithi022.stdout:578 2023-10-11T21:45:21.892 INFO:tasks.workunit.client.0.smithi022.stdout:579 2023-10-11T21:45:21.916 INFO:tasks.workunit.client.0.smithi022.stdout:580 2023-10-11T21:45:21.941 INFO:tasks.workunit.client.0.smithi022.stdout:581 2023-10-11T21:45:21.964 INFO:tasks.workunit.client.0.smithi022.stdout:582 2023-10-11T21:45:21.988 INFO:tasks.workunit.client.0.smithi022.stdout:583 2023-10-11T21:45:22.011 INFO:tasks.workunit.client.0.smithi022.stdout:584 2023-10-11T21:45:22.035 INFO:tasks.workunit.client.0.smithi022.stdout:585 2023-10-11T21:45:22.069 INFO:tasks.workunit.client.0.smithi022.stdout:586 2023-10-11T21:45:22.097 INFO:tasks.workunit.client.0.smithi022.stdout:587 2023-10-11T21:45:22.119 INFO:tasks.workunit.client.0.smithi022.stdout:588 2023-10-11T21:45:22.143 INFO:tasks.workunit.client.0.smithi022.stdout:589 2023-10-11T21:45:22.166 INFO:tasks.workunit.client.0.smithi022.stdout:590 2023-10-11T21:45:22.190 INFO:tasks.workunit.client.0.smithi022.stdout:591 2023-10-11T21:45:22.214 INFO:tasks.workunit.client.0.smithi022.stdout:592 2023-10-11T21:45:22.238 INFO:tasks.workunit.client.0.smithi022.stdout:593 2023-10-11T21:45:22.261 INFO:tasks.workunit.client.0.smithi022.stdout:594 2023-10-11T21:45:22.284 INFO:tasks.workunit.client.0.smithi022.stdout:595 2023-10-11T21:45:22.307 INFO:tasks.workunit.client.0.smithi022.stdout:596 2023-10-11T21:45:22.331 INFO:tasks.workunit.client.0.smithi022.stdout:597 2023-10-11T21:45:22.356 INFO:tasks.workunit.client.0.smithi022.stdout:598 2023-10-11T21:45:22.377 INFO:tasks.workunit.client.0.smithi022.stdout:599 2023-10-11T21:45:22.403 INFO:tasks.workunit.client.0.smithi022.stdout:600 2023-10-11T21:45:22.426 INFO:tasks.workunit.client.0.smithi022.stdout:601 2023-10-11T21:45:22.452 INFO:tasks.workunit.client.0.smithi022.stdout:602 2023-10-11T21:45:22.477 INFO:tasks.workunit.client.0.smithi022.stdout:603 2023-10-11T21:45:22.501 INFO:tasks.workunit.client.0.smithi022.stdout:604 2023-10-11T21:45:22.525 INFO:tasks.workunit.client.0.smithi022.stdout:605 2023-10-11T21:45:22.550 INFO:tasks.workunit.client.0.smithi022.stdout:606 2023-10-11T21:45:22.574 INFO:tasks.workunit.client.0.smithi022.stdout:607 2023-10-11T21:45:22.599 INFO:tasks.workunit.client.0.smithi022.stdout:608 2023-10-11T21:45:22.622 INFO:tasks.workunit.client.0.smithi022.stdout:609 2023-10-11T21:45:22.646 INFO:tasks.workunit.client.0.smithi022.stdout:610 2023-10-11T21:45:22.669 INFO:tasks.workunit.client.0.smithi022.stdout:611 2023-10-11T21:45:22.694 INFO:tasks.workunit.client.0.smithi022.stdout:612 2023-10-11T21:45:22.718 INFO:tasks.workunit.client.0.smithi022.stdout:613 2023-10-11T21:45:22.744 INFO:tasks.workunit.client.0.smithi022.stdout:614 2023-10-11T21:45:22.775 INFO:tasks.workunit.client.0.smithi022.stdout:615 2023-10-11T21:45:22.802 INFO:tasks.workunit.client.0.smithi022.stdout:616 2023-10-11T21:45:22.832 INFO:tasks.workunit.client.0.smithi022.stdout:617 2023-10-11T21:45:22.863 INFO:tasks.workunit.client.0.smithi022.stdout:618 2023-10-11T21:45:22.891 INFO:tasks.workunit.client.0.smithi022.stdout:619 2023-10-11T21:45:22.917 INFO:tasks.workunit.client.0.smithi022.stdout:620 2023-10-11T21:45:22.942 INFO:tasks.workunit.client.0.smithi022.stdout:621 2023-10-11T21:45:22.973 INFO:tasks.workunit.client.0.smithi022.stdout:622 2023-10-11T21:45:22.998 INFO:tasks.workunit.client.0.smithi022.stdout:623 2023-10-11T21:45:23.021 INFO:tasks.workunit.client.0.smithi022.stdout:624 2023-10-11T21:45:23.044 INFO:tasks.workunit.client.0.smithi022.stdout:625 2023-10-11T21:45:23.069 INFO:tasks.workunit.client.0.smithi022.stdout:626 2023-10-11T21:45:23.093 INFO:tasks.workunit.client.0.smithi022.stdout:627 2023-10-11T21:45:23.117 INFO:tasks.workunit.client.0.smithi022.stdout:628 2023-10-11T21:45:23.142 INFO:tasks.workunit.client.0.smithi022.stdout:629 2023-10-11T21:45:23.167 INFO:tasks.workunit.client.0.smithi022.stdout:630 2023-10-11T21:45:23.190 INFO:tasks.workunit.client.0.smithi022.stdout:631 2023-10-11T21:45:23.214 INFO:tasks.workunit.client.0.smithi022.stdout:632 2023-10-11T21:45:23.239 INFO:tasks.workunit.client.0.smithi022.stdout:633 2023-10-11T21:45:23.268 INFO:tasks.workunit.client.0.smithi022.stdout:634 2023-10-11T21:45:23.292 INFO:tasks.workunit.client.0.smithi022.stdout:635 2023-10-11T21:45:23.316 INFO:tasks.workunit.client.0.smithi022.stdout:636 2023-10-11T21:45:23.340 INFO:tasks.workunit.client.0.smithi022.stdout:637 2023-10-11T21:45:23.365 INFO:tasks.workunit.client.0.smithi022.stdout:638 2023-10-11T21:45:23.391 INFO:tasks.workunit.client.0.smithi022.stdout:639 2023-10-11T21:45:23.414 INFO:tasks.workunit.client.0.smithi022.stdout:640 2023-10-11T21:45:23.438 INFO:tasks.workunit.client.0.smithi022.stdout:641 2023-10-11T21:45:23.464 INFO:tasks.workunit.client.0.smithi022.stdout:642 2023-10-11T21:45:23.503 INFO:tasks.workunit.client.0.smithi022.stdout:643 2023-10-11T21:45:23.528 INFO:tasks.workunit.client.0.smithi022.stdout:644 2023-10-11T21:45:23.553 INFO:tasks.workunit.client.0.smithi022.stdout:645 2023-10-11T21:45:23.578 INFO:tasks.workunit.client.0.smithi022.stdout:646 2023-10-11T21:45:23.603 INFO:tasks.workunit.client.0.smithi022.stdout:647 2023-10-11T21:45:23.631 INFO:tasks.workunit.client.0.smithi022.stdout:648 2023-10-11T21:45:23.656 INFO:tasks.workunit.client.0.smithi022.stdout:649 2023-10-11T21:45:23.678 INFO:tasks.workunit.client.0.smithi022.stdout:650 2023-10-11T21:45:23.703 INFO:tasks.workunit.client.0.smithi022.stdout:651 2023-10-11T21:45:23.732 INFO:tasks.workunit.client.0.smithi022.stdout:652 2023-10-11T21:45:23.757 INFO:tasks.workunit.client.0.smithi022.stdout:653 2023-10-11T21:45:23.782 INFO:tasks.workunit.client.0.smithi022.stdout:654 2023-10-11T21:45:23.805 INFO:tasks.workunit.client.0.smithi022.stdout:655 2023-10-11T21:45:23.829 INFO:tasks.workunit.client.0.smithi022.stdout:656 2023-10-11T21:45:23.852 INFO:tasks.workunit.client.0.smithi022.stdout:657 2023-10-11T21:45:23.877 INFO:tasks.workunit.client.0.smithi022.stdout:658 2023-10-11T21:45:23.904 INFO:tasks.workunit.client.0.smithi022.stdout:659 2023-10-11T21:45:23.929 INFO:tasks.workunit.client.0.smithi022.stdout:660 2023-10-11T21:45:23.957 INFO:tasks.workunit.client.0.smithi022.stdout:661 2023-10-11T21:45:23.979 INFO:tasks.workunit.client.0.smithi022.stdout:662 2023-10-11T21:45:24.003 INFO:tasks.workunit.client.0.smithi022.stdout:663 2023-10-11T21:45:24.028 INFO:tasks.workunit.client.0.smithi022.stdout:664 2023-10-11T21:45:24.053 INFO:tasks.workunit.client.0.smithi022.stdout:665 2023-10-11T21:45:24.078 INFO:tasks.workunit.client.0.smithi022.stdout:666 2023-10-11T21:45:24.102 INFO:tasks.workunit.client.0.smithi022.stdout:667 2023-10-11T21:45:24.127 INFO:tasks.workunit.client.0.smithi022.stdout:668 2023-10-11T21:45:24.153 INFO:tasks.workunit.client.0.smithi022.stdout:669 2023-10-11T21:45:24.176 INFO:tasks.workunit.client.0.smithi022.stdout:670 2023-10-11T21:45:24.201 INFO:tasks.workunit.client.0.smithi022.stdout:671 2023-10-11T21:45:24.223 INFO:tasks.workunit.client.0.smithi022.stdout:672 2023-10-11T21:45:24.246 INFO:tasks.workunit.client.0.smithi022.stdout:673 2023-10-11T21:45:24.269 INFO:tasks.workunit.client.0.smithi022.stdout:674 2023-10-11T21:45:24.293 INFO:tasks.workunit.client.0.smithi022.stdout:675 2023-10-11T21:45:24.317 INFO:tasks.workunit.client.0.smithi022.stdout:676 2023-10-11T21:45:24.340 INFO:tasks.workunit.client.0.smithi022.stdout:677 2023-10-11T21:45:24.365 INFO:tasks.workunit.client.0.smithi022.stdout:678 2023-10-11T21:45:24.387 INFO:tasks.workunit.client.0.smithi022.stdout:679 2023-10-11T21:45:24.410 INFO:tasks.workunit.client.0.smithi022.stdout:680 2023-10-11T21:45:24.435 INFO:tasks.workunit.client.0.smithi022.stdout:681 2023-10-11T21:45:24.460 INFO:tasks.workunit.client.0.smithi022.stdout:682 2023-10-11T21:45:24.485 INFO:tasks.workunit.client.0.smithi022.stdout:683 2023-10-11T21:45:24.509 INFO:tasks.workunit.client.0.smithi022.stdout:684 2023-10-11T21:45:24.539 INFO:tasks.workunit.client.0.smithi022.stdout:685 2023-10-11T21:45:24.562 INFO:tasks.workunit.client.0.smithi022.stdout:686 2023-10-11T21:45:24.588 INFO:tasks.workunit.client.0.smithi022.stdout:687 2023-10-11T21:45:24.611 INFO:tasks.workunit.client.0.smithi022.stdout:688 2023-10-11T21:45:24.634 INFO:tasks.workunit.client.0.smithi022.stdout:689 2023-10-11T21:45:24.659 INFO:tasks.workunit.client.0.smithi022.stdout:690 2023-10-11T21:45:24.689 INFO:tasks.workunit.client.0.smithi022.stdout:691 2023-10-11T21:45:24.715 INFO:tasks.workunit.client.0.smithi022.stdout:692 2023-10-11T21:45:24.740 INFO:tasks.workunit.client.0.smithi022.stdout:693 2023-10-11T21:45:24.764 INFO:tasks.workunit.client.0.smithi022.stdout:694 2023-10-11T21:45:24.789 INFO:tasks.workunit.client.0.smithi022.stdout:695 2023-10-11T21:45:24.814 INFO:tasks.workunit.client.0.smithi022.stdout:696 2023-10-11T21:45:24.837 INFO:tasks.workunit.client.0.smithi022.stdout:697 2023-10-11T21:45:24.861 INFO:tasks.workunit.client.0.smithi022.stdout:698 2023-10-11T21:45:24.887 INFO:tasks.workunit.client.0.smithi022.stdout:699 2023-10-11T21:45:24.911 INFO:tasks.workunit.client.0.smithi022.stdout:700 2023-10-11T21:45:24.936 INFO:tasks.workunit.client.0.smithi022.stdout:701 2023-10-11T21:45:24.980 INFO:tasks.workunit.client.0.smithi022.stdout:702 2023-10-11T21:45:25.007 INFO:tasks.workunit.client.0.smithi022.stdout:703 2023-10-11T21:45:25.031 INFO:tasks.workunit.client.0.smithi022.stdout:704 2023-10-11T21:45:25.058 INFO:tasks.workunit.client.0.smithi022.stdout:705 2023-10-11T21:45:25.081 INFO:tasks.workunit.client.0.smithi022.stdout:706 2023-10-11T21:45:25.110 INFO:tasks.workunit.client.0.smithi022.stdout:707 2023-10-11T21:45:25.136 INFO:tasks.workunit.client.0.smithi022.stdout:708 2023-10-11T21:45:25.161 INFO:tasks.workunit.client.0.smithi022.stdout:709 2023-10-11T21:45:25.186 INFO:tasks.workunit.client.0.smithi022.stdout:710 2023-10-11T21:45:25.210 INFO:tasks.workunit.client.0.smithi022.stdout:711 2023-10-11T21:45:25.236 INFO:tasks.workunit.client.0.smithi022.stdout:712 2023-10-11T21:45:25.260 INFO:tasks.workunit.client.0.smithi022.stdout:713 2023-10-11T21:45:25.285 INFO:tasks.workunit.client.0.smithi022.stdout:714 2023-10-11T21:45:25.309 INFO:tasks.workunit.client.0.smithi022.stdout:715 2023-10-11T21:45:25.334 INFO:tasks.workunit.client.0.smithi022.stdout:716 2023-10-11T21:45:25.358 INFO:tasks.workunit.client.0.smithi022.stdout:717 2023-10-11T21:45:25.381 INFO:tasks.workunit.client.0.smithi022.stdout:718 2023-10-11T21:45:25.406 INFO:tasks.workunit.client.0.smithi022.stdout:719 2023-10-11T21:45:25.430 INFO:tasks.workunit.client.0.smithi022.stdout:720 2023-10-11T21:45:25.455 INFO:tasks.workunit.client.0.smithi022.stdout:721 2023-10-11T21:45:25.481 INFO:tasks.workunit.client.0.smithi022.stdout:722 2023-10-11T21:45:25.507 INFO:tasks.workunit.client.0.smithi022.stdout:723 2023-10-11T21:45:25.531 INFO:tasks.workunit.client.0.smithi022.stdout:724 2023-10-11T21:45:25.557 INFO:tasks.workunit.client.0.smithi022.stdout:725 2023-10-11T21:45:25.586 INFO:tasks.workunit.client.0.smithi022.stdout:726 2023-10-11T21:45:25.612 INFO:tasks.workunit.client.0.smithi022.stdout:727 2023-10-11T21:45:25.638 INFO:tasks.workunit.client.0.smithi022.stdout:728 2023-10-11T21:45:25.664 INFO:tasks.workunit.client.0.smithi022.stdout:729 2023-10-11T21:45:25.690 INFO:tasks.workunit.client.0.smithi022.stdout:730 2023-10-11T21:45:25.714 INFO:tasks.workunit.client.0.smithi022.stdout:731 2023-10-11T21:45:25.740 INFO:tasks.workunit.client.0.smithi022.stdout:732 2023-10-11T21:45:25.766 INFO:tasks.workunit.client.0.smithi022.stdout:733 2023-10-11T21:45:25.792 INFO:tasks.workunit.client.0.smithi022.stdout:734 2023-10-11T21:45:25.816 INFO:tasks.workunit.client.0.smithi022.stdout:735 2023-10-11T21:45:25.841 INFO:tasks.workunit.client.0.smithi022.stdout:736 2023-10-11T21:45:25.868 INFO:tasks.workunit.client.0.smithi022.stdout:737 2023-10-11T21:45:25.896 INFO:tasks.workunit.client.0.smithi022.stdout:738 2023-10-11T21:45:25.929 INFO:tasks.workunit.client.0.smithi022.stdout:739 2023-10-11T21:45:25.955 INFO:tasks.workunit.client.0.smithi022.stdout:740 2023-10-11T21:45:25.980 INFO:tasks.workunit.client.0.smithi022.stdout:741 2023-10-11T21:45:26.005 INFO:tasks.workunit.client.0.smithi022.stdout:742 2023-10-11T21:45:26.032 INFO:tasks.workunit.client.0.smithi022.stdout:743 2023-10-11T21:45:26.058 INFO:tasks.workunit.client.0.smithi022.stdout:744 2023-10-11T21:45:26.082 INFO:tasks.workunit.client.0.smithi022.stdout:745 2023-10-11T21:45:26.109 INFO:tasks.workunit.client.0.smithi022.stdout:746 2023-10-11T21:45:26.136 INFO:tasks.workunit.client.0.smithi022.stdout:747 2023-10-11T21:45:26.162 INFO:tasks.workunit.client.0.smithi022.stdout:748 2023-10-11T21:45:26.188 INFO:tasks.workunit.client.0.smithi022.stdout:749 2023-10-11T21:45:26.212 INFO:tasks.workunit.client.0.smithi022.stdout:750 2023-10-11T21:45:26.238 INFO:tasks.workunit.client.0.smithi022.stdout:751 2023-10-11T21:45:26.264 INFO:tasks.workunit.client.0.smithi022.stdout:752 2023-10-11T21:45:26.288 INFO:tasks.workunit.client.0.smithi022.stdout:753 2023-10-11T21:45:26.314 INFO:tasks.workunit.client.0.smithi022.stdout:754 2023-10-11T21:45:26.338 INFO:tasks.workunit.client.0.smithi022.stdout:755 2023-10-11T21:45:26.365 INFO:tasks.workunit.client.0.smithi022.stdout:756 2023-10-11T21:45:26.393 INFO:tasks.workunit.client.0.smithi022.stdout:757 2023-10-11T21:45:26.419 INFO:tasks.workunit.client.0.smithi022.stdout:758 2023-10-11T21:45:26.448 INFO:tasks.workunit.client.0.smithi022.stdout:759 2023-10-11T21:45:26.475 INFO:tasks.workunit.client.0.smithi022.stdout:760 2023-10-11T21:45:26.501 INFO:tasks.workunit.client.0.smithi022.stdout:761 2023-10-11T21:45:26.527 INFO:tasks.workunit.client.0.smithi022.stdout:762 2023-10-11T21:45:26.554 INFO:tasks.workunit.client.0.smithi022.stdout:763 2023-10-11T21:45:26.580 INFO:tasks.workunit.client.0.smithi022.stdout:764 2023-10-11T21:45:26.606 INFO:tasks.workunit.client.0.smithi022.stdout:765 2023-10-11T21:45:26.629 INFO:tasks.workunit.client.0.smithi022.stdout:766 2023-10-11T21:45:26.655 INFO:tasks.workunit.client.0.smithi022.stdout:767 2023-10-11T21:45:26.690 INFO:tasks.workunit.client.0.smithi022.stdout:768 2023-10-11T21:45:26.716 INFO:tasks.workunit.client.0.smithi022.stdout:769 2023-10-11T21:45:26.743 INFO:tasks.workunit.client.0.smithi022.stdout:770 2023-10-11T21:45:26.768 INFO:tasks.workunit.client.0.smithi022.stdout:771 2023-10-11T21:45:26.794 INFO:tasks.workunit.client.0.smithi022.stdout:772 2023-10-11T21:45:26.820 INFO:tasks.workunit.client.0.smithi022.stdout:773 2023-10-11T21:45:26.846 INFO:tasks.workunit.client.0.smithi022.stdout:774 2023-10-11T21:45:26.875 INFO:tasks.workunit.client.0.smithi022.stdout:775 2023-10-11T21:45:26.904 INFO:tasks.workunit.client.0.smithi022.stdout:776 2023-10-11T21:45:26.930 INFO:tasks.workunit.client.0.smithi022.stdout:777 2023-10-11T21:45:26.958 INFO:tasks.workunit.client.0.smithi022.stdout:778 2023-10-11T21:45:26.985 INFO:tasks.workunit.client.0.smithi022.stdout:779 2023-10-11T21:45:27.011 INFO:tasks.workunit.client.0.smithi022.stdout:780 2023-10-11T21:45:27.039 INFO:tasks.workunit.client.0.smithi022.stdout:781 2023-10-11T21:45:27.063 INFO:tasks.workunit.client.0.smithi022.stdout:782 2023-10-11T21:45:27.089 INFO:tasks.workunit.client.0.smithi022.stdout:783 2023-10-11T21:45:27.114 INFO:tasks.workunit.client.0.smithi022.stdout:784 2023-10-11T21:45:27.141 INFO:tasks.workunit.client.0.smithi022.stdout:785 2023-10-11T21:45:27.170 INFO:tasks.workunit.client.0.smithi022.stdout:786 2023-10-11T21:45:27.194 INFO:tasks.workunit.client.0.smithi022.stdout:787 2023-10-11T21:45:27.221 INFO:tasks.workunit.client.0.smithi022.stdout:788 2023-10-11T21:45:27.247 INFO:tasks.workunit.client.0.smithi022.stdout:789 2023-10-11T21:45:27.273 INFO:tasks.workunit.client.0.smithi022.stdout:790 2023-10-11T21:45:27.299 INFO:tasks.workunit.client.0.smithi022.stdout:791 2023-10-11T21:45:27.323 INFO:tasks.workunit.client.0.smithi022.stdout:792 2023-10-11T21:45:27.350 INFO:tasks.workunit.client.0.smithi022.stdout:793 2023-10-11T21:45:27.376 INFO:tasks.workunit.client.0.smithi022.stdout:794 2023-10-11T21:45:27.400 INFO:tasks.workunit.client.0.smithi022.stdout:795 2023-10-11T21:45:27.427 INFO:tasks.workunit.client.0.smithi022.stdout:796 2023-10-11T21:45:27.453 INFO:tasks.workunit.client.0.smithi022.stdout:797 2023-10-11T21:45:27.480 INFO:tasks.workunit.client.0.smithi022.stdout:798 2023-10-11T21:45:27.506 INFO:tasks.workunit.client.0.smithi022.stdout:799 2023-10-11T21:45:27.533 INFO:tasks.workunit.client.0.smithi022.stdout:800 2023-10-11T21:45:27.558 INFO:tasks.workunit.client.0.smithi022.stdout:801 2023-10-11T21:45:27.583 INFO:tasks.workunit.client.0.smithi022.stdout:802 2023-10-11T21:45:27.610 INFO:tasks.workunit.client.0.smithi022.stdout:803 2023-10-11T21:45:27.634 INFO:tasks.workunit.client.0.smithi022.stdout:804 2023-10-11T21:45:27.659 INFO:tasks.workunit.client.0.smithi022.stdout:805 2023-10-11T21:45:27.684 INFO:tasks.workunit.client.0.smithi022.stdout:806 2023-10-11T21:45:27.710 INFO:tasks.workunit.client.0.smithi022.stdout:807 2023-10-11T21:45:27.736 INFO:tasks.workunit.client.0.smithi022.stdout:808 2023-10-11T21:45:27.764 INFO:tasks.workunit.client.0.smithi022.stdout:809 2023-10-11T21:45:27.791 INFO:tasks.workunit.client.0.smithi022.stdout:810 2023-10-11T21:45:27.820 INFO:tasks.workunit.client.0.smithi022.stdout:811 2023-10-11T21:45:27.847 INFO:tasks.workunit.client.0.smithi022.stdout:812 2023-10-11T21:45:27.874 INFO:tasks.workunit.client.0.smithi022.stdout:813 2023-10-11T21:45:27.901 INFO:tasks.workunit.client.0.smithi022.stdout:814 2023-10-11T21:45:27.937 INFO:tasks.workunit.client.0.smithi022.stdout:815 2023-10-11T21:45:27.963 INFO:tasks.workunit.client.0.smithi022.stdout:816 2023-10-11T21:45:27.994 INFO:tasks.workunit.client.0.smithi022.stdout:817 2023-10-11T21:45:28.021 INFO:tasks.workunit.client.0.smithi022.stdout:818 2023-10-11T21:45:28.047 INFO:tasks.workunit.client.0.smithi022.stdout:819 2023-10-11T21:45:28.074 INFO:tasks.workunit.client.0.smithi022.stdout:820 2023-10-11T21:45:28.101 INFO:tasks.workunit.client.0.smithi022.stdout:821 2023-10-11T21:45:28.128 INFO:tasks.workunit.client.0.smithi022.stdout:822 2023-10-11T21:45:28.155 INFO:tasks.workunit.client.0.smithi022.stdout:823 2023-10-11T21:45:28.182 INFO:tasks.workunit.client.0.smithi022.stdout:824 2023-10-11T21:45:28.209 INFO:tasks.workunit.client.0.smithi022.stdout:825 2023-10-11T21:45:28.234 INFO:tasks.workunit.client.0.smithi022.stdout:826 2023-10-11T21:45:28.260 INFO:tasks.workunit.client.0.smithi022.stdout:827 2023-10-11T21:45:28.287 INFO:tasks.workunit.client.0.smithi022.stdout:828 2023-10-11T21:45:28.314 INFO:tasks.workunit.client.0.smithi022.stdout:829 2023-10-11T21:45:28.339 INFO:tasks.workunit.client.0.smithi022.stdout:830 2023-10-11T21:45:28.364 INFO:tasks.workunit.client.0.smithi022.stdout:831 2023-10-11T21:45:28.391 INFO:tasks.workunit.client.0.smithi022.stdout:832 2023-10-11T21:45:28.418 INFO:tasks.workunit.client.0.smithi022.stdout:833 2023-10-11T21:45:28.445 INFO:tasks.workunit.client.0.smithi022.stdout:834 2023-10-11T21:45:28.473 INFO:tasks.workunit.client.0.smithi022.stdout:835 2023-10-11T21:45:28.504 INFO:tasks.workunit.client.0.smithi022.stdout:836 2023-10-11T21:45:28.532 INFO:tasks.workunit.client.0.smithi022.stdout:837 2023-10-11T21:45:28.560 INFO:tasks.workunit.client.0.smithi022.stdout:838 2023-10-11T21:45:28.585 INFO:tasks.workunit.client.0.smithi022.stdout:839 2023-10-11T21:45:28.612 INFO:tasks.workunit.client.0.smithi022.stdout:840 2023-10-11T21:45:28.643 INFO:tasks.workunit.client.0.smithi022.stdout:841 2023-10-11T21:45:28.673 INFO:tasks.workunit.client.0.smithi022.stdout:842 2023-10-11T21:45:28.699 INFO:tasks.workunit.client.0.smithi022.stdout:843 2023-10-11T21:45:28.726 INFO:tasks.workunit.client.0.smithi022.stdout:844 2023-10-11T21:45:28.765 INFO:tasks.workunit.client.0.smithi022.stdout:845 2023-10-11T21:45:28.791 INFO:tasks.workunit.client.0.smithi022.stdout:846 2023-10-11T21:45:28.817 INFO:tasks.workunit.client.0.smithi022.stdout:847 2023-10-11T21:45:28.843 INFO:tasks.workunit.client.0.smithi022.stdout:848 2023-10-11T21:45:28.868 INFO:tasks.workunit.client.0.smithi022.stdout:849 2023-10-11T21:45:28.894 INFO:tasks.workunit.client.0.smithi022.stdout:850 2023-10-11T21:45:28.922 INFO:tasks.workunit.client.0.smithi022.stdout:851 2023-10-11T21:45:28.948 INFO:tasks.workunit.client.0.smithi022.stdout:852 2023-10-11T21:45:28.977 INFO:tasks.workunit.client.0.smithi022.stdout:853 2023-10-11T21:45:29.006 INFO:tasks.workunit.client.0.smithi022.stdout:854 2023-10-11T21:45:29.035 INFO:tasks.workunit.client.0.smithi022.stdout:855 2023-10-11T21:45:29.061 INFO:tasks.workunit.client.0.smithi022.stdout:856 2023-10-11T21:45:29.088 INFO:tasks.workunit.client.0.smithi022.stdout:857 2023-10-11T21:45:29.115 INFO:tasks.workunit.client.0.smithi022.stdout:858 2023-10-11T21:45:29.141 INFO:tasks.workunit.client.0.smithi022.stdout:859 2023-10-11T21:45:29.167 INFO:tasks.workunit.client.0.smithi022.stdout:860 2023-10-11T21:45:29.195 INFO:tasks.workunit.client.0.smithi022.stdout:861 2023-10-11T21:45:29.220 INFO:tasks.workunit.client.0.smithi022.stdout:862 2023-10-11T21:45:29.248 INFO:tasks.workunit.client.0.smithi022.stdout:863 2023-10-11T21:45:29.273 INFO:tasks.workunit.client.0.smithi022.stdout:864 2023-10-11T21:45:29.300 INFO:tasks.workunit.client.0.smithi022.stdout:865 2023-10-11T21:45:29.325 INFO:tasks.workunit.client.0.smithi022.stdout:866 2023-10-11T21:45:29.350 INFO:tasks.workunit.client.0.smithi022.stdout:867 2023-10-11T21:45:29.377 INFO:tasks.workunit.client.0.smithi022.stdout:868 2023-10-11T21:45:29.419 INFO:tasks.workunit.client.0.smithi022.stdout:869 2023-10-11T21:45:29.446 INFO:tasks.workunit.client.0.smithi022.stdout:870 2023-10-11T21:45:29.473 INFO:tasks.workunit.client.0.smithi022.stdout:871 2023-10-11T21:45:29.500 INFO:tasks.workunit.client.0.smithi022.stdout:872 2023-10-11T21:45:29.526 INFO:tasks.workunit.client.0.smithi022.stdout:873 2023-10-11T21:45:29.554 INFO:tasks.workunit.client.0.smithi022.stdout:874 2023-10-11T21:45:29.582 INFO:tasks.workunit.client.0.smithi022.stdout:875 2023-10-11T21:45:29.609 INFO:tasks.workunit.client.0.smithi022.stdout:876 2023-10-11T21:45:29.636 INFO:tasks.workunit.client.0.smithi022.stdout:877 2023-10-11T21:45:29.663 INFO:tasks.workunit.client.0.smithi022.stdout:878 2023-10-11T21:45:29.692 INFO:tasks.workunit.client.0.smithi022.stdout:879 2023-10-11T21:45:29.718 INFO:tasks.workunit.client.0.smithi022.stdout:880 2023-10-11T21:45:29.743 INFO:tasks.workunit.client.0.smithi022.stdout:881 2023-10-11T21:45:29.770 INFO:tasks.workunit.client.0.smithi022.stdout:882 2023-10-11T21:45:29.798 INFO:tasks.workunit.client.0.smithi022.stdout:883 2023-10-11T21:45:29.825 INFO:tasks.workunit.client.0.smithi022.stdout:884 2023-10-11T21:45:29.852 INFO:tasks.workunit.client.0.smithi022.stdout:885 2023-10-11T21:45:29.885 INFO:tasks.workunit.client.0.smithi022.stdout:886 2023-10-11T21:45:29.912 INFO:tasks.workunit.client.0.smithi022.stdout:887 2023-10-11T21:45:29.938 INFO:tasks.workunit.client.0.smithi022.stdout:888 2023-10-11T21:45:29.967 INFO:tasks.workunit.client.0.smithi022.stdout:889 2023-10-11T21:45:29.995 INFO:tasks.workunit.client.0.smithi022.stdout:890 2023-10-11T21:45:30.023 INFO:tasks.workunit.client.0.smithi022.stdout:891 2023-10-11T21:45:30.051 INFO:tasks.workunit.client.0.smithi022.stdout:892 2023-10-11T21:45:30.078 INFO:tasks.workunit.client.0.smithi022.stdout:893 2023-10-11T21:45:30.107 INFO:tasks.workunit.client.0.smithi022.stdout:894 2023-10-11T21:45:30.136 INFO:tasks.workunit.client.0.smithi022.stdout:895 2023-10-11T21:45:30.162 INFO:tasks.workunit.client.0.smithi022.stdout:896 2023-10-11T21:45:30.189 INFO:tasks.workunit.client.0.smithi022.stdout:897 2023-10-11T21:45:30.219 INFO:tasks.workunit.client.0.smithi022.stdout:898 2023-10-11T21:45:30.246 INFO:tasks.workunit.client.0.smithi022.stdout:899 2023-10-11T21:45:30.276 INFO:tasks.workunit.client.0.smithi022.stdout:900 2023-10-11T21:45:30.305 INFO:tasks.workunit.client.0.smithi022.stdout:901 2023-10-11T21:45:30.332 INFO:tasks.workunit.client.0.smithi022.stdout:902 2023-10-11T21:45:30.358 INFO:tasks.workunit.client.0.smithi022.stdout:903 2023-10-11T21:45:30.384 INFO:tasks.workunit.client.0.smithi022.stdout:904 2023-10-11T21:45:30.410 INFO:tasks.workunit.client.0.smithi022.stdout:905 2023-10-11T21:45:30.438 INFO:tasks.workunit.client.0.smithi022.stdout:906 2023-10-11T21:45:30.463 INFO:tasks.workunit.client.0.smithi022.stdout:907 2023-10-11T21:45:30.490 INFO:tasks.workunit.client.0.smithi022.stdout:908 2023-10-11T21:45:30.519 INFO:tasks.workunit.client.0.smithi022.stdout:909 2023-10-11T21:45:30.547 INFO:tasks.workunit.client.0.smithi022.stdout:910 2023-10-11T21:45:30.575 INFO:tasks.workunit.client.0.smithi022.stdout:911 2023-10-11T21:45:30.603 INFO:tasks.workunit.client.0.smithi022.stdout:912 2023-10-11T21:45:30.630 INFO:tasks.workunit.client.0.smithi022.stdout:913 2023-10-11T21:45:30.657 INFO:tasks.workunit.client.0.smithi022.stdout:914 2023-10-11T21:45:30.685 INFO:tasks.workunit.client.0.smithi022.stdout:915 2023-10-11T21:45:30.710 INFO:tasks.workunit.client.0.smithi022.stdout:916 2023-10-11T21:45:30.741 INFO:tasks.workunit.client.0.smithi022.stdout:917 2023-10-11T21:45:30.768 INFO:tasks.workunit.client.0.smithi022.stdout:918 2023-10-11T21:45:30.797 INFO:tasks.workunit.client.0.smithi022.stdout:919 2023-10-11T21:45:30.824 INFO:tasks.workunit.client.0.smithi022.stdout:920 2023-10-11T21:45:30.851 INFO:tasks.workunit.client.0.smithi022.stdout:921 2023-10-11T21:45:30.877 INFO:tasks.workunit.client.0.smithi022.stdout:922 2023-10-11T21:45:30.906 INFO:tasks.workunit.client.0.smithi022.stdout:923 2023-10-11T21:45:30.934 INFO:tasks.workunit.client.0.smithi022.stdout:924 2023-10-11T21:45:30.971 INFO:tasks.workunit.client.0.smithi022.stdout:925 2023-10-11T21:45:30.998 INFO:tasks.workunit.client.0.smithi022.stdout:926 2023-10-11T21:45:31.028 INFO:tasks.workunit.client.0.smithi022.stdout:927 2023-10-11T21:45:31.056 INFO:tasks.workunit.client.0.smithi022.stdout:928 2023-10-11T21:45:31.085 INFO:tasks.workunit.client.0.smithi022.stdout:929 2023-10-11T21:45:31.114 INFO:tasks.workunit.client.0.smithi022.stdout:930 2023-10-11T21:45:31.141 INFO:tasks.workunit.client.0.smithi022.stdout:931 2023-10-11T21:45:31.168 INFO:tasks.workunit.client.0.smithi022.stdout:932 2023-10-11T21:45:31.194 INFO:tasks.workunit.client.0.smithi022.stdout:933 2023-10-11T21:45:31.222 INFO:tasks.workunit.client.0.smithi022.stdout:934 2023-10-11T21:45:31.249 INFO:tasks.workunit.client.0.smithi022.stdout:935 2023-10-11T21:45:31.276 INFO:tasks.workunit.client.0.smithi022.stdout:936 2023-10-11T21:45:31.304 INFO:tasks.workunit.client.0.smithi022.stdout:937 2023-10-11T21:45:31.330 INFO:tasks.workunit.client.0.smithi022.stdout:938 2023-10-11T21:45:31.357 INFO:tasks.workunit.client.0.smithi022.stdout:939 2023-10-11T21:45:31.384 INFO:tasks.workunit.client.0.smithi022.stdout:940 2023-10-11T21:45:31.412 INFO:tasks.workunit.client.0.smithi022.stdout:941 2023-10-11T21:45:31.438 INFO:tasks.workunit.client.0.smithi022.stdout:942 2023-10-11T21:45:31.470 INFO:tasks.workunit.client.0.smithi022.stdout:943 2023-10-11T21:45:31.497 INFO:tasks.workunit.client.0.smithi022.stdout:944 2023-10-11T21:45:31.524 INFO:tasks.workunit.client.0.smithi022.stdout:945 2023-10-11T21:45:31.553 INFO:tasks.workunit.client.0.smithi022.stdout:946 2023-10-11T21:45:31.581 INFO:tasks.workunit.client.0.smithi022.stdout:947 2023-10-11T21:45:31.609 INFO:tasks.workunit.client.0.smithi022.stdout:948 2023-10-11T21:45:31.635 INFO:tasks.workunit.client.0.smithi022.stdout:949 2023-10-11T21:45:31.661 INFO:tasks.workunit.client.0.smithi022.stdout:950 2023-10-11T21:45:31.690 INFO:tasks.workunit.client.0.smithi022.stdout:951 2023-10-11T21:45:31.719 INFO:tasks.workunit.client.0.smithi022.stdout:952 2023-10-11T21:45:31.746 INFO:tasks.workunit.client.0.smithi022.stdout:953 2023-10-11T21:45:31.773 INFO:tasks.workunit.client.0.smithi022.stdout:954 2023-10-11T21:45:31.799 INFO:tasks.workunit.client.0.smithi022.stdout:955 2023-10-11T21:45:31.830 INFO:tasks.workunit.client.0.smithi022.stdout:956 2023-10-11T21:45:31.856 INFO:tasks.workunit.client.0.smithi022.stdout:957 2023-10-11T21:45:31.884 INFO:tasks.workunit.client.0.smithi022.stdout:958 2023-10-11T21:45:31.911 INFO:tasks.workunit.client.0.smithi022.stdout:959 2023-10-11T21:45:31.939 INFO:tasks.workunit.client.0.smithi022.stdout:960 2023-10-11T21:45:31.969 INFO:tasks.workunit.client.0.smithi022.stdout:961 2023-10-11T21:45:32.007 INFO:tasks.workunit.client.0.smithi022.stdout:962 2023-10-11T21:45:32.038 INFO:tasks.workunit.client.0.smithi022.stdout:963 2023-10-11T21:45:32.064 INFO:tasks.workunit.client.0.smithi022.stdout:964 2023-10-11T21:45:32.091 INFO:tasks.workunit.client.0.smithi022.stdout:965 2023-10-11T21:45:32.119 INFO:tasks.workunit.client.0.smithi022.stdout:966 2023-10-11T21:45:32.148 INFO:tasks.workunit.client.0.smithi022.stdout:967 2023-10-11T21:45:32.174 INFO:tasks.workunit.client.0.smithi022.stdout:968 2023-10-11T21:45:32.202 INFO:tasks.workunit.client.0.smithi022.stdout:969 2023-10-11T21:45:32.230 INFO:tasks.workunit.client.0.smithi022.stdout:970 2023-10-11T21:45:32.258 INFO:tasks.workunit.client.0.smithi022.stdout:971 2023-10-11T21:45:32.285 INFO:tasks.workunit.client.0.smithi022.stdout:972 2023-10-11T21:45:32.314 INFO:tasks.workunit.client.0.smithi022.stdout:973 2023-10-11T21:45:32.345 INFO:tasks.workunit.client.0.smithi022.stdout:974 2023-10-11T21:45:32.373 INFO:tasks.workunit.client.0.smithi022.stdout:975 2023-10-11T21:45:32.401 INFO:tasks.workunit.client.0.smithi022.stdout:976 2023-10-11T21:45:32.428 INFO:tasks.workunit.client.0.smithi022.stdout:977 2023-10-11T21:45:32.457 INFO:tasks.workunit.client.0.smithi022.stdout:978 2023-10-11T21:45:32.484 INFO:tasks.workunit.client.0.smithi022.stdout:979 2023-10-11T21:45:32.512 INFO:tasks.workunit.client.0.smithi022.stdout:980 2023-10-11T21:45:32.539 INFO:tasks.workunit.client.0.smithi022.stdout:981 2023-10-11T21:45:32.567 INFO:tasks.workunit.client.0.smithi022.stdout:982 2023-10-11T21:45:32.600 INFO:tasks.workunit.client.0.smithi022.stdout:983 2023-10-11T21:45:32.629 INFO:tasks.workunit.client.0.smithi022.stdout:984 2023-10-11T21:45:32.656 INFO:tasks.workunit.client.0.smithi022.stdout:985 2023-10-11T21:45:32.683 INFO:tasks.workunit.client.0.smithi022.stdout:986 2023-10-11T21:45:32.709 INFO:tasks.workunit.client.0.smithi022.stdout:987 2023-10-11T21:45:32.738 INFO:tasks.workunit.client.0.smithi022.stdout:988 2023-10-11T21:45:32.772 INFO:tasks.workunit.client.0.smithi022.stdout:989 2023-10-11T21:45:32.804 INFO:tasks.workunit.client.0.smithi022.stdout:990 2023-10-11T21:45:32.834 INFO:tasks.workunit.client.0.smithi022.stdout:991 2023-10-11T21:45:32.848 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.175 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.850 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.177 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.864 INFO:tasks.workunit.client.0.smithi022.stdout:992 2023-10-11T21:45:32.869 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.195 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.895 INFO:tasks.workunit.client.0.smithi022.stdout:993 2023-10-11T21:45:32.895 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.171 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.898 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.174 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.901 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.228 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.905 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.232 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.914 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.191 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.925 INFO:tasks.workunit.client.0.smithi022.stdout:994 2023-10-11T21:45:32.937 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.264 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:32.954 INFO:tasks.workunit.client.0.smithi022.stdout:995 2023-10-11T21:45:32.987 INFO:tasks.workunit.client.0.smithi022.stdout:996 2023-10-11T21:45:33.018 INFO:tasks.workunit.client.0.smithi022.stdout:997 2023-10-11T21:45:33.050 INFO:tasks.workunit.client.0.smithi022.stdout:998 2023-10-11T21:45:33.082 INFO:tasks.workunit.client.0.smithi022.stdout:999 2023-10-11T21:45:33.306 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.582 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.307 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.583 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.317 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:28.593 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.322 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.648 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.323 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.650 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.332 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:28.659 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.358 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.685 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.359 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.686 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:33.368 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:28.695 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:34.201 INFO:tasks.workunit.client.0.smithi022.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2023-10-11T21:45:34.201 INFO:tasks.workunit.client.0.smithi022.stdout:00000010 69 73 |is| 2023-10-11T21:45:34.201 INFO:tasks.workunit.client.0.smithi022.stdout:00000012 2023-10-11T21:45:34.201 INFO:tasks.workunit.client.0.smithi022.stdout:00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2023-10-11T21:45:34.202 INFO:tasks.workunit.client.0.smithi022.stdout:00000010 69 73 |is| 2023-10-11T21:45:34.202 INFO:tasks.workunit.client.0.smithi022.stdout:00000012 2023-10-11T21:45:34.202 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.WriteReturnData (27182 ms) 2023-10-11T21:45:34.202 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.Loud 2023-10-11T21:45:37.543 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.Loud (3342 ms) 2023-10-11T21:45:37.543 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.BadMethods 2023-10-11T21:45:37.852 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:33.179 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.854 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:33.181 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.867 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:33.194 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.903 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:33.180 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.907 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:33.183 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.923 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:33.249 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.923 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:33.199 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.924 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:33.251 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:37.947 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:33.274 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:40.130 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:45:40.125+0000 25e8e640 -1 osd.5 pg_epoch: 165 pg[35.2( v 165'1 (0'0,165'1] local-lis/les=164/165 n=1 ec=164/164 lis/c=164/164 les/c/f=165/165/0 sis=164) [5,2] r=0 lpr=164 crt=165'1 lcod 0'0 mlcod 0'0 active+clean] method hello.bad_reader tried to read object but is not marked RD 2023-10-11T21:45:40.187 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:45:40.184+0000 25e8e640 -1 osd.5 pg_epoch: 165 pg[35.2( v 165'2 (0'0,165'2] local-lis/les=164/165 n=1 ec=164/164 lis/c=164/164 les/c/f=165/165/0 sis=164) [5,2] r=0 lpr=164 crt=165'1 lcod 165'1 mlcod 165'1 active+clean] method hello.bad_writer tried to update object but is not marked WR 2023-10-11T21:45:41.002 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.BadMethods (3460 ms) 2023-10-11T21:45:41.003 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsHello.Filter 2023-10-11T21:45:44.336 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsHello.Filter (3333 ms) 2023-10-11T21:45:44.336 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 6 tests from ClsHello (44135 ms total) 2023-10-11T21:45:44.336 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:45:44.336 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:45:44.337 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 6 tests from 1 test suite ran. (44135 ms total) 2023-10-11T21:45:44.337 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 6 tests. 2023-10-11T21:45:44.338 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:45:44.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:45:44.410 INFO:tasks.workunit:Running workunit cls/test_cls_journal.sh... 2023-10-11T21:45:44.410 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_journal.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_journal.sh 2023-10-11T21:45:44.480 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:45:44.480 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 27 tests from 1 test suite. 2023-10-11T21:45:44.480 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:45:44.480 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 27 tests from TestClsJournal 2023-10-11T21:45:46.430 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.Create 2023-10-11T21:45:46.774 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.Create (344 ms) 2023-10-11T21:45:46.775 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.MinimumSet 2023-10-11T21:45:46.928 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.MinimumSet (155 ms) 2023-10-11T21:45:46.929 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.MinimumSetStale 2023-10-11T21:45:47.055 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.MinimumSetStale (126 ms) 2023-10-11T21:45:47.055 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.MinimumSetOrderConstraint 2023-10-11T21:45:47.134 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.MinimumSetOrderConstraint (79 ms) 2023-10-11T21:45:47.134 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ActiveSet 2023-10-11T21:45:47.218 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ActiveSet (84 ms) 2023-10-11T21:45:47.218 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ActiveSetStale 2023-10-11T21:45:47.316 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ActiveSetStale (98 ms) 2023-10-11T21:45:47.317 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.CreateDuplicate 2023-10-11T21:45:47.373 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.CreateDuplicate (56 ms) 2023-10-11T21:45:47.374 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.GetClient 2023-10-11T21:45:47.465 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.GetClient (93 ms) 2023-10-11T21:45:47.465 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientRegister 2023-10-11T21:45:47.540 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientRegister (75 ms) 2023-10-11T21:45:47.540 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientRegisterDuplicate 2023-10-11T21:45:47.711 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientRegisterDuplicate (171 ms) 2023-10-11T21:45:47.711 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientUpdateData 2023-10-11T21:45:47.819 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientUpdateData (108 ms) 2023-10-11T21:45:47.820 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientUpdateState 2023-10-11T21:45:47.970 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientUpdateState (150 ms) 2023-10-11T21:45:47.970 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientUnregister 2023-10-11T21:45:47.971 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:43.298 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:47.973 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:43.300 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:47.995 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:43.322 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.022 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:43.298 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.025 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:43.301 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.044 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:43.371 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.045 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:43.372 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.046 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:43.322 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.067 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:43.394 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:48.110 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientUnregister (140 ms) 2023-10-11T21:45:48.110 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientUnregisterDNE 2023-10-11T21:45:48.347 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientUnregisterDNE (237 ms) 2023-10-11T21:45:48.347 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientUnregisterPruneTags 2023-10-11T21:45:50.962 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientUnregisterPruneTags (2615 ms) 2023-10-11T21:45:50.963 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientCommit 2023-10-11T21:45:51.063 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientCommit (101 ms) 2023-10-11T21:45:51.063 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientCommitInvalid 2023-10-11T21:45:51.135 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientCommitInvalid (72 ms) 2023-10-11T21:45:51.136 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientCommitDNE 2023-10-11T21:45:51.156 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientCommitDNE (21 ms) 2023-10-11T21:45:51.156 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.ClientList 2023-10-11T21:45:52.905 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:48.232 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.907 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:48.234 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.917 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:48.244 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.942 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.ClientList (1786 ms) 2023-10-11T21:45:52.943 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.GetNextTagTid 2023-10-11T21:45:52.958 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:48.234 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.959 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:48.236 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.969 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:48.295 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.969 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:48.245 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.971 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:48.298 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:52.981 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:48.308 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:45:53.066 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.GetNextTagTid (124 ms) 2023-10-11T21:45:53.066 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.TagCreate 2023-10-11T21:45:53.311 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.TagCreate (245 ms) 2023-10-11T21:45:53.311 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.TagCreatePrunesTags 2023-10-11T21:45:53.535 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.TagCreatePrunesTags (225 ms) 2023-10-11T21:45:53.536 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.TagList 2023-10-11T21:45:56.138 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.TagList (2602 ms) 2023-10-11T21:45:56.139 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.GuardAppend 2023-10-11T21:45:56.179 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.GuardAppend (41 ms) 2023-10-11T21:45:56.179 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.GuardAppendDNE 2023-10-11T21:45:56.198 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.GuardAppendDNE (19 ms) 2023-10-11T21:45:56.198 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.GuardAppendOverflow 2023-10-11T21:45:56.242 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.GuardAppendOverflow (44 ms) 2023-10-11T21:45:56.243 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsJournal.Append 2023-10-11T21:45:56.425 INFO:tasks.workunit.client.0.smithi022.stdout:padding is not enabled 2023-10-11T21:45:56.425 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsJournal.Append (183 ms) 2023-10-11T21:45:56.600 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 27 tests from TestClsJournal (9995 ms total) 2023-10-11T21:45:56.600 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:45:56.600 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:45:56.601 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 27 tests from 1 test suite ran. (12120 ms total) 2023-10-11T21:45:56.601 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 27 tests. 2023-10-11T21:45:56.602 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:45:56.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:45:56.675 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2023-10-11T21:45:56.675 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2023-10-11T21:45:56.745 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:45:56.745 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 11 tests from 1 test suite. 2023-10-11T21:45:56.745 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:45:56.746 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 11 tests from ClsLock 2023-10-11T21:45:56.746 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestMultiLocking 2023-10-11T21:45:59.203 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:45:59.204 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: exclusive 2023-10-11T21:45:59.204 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:45:59.204 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:45:59.204 INFO:tasks.workunit.client.0.smithi022.stdout: client.4627 expiration=2023-10-11T21:47:59.091943+0000 addr=v1:172.21.15.22:0/888535976 cookie= 2023-10-11T21:45:59.297 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:45:59.297 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: shared 2023-10-11T21:45:59.297 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:45:59.298 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:45:59.298 INFO:tasks.workunit.client.0.smithi022.stdout: client.4627 expiration=2023-10-11T21:47:59.260793+0000 addr=v1:172.21.15.22:0/888535976 cookie= 2023-10-11T21:45:59.298 INFO:tasks.workunit.client.0.smithi022.stdout: client.4653 expiration=0.000000 addr=v1:172.21.15.22:0/297649298 cookie= 2023-10-11T21:45:59.327 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:45:59.327 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: shared 2023-10-11T21:45:59.327 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:45:59.327 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:45:59.328 INFO:tasks.workunit.client.0.smithi022.stdout: client.4653 expiration=0.000000 addr=v1:172.21.15.22:0/297649298 cookie= 2023-10-11T21:45:59.848 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestMultiLocking (3103 ms) 2023-10-11T21:45:59.848 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestMeta 2023-10-11T21:46:02.732 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:46:02.732 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: shared 2023-10-11T21:46:02.732 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:46:02.732 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:46:02.733 INFO:tasks.workunit.client.0.smithi022.stdout: client.4583 expiration=0.000000 addr=v1:172.21.15.22:0/2838049471 cookie= 2023-10-11T21:46:02.794 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:46:02.795 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: exclusive 2023-10-11T21:46:02.795 INFO:tasks.workunit.client.0.smithi022.stdout: tag: new_tag 2023-10-11T21:46:02.795 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:46:02.796 INFO:tasks.workunit.client.0.smithi022.stdout: client.4639 expiration=0.000000 addr=v1:172.21.15.22:0/1957679235 cookie= 2023-10-11T21:46:02.883 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:58.210 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.927 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:58.204 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.929 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:58.205 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.934 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:58.261 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.947 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:48:58.224 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.955 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:48:58.282 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.990 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:58.317 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:02.993 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:58.320 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:03.011 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:48:58.338 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:03.498 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestMeta (3650 ms) 2023-10-11T21:46:03.499 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestCookie 2023-10-11T21:46:06.186 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:46:06.187 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: exclusive 2023-10-11T21:46:06.187 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:46:06.187 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:46:06.244 INFO:tasks.workunit.client.0.smithi022.stdout:lock: mylock 2023-10-11T21:46:06.245 INFO:tasks.workunit.client.0.smithi022.stdout: lock_type: shared 2023-10-11T21:46:06.245 INFO:tasks.workunit.client.0.smithi022.stdout: tag: 2023-10-11T21:46:06.246 INFO:tasks.workunit.client.0.smithi022.stdout: lockers: 2023-10-11T21:46:06.246 INFO:tasks.workunit.client.0.smithi022.stdout: client.4651 expiration=0.000000 addr=v1:172.21.15.22:0/871291301 cookie= 2023-10-11T21:46:06.247 INFO:tasks.workunit.client.0.smithi022.stdout: client.4651 expiration=0.000000 addr=v1:172.21.15.22:0/871291301 cookie=new cookie 2023-10-11T21:46:06.819 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestCookie (3321 ms) 2023-10-11T21:46:06.820 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestMultipleLocks 2023-10-11T21:46:10.200 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestMultipleLocks (3381 ms) 2023-10-11T21:46:10.200 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestLockDuration 2023-10-11T21:46:12.999 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:08.326 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.002 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:08.328 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.023 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:08.350 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.048 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:08.323 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.049 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:08.325 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.052 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:08.379 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.055 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:08.382 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.067 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:08.343 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:13.083 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:08.410 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.044 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestLockDuration (7844 ms) 2023-10-11T21:46:18.044 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestAssertLocked 2023-10-11T21:46:18.167 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:13.494 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.170 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:13.497 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.188 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:13.515 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.224 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:13.500 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.224 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:13.551 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.225 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:13.501 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.226 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:13.553 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.236 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:13.512 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:18.238 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:13.565 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:21.253 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestAssertLocked (3210 ms) 2023-10-11T21:46:21.254 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestSetCookie 2023-10-11T21:46:25.784 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:21.111 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.786 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:21.113 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.814 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:21.141 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.838 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:21.115 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.841 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:21.118 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.852 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:21.179 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.855 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:21.182 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.861 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:21.138 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:25.877 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:21.203 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:26.918 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestSetCookie (5664 ms) 2023-10-11T21:46:26.918 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestRenew 2023-10-11T21:46:33.104 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.430 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.106 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.432 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.121 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.448 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.145 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.421 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.149 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.426 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.166 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.442 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.173 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.499 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.176 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.502 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.190 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.517 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.488 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.764 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.488 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.765 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.496 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:28.773 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.525 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.852 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.526 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.853 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.535 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:28.862 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.575 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.901 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.576 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.903 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:33.584 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:28.911 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:48.427 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestRenew (21509 ms) 2023-10-11T21:46:48.427 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2023-10-11T21:46:53.156 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.483 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.157 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.484 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.175 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.502 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.204 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.480 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.206 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.482 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.209 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.536 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.214 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.540 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.222 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.499 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.245 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.572 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.565 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.841 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.566 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.842 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.574 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:49:48.851 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.609 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.936 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.610 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.937 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.618 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:49:48.945 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.658 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.984 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.659 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.985 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:53.667 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:49:48.994 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:46:56.511 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (8084 ms) 2023-10-11T21:46:56.511 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2023-10-11T21:47:05.345 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8834 ms) 2023-10-11T21:47:05.346 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2023-10-11T21:47:08.313 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:03.589 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.314 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:03.590 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.316 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:03.643 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.317 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:03.644 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.333 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:03.609 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.338 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:03.665 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.371 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:03.697 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.372 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:03.699 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:08.391 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:03.718 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.216 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:08.543 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.219 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:08.546 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.229 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:08.555 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.265 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:08.541 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.266 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:08.593 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.269 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:08.545 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.271 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:08.598 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.281 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:08.557 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:13.285 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:08.612 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:14.297 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8952 ms) 2023-10-11T21:47:14.297 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 11 tests from ClsLock (77552 ms total) 2023-10-11T21:47:14.298 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:47:14.298 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:47:14.298 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 11 tests from 1 test suite ran. (77552 ms total) 2023-10-11T21:47:14.298 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 11 tests. 2023-10-11T21:47:14.299 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:47:14.300 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:47:14.371 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2023-10-11T21:47:14.372 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2023-10-11T21:47:14.443 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:47:14.444 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 4 tests from 1 test suite. 2023-10-11T21:47:14.444 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:47:14.444 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 4 tests from cls_log 2023-10-11T21:47:14.444 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_log.test_log_add_same_time 2023-10-11T21:47:17.611 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_log.test_log_add_same_time (3168 ms) 2023-10-11T21:47:17.611 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_log.test_log_add_different_time 2023-10-11T21:47:20.857 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_log.test_log_add_different_time (3247 ms) 2023-10-11T21:47:20.858 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_log.trim_by_time 2023-10-11T21:47:23.499 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:18.826 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.502 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:18.828 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.520 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:18.847 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.552 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:18.878 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.553 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:18.880 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.567 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:18.843 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.572 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:18.899 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.572 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:18.849 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:23.596 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:18.872 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:24.402 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_log.trim_by_time (3544 ms) 2023-10-11T21:47:24.403 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_log.trim_by_marker 2023-10-11T21:47:27.809 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_log.trim_by_marker (3406 ms) 2023-10-11T21:47:27.809 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 4 tests from cls_log (13365 ms total) 2023-10-11T21:47:27.809 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:47:27.809 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:47:27.810 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 4 tests from 1 test suite ran. (13365 ms total) 2023-10-11T21:47:27.810 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 4 tests. 2023-10-11T21:47:27.811 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:47:27.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:47:27.885 INFO:tasks.workunit:Running workunit cls/test_cls_numops.sh... 2023-10-11T21:47:27.885 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_numops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_numops.sh 2023-10-11T21:47:27.957 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:47:27.958 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 4 tests from 1 test suite. 2023-10-11T21:47:27.958 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:47:27.958 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 4 tests from ClsNumOps 2023-10-11T21:47:27.958 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsNumOps.Add 2023-10-11T21:47:31.201 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsNumOps.Add (3244 ms) 2023-10-11T21:47:31.201 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsNumOps.Sub 2023-10-11T21:47:38.382 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:33.707 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.385 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:33.712 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.410 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:33.737 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.429 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:33.705 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.432 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:33.708 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.436 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:33.763 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.439 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:33.766 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.452 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:33.729 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.474 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:33.800 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.728 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:34.004 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.746 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:34.072 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.747 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:34.074 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.755 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:34.082 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.780 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:34.056 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.790 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:34.066 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.791 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:34.115 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.791 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:34.117 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:38.801 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:34.127 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.439 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:53.766 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.441 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:53.768 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.457 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:53.784 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.491 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:53.767 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.492 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:53.818 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.492 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:53.769 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.493 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:53.820 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.507 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:53.783 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.510 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:53.837 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.881 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:54.157 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.882 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:54.158 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.890 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:50:54.166 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.892 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:54.219 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.893 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:54.220 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.902 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:50:54.229 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.911 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:54.238 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.912 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:54.239 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:47:58.924 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:50:54.250 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.501 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:13.827 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.502 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:13.829 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.517 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:13.843 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.548 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:13.824 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.551 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:13.827 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.551 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:13.878 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.553 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:13.880 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.567 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:13.843 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.570 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:13.897 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.939 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:14.215 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.940 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:14.216 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.950 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:14.226 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.953 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:14.280 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.954 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:14.281 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.962 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:14.289 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.973 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:14.300 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.975 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:14.302 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:18.987 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:14.313 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:31.887 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsNumOps.Sub (60686 ms) 2023-10-11T21:48:31.888 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsNumOps.Mul 2023-10-11T21:48:35.187 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsNumOps.Mul (3300 ms) 2023-10-11T21:48:35.188 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] ClsNumOps.Div 2023-10-11T21:48:38.543 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] ClsNumOps.Div (3356 ms) 2023-10-11T21:48:38.544 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 4 tests from ClsNumOps (70586 ms total) 2023-10-11T21:48:38.544 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:48:38.544 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:48:38.545 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 4 tests from 1 test suite ran. (70586 ms total) 2023-10-11T21:48:38.545 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 4 tests. 2023-10-11T21:48:38.546 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:48:38.546 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:48:38.621 INFO:tasks.workunit:Running workunit cls/test_cls_rbd.sh... 2023-10-11T21:48:38.621 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_rbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh 2023-10-11T21:48:38.691 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:48:38.691 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 70 tests from 1 test suite. 2023-10-11T21:48:38.691 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:48:38.692 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 70 tests from TestClsRbd 2023-10-11T21:48:38.699 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:34.025 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.705 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:34.031 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.745 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:34.072 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.759 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:34.036 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.762 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:34.038 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.768 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:34.095 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.773 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:34.100 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.794 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:34.070 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:38.805 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:34.132 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:41.011 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_all_features 2023-10-11T21:48:41.278 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_all_features (267 ms) 2023-10-11T21:48:41.279 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.copyup 2023-10-11T21:48:42.249 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.copyup (970 ms) 2023-10-11T21:48:42.249 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.sparse_copyup 2023-10-11T21:48:42.606 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.sparse_copyup (358 ms) 2023-10-11T21:48:42.607 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_and_set_id 2023-10-11T21:48:42.809 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_and_set_id (203 ms) 2023-10-11T21:48:42.809 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.add_remove_child 2023-10-11T21:48:43.129 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.add_remove_child (320 ms) 2023-10-11T21:48:43.129 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.directory_methods 2023-10-11T21:48:43.834 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.directory_methods (705 ms) 2023-10-11T21:48:43.834 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.create 2023-10-11T21:48:44.150 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.create (316 ms) 2023-10-11T21:48:44.150 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_features 2023-10-11T21:48:44.199 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_features (49 ms) 2023-10-11T21:48:44.199 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_object_prefix 2023-10-11T21:48:44.294 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_object_prefix (95 ms) 2023-10-11T21:48:44.294 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_create_timestamp 2023-10-11T21:48:44.362 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_create_timestamp (68 ms) 2023-10-11T21:48:44.362 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_access_timestamp 2023-10-11T21:48:44.418 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_access_timestamp (56 ms) 2023-10-11T21:48:44.419 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_modify_timestamp 2023-10-11T21:48:44.456 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_modify_timestamp (38 ms) 2023-10-11T21:48:44.456 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_data_pool 2023-10-11T21:48:44.553 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_data_pool (97 ms) 2023-10-11T21:48:44.553 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.get_size 2023-10-11T21:48:44.676 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.get_size (123 ms) 2023-10-11T21:48:44.676 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.set_size 2023-10-11T21:48:44.802 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.set_size (126 ms) 2023-10-11T21:48:44.803 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.protection_status 2023-10-11T21:48:45.300 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.protection_status (498 ms) 2023-10-11T21:48:45.301 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.snapshot_limits 2023-10-11T21:48:45.513 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.snapshot_limits (213 ms) 2023-10-11T21:48:45.513 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.parents_v1 2023-10-11T21:48:46.582 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.parents_v1 (1069 ms) 2023-10-11T21:48:46.583 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.parents_v2 2023-10-11T21:48:47.411 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.parents_v2 (829 ms) 2023-10-11T21:48:47.411 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.snapshots 2023-10-11T21:48:48.017 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.snapshots (606 ms) 2023-10-11T21:48:48.017 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.snapid_race 2023-10-11T21:48:48.125 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.snapid_race (108 ms) 2023-10-11T21:48:48.125 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.stripingv2 2023-10-11T21:48:48.339 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.stripingv2 (214 ms) 2023-10-11T21:48:48.340 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_save 2023-10-11T21:48:48.386 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_save (46 ms) 2023-10-11T21:48:48.386 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_resize 2023-10-11T21:48:48.520 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_resize (135 ms) 2023-10-11T21:48:48.521 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_update 2023-10-11T21:48:48.654 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_update (134 ms) 2023-10-11T21:48:48.654 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_load_enoent 2023-10-11T21:48:48.657 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_load_enoent (4 ms) 2023-10-11T21:48:48.658 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_snap_add 2023-10-11T21:48:48.766 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_snap_add (108 ms) 2023-10-11T21:48:48.767 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.object_map_snap_remove 2023-10-11T21:48:48.884 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.object_map_snap_remove (118 ms) 2023-10-11T21:48:48.885 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.flags 2023-10-11T21:48:49.018 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.flags (134 ms) 2023-10-11T21:48:49.018 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.metadata 2023-10-11T21:48:49.809 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.metadata (791 ms) 2023-10-11T21:48:49.809 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.set_features 2023-10-11T21:48:49.976 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.set_features (167 ms) 2023-10-11T21:48:49.977 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror 2023-10-11T21:48:50.882 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror (906 ms) 2023-10-11T21:48:50.883 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror_image 2023-10-11T21:48:51.310 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror_image (428 ms) 2023-10-11T21:48:51.310 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror_image_status 2023-10-11T21:48:58.637 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:53.963 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.639 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:53.966 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.661 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:53.988 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:53.966 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.692 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:53.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.709 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.036 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.710 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:53.986 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.711 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.038 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:58.739 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.065 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.165 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.441 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.165 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.442 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.179 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.455 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.326 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:54.652 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.326 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:54.653 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.329 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.656 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.330 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.657 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.341 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:51:54.668 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.344 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:51:54.671 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.551 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.827 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.552 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.829 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:48:59.564 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:51:54.840 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.698 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.025 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.700 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.027 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.717 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.044 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.747 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.023 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.749 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.025 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.752 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.079 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.753 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.080 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.763 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.039 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:18.769 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.095 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.181 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.457 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.182 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.458 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.190 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:14.466 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.192 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.518 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.193 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.520 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.206 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:14.532 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.214 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.541 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.216 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.543 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:19.229 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:14.556 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.798 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.124 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.800 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.127 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.816 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.143 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.847 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.123 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.850 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.126 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.854 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.181 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.856 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.183 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.864 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.141 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:38.878 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.204 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.217 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.544 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.218 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.545 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.224 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.500 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.226 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.502 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.231 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:34.557 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.237 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:34.513 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.290 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.617 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.291 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.618 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:39.302 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:34.629 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.836 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:54.162 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.838 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:54.165 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.854 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:54.181 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.886 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:54.162 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.889 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:54.165 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.889 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:54.216 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.894 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:54.221 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.903 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:54.179 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:49:58.914 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:54.240 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.834 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:59.160 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.837 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:59.163 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.848 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:52:59.175 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.886 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:59.163 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.888 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:59.165 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.889 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:59.216 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.891 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:59.217 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.901 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:52:59.228 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:03.902 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:52:59.179 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:10.031 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror_image_status (78721 ms) 2023-10-11T21:50:10.031 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror_image_map 2023-10-11T21:50:13.545 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror_image_map (3514 ms) 2023-10-11T21:50:13.545 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror_instances 2023-10-11T21:50:13.747 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror_instances (202 ms) 2023-10-11T21:50:13.747 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.mirror_snapshot 2023-10-11T21:50:14.061 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.mirror_snapshot (314 ms) 2023-10-11T21:50:14.062 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_dir_list 2023-10-11T21:50:14.129 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_dir_list (68 ms) 2023-10-11T21:50:14.130 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_dir_add 2023-10-11T21:50:14.179 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_dir_add (50 ms) 2023-10-11T21:50:14.179 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.dir_add_already_existing 2023-10-11T21:50:14.248 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.dir_add_already_existing (69 ms) 2023-10-11T21:50:14.249 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_dir_rename 2023-10-11T21:50:14.394 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_dir_rename (146 ms) 2023-10-11T21:50:14.395 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_dir_remove 2023-10-11T21:50:14.479 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_dir_remove (85 ms) 2023-10-11T21:50:14.479 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_dir_remove_missing 2023-10-11T21:50:14.579 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_dir_remove_missing (100 ms) 2023-10-11T21:50:14.580 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_image_add 2023-10-11T21:50:14.633 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_image_add (54 ms) 2023-10-11T21:50:14.633 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_image_remove 2023-10-11T21:50:14.720 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_image_remove (87 ms) 2023-10-11T21:50:14.720 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_image_list 2023-10-11T21:50:14.796 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_image_list (75 ms) 2023-10-11T21:50:14.796 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_image_clean 2023-10-11T21:50:14.925 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_image_clean (130 ms) 2023-10-11T21:50:14.925 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.image_group_add 2023-10-11T21:50:14.983 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.image_group_add (58 ms) 2023-10-11T21:50:14.984 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.image_group_remove 2023-10-11T21:50:15.067 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.image_group_remove (84 ms) 2023-10-11T21:50:15.067 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.image_group_get 2023-10-11T21:50:15.123 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.image_group_get (56 ms) 2023-10-11T21:50:15.123 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_name 2023-10-11T21:50:15.163 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_set_empty_name (40 ms) 2023-10-11T21:50:15.163 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_set_empty_id 2023-10-11T21:50:15.210 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_set_empty_id (47 ms) 2023-10-11T21:50:15.210 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_id 2023-10-11T21:50:15.280 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_id (70 ms) 2023-10-11T21:50:15.281 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_set_duplicate_name 2023-10-11T21:50:15.352 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_set_duplicate_name (72 ms) 2023-10-11T21:50:15.352 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_set 2023-10-11T21:50:15.414 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_set (62 ms) 2023-10-11T21:50:15.415 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_list 2023-10-11T21:50:15.503 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_list (89 ms) 2023-10-11T21:50:15.503 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_list_max_return 2023-10-11T21:50:15.967 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_list_max_return (464 ms) 2023-10-11T21:50:15.967 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_list_max_read 2023-10-11T21:50:18.882 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:14.209 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.886 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:14.213 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.902 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:14.228 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.936 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:14.212 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.937 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:14.213 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.949 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:14.226 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.967 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:14.293 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.968 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:14.295 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:18.982 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:14.309 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:22.701 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_list_max_read (6734 ms) 2023-10-11T21:50:22.701 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_remove 2023-10-11T21:50:22.790 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_remove (89 ms) 2023-10-11T21:50:22.790 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.group_snap_get_by_id 2023-10-11T21:50:22.847 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.group_snap_get_by_id (57 ms) 2023-10-11T21:50:22.848 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.trash_methods 2023-10-11T21:50:23.031 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.trash_methods (183 ms) 2023-10-11T21:50:23.031 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.op_features 2023-10-11T21:50:23.198 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.op_features (168 ms) 2023-10-11T21:50:23.198 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.clone_parent 2023-10-11T21:50:23.777 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.clone_parent (579 ms) 2023-10-11T21:50:23.777 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.clone_parent_ns 2023-10-11T21:50:23.896 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:19.223 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.900 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:19.226 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.912 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:19.239 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.948 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:19.224 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.951 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:19.228 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.952 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:19.279 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.954 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:19.281 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.963 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:19.240 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:23.965 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:19.292 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:24.000 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.clone_parent_ns (223 ms) 2023-10-11T21:50:24.000 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.clone_child 2023-10-11T21:50:24.330 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.clone_child (330 ms) 2023-10-11T21:50:24.331 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.namespace_methods 2023-10-11T21:50:24.509 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.namespace_methods (179 ms) 2023-10-11T21:50:24.510 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.migration 2023-10-11T21:50:24.763 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.migration (254 ms) 2023-10-11T21:50:24.763 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.migration_v1 2023-10-11T21:50:24.974 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.migration_v1 (211 ms) 2023-10-11T21:50:24.975 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.assert_snapc_seq 2023-10-11T21:50:26.582 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.assert_snapc_seq (1608 ms) 2023-10-11T21:50:26.583 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] TestClsRbd.sparsify 2023-10-11T21:50:27.311 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] TestClsRbd.sparsify (729 ms) 2023-10-11T21:50:27.622 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 70 tests from TestClsRbd (106300 ms total) 2023-10-11T21:50:27.622 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:50:27.623 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:50:27.623 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 70 tests from 1 test suite ran. (108931 ms total) 2023-10-11T21:50:27.623 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 70 tests. 2023-10-11T21:50:27.624 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:50:27.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:50:27.696 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2023-10-11T21:50:27.696 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2023-10-11T21:50:27.766 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:50:27.767 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 10 tests from 1 test suite. 2023-10-11T21:50:27.767 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:50:27.767 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 10 tests from cls_rgw 2023-10-11T21:50:27.767 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_implicit 2023-10-11T21:50:30.976 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_implicit (3210 ms) 2023-10-11T21:50:30.977 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2023-10-11T21:50:33.922 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:29.248 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.926 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:29.253 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.946 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:29.273 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.972 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:29.248 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.973 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:29.250 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.976 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:29.303 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.979 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:29.306 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.990 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:29.266 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:33.998 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:29.324 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:34.393 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3416 ms) 2023-10-11T21:50:34.393 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_put_snap 2023-10-11T21:50:43.972 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_put_snap (9580 ms) 2023-10-11T21:50:43.973 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_explicit 2023-10-11T21:50:44.111 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:39.437 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.114 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:39.440 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.132 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:39.458 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.162 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:39.438 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.165 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:39.441 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.181 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:39.508 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.183 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:39.510 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.183 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:39.460 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:44.201 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:39.528 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:47.213 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_explicit (3241 ms) 2023-10-11T21:50:47.213 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.set 2023-10-11T21:50:48.970 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:44.296 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:48.972 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:44.299 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:48.985 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:44.311 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.018 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:44.295 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.021 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:44.298 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.024 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:44.351 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.027 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:44.352 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.034 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:44.310 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:50:49.038 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:44.365 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.011 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:59.338 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.013 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:59.340 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.031 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:53:59.358 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.061 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:59.337 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.062 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:59.338 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.067 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:59.394 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.068 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:59.395 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.082 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:53:59.359 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:04.084 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:53:59.411 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.030 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:04.357 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.032 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:04.359 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.041 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:04.368 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.078 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:04.354 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.080 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:04.357 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.081 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:04.408 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.083 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:04.410 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.091 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:04.367 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:09.093 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:04.419 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.187 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:19.514 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.189 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:19.516 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.202 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:19.529 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.231 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:19.507 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.236 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:19.512 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.237 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:19.563 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.238 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:19.565 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.249 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:19.526 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:24.251 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:19.578 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:25.704 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.set (38490 ms) 2023-10-11T21:51:25.704 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_implicit_ec 2023-10-11T21:51:29.174 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:24.501 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.177 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:24.504 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.196 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:24.523 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.248 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:24.575 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.249 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:24.576 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.252 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:24.529 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.254 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:24.530 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.266 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:24.592 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:29.268 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:24.544 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:33.539 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_implicit_ec (7836 ms) 2023-10-11T21:51:33.539 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_implicit_idempotent_ec 2023-10-11T21:51:41.349 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_implicit_idempotent_ec (7809 ms) 2023-10-11T21:51:41.349 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_put_snap_ec 2023-10-11T21:51:43.482 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:38.809 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.485 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:38.812 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.494 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:38.770 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.497 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:38.774 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.500 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:38.827 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.502 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:38.828 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.537 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:38.864 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.578 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:38.854 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:43.612 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:38.938 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.136 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:39.462 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.183 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:39.510 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.185 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.461 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.188 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:39.515 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.189 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.465 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.193 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:39.519 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.194 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:39.521 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.251 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.527 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.260 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:39.586 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.638 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.914 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.638 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.915 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.648 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:39.924 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.697 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:40.024 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.699 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:40.025 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.707 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:40.034 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.731 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:40.058 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.734 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:40.060 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:51:44.742 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:40.069 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.235 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.511 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.237 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:59.564 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.237 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.514 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.240 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:59.567 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.256 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.533 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.260 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:54:59.587 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.281 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:59.608 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.286 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:59.613 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.312 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:54:59.639 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.690 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.966 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.691 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.967 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.699 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:54:59.975 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.767 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:00.094 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.768 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:00.095 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.777 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:00.104 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.804 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:00.131 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.806 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:00.132 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:04.815 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:00.141 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:11.019 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:52:11.015+0000 f25a640 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:45.717196+0000 front 2023-10-11T21:50:45.723922+0000 (oldest deadline 2023-10-11T21:52:10.413712+0000) 2023-10-11T21:52:11.068 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:52:11.063+0000 ea59640 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:44.380484+0000 front 2023-10-11T21:50:44.391064+0000 (oldest deadline 2023-10-11T21:52:10.266278+0000) 2023-10-11T21:52:12.007 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:52:12.001+0000 ea59640 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:48.437803+0000 front 2023-10-11T21:50:48.440634+0000 (oldest deadline 2023-10-11T21:52:11.222136+0000) 2023-10-11T21:52:12.025 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:52:12.023+0000 f25a640 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:45.717196+0000 front 2023-10-11T21:50:45.723922+0000 (oldest deadline 2023-10-11T21:52:10.413712+0000) 2023-10-11T21:52:12.063 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:52:12.060+0000 ea59640 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:44.380484+0000 front 2023-10-11T21:50:44.391064+0000 (oldest deadline 2023-10-11T21:52:10.266278+0000) 2023-10-11T21:52:12.789 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:52:12.784+0000 ea59640 -1 osd.0 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.253398+0000 front 2023-10-11T21:50:46.254281+0000 (oldest deadline 2023-10-11T21:52:12.148754+0000) 2023-10-11T21:52:13.000 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:52:12.998+0000 f25a640 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:45.717196+0000 front 2023-10-11T21:50:45.723922+0000 (oldest deadline 2023-10-11T21:52:10.413712+0000) 2023-10-11T21:52:13.044 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:52:13.041+0000 ea59640 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:48.437803+0000 front 2023-10-11T21:50:48.440634+0000 (oldest deadline 2023-10-11T21:52:11.222136+0000) 2023-10-11T21:52:13.099 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:52:13.097+0000 ea59640 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:44.380484+0000 front 2023-10-11T21:50:44.391064+0000 (oldest deadline 2023-10-11T21:52:10.266278+0000) 2023-10-11T21:52:13.312 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:52:13.307+0000 f25a640 -1 osd.5 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.925119+0000 front 2023-10-11T21:50:46.919460+0000 (oldest deadline 2023-10-11T21:52:12.815542+0000) 2023-10-11T21:52:13.776 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:52:13.774+0000 ea59640 -1 osd.0 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.253398+0000 front 2023-10-11T21:50:46.254281+0000 (oldest deadline 2023-10-11T21:52:12.148754+0000) 2023-10-11T21:52:14.025 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:52:14.022+0000 ea59640 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:48.437803+0000 front 2023-10-11T21:50:48.440634+0000 (oldest deadline 2023-10-11T21:52:11.222136+0000) 2023-10-11T21:52:14.042 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:52:14.041+0000 f25a640 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:45.717196+0000 front 2023-10-11T21:50:45.723922+0000 (oldest deadline 2023-10-11T21:52:10.413712+0000) 2023-10-11T21:52:14.103 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:52:14.101+0000 ea59640 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:44.380484+0000 front 2023-10-11T21:50:44.391064+0000 (oldest deadline 2023-10-11T21:52:10.266278+0000) 2023-10-11T21:52:14.296 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:52:14.292+0000 f25a640 -1 osd.5 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.925119+0000 front 2023-10-11T21:50:46.919460+0000 (oldest deadline 2023-10-11T21:52:12.815542+0000) 2023-10-11T21:52:14.821 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:52:14.816+0000 ea59640 -1 osd.0 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.253398+0000 front 2023-10-11T21:50:46.254281+0000 (oldest deadline 2023-10-11T21:52:12.148754+0000) 2023-10-11T21:52:15.012 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:52:15.011+0000 f25a640 -1 osd.6 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:45.717196+0000 front 2023-10-11T21:50:45.723922+0000 (oldest deadline 2023-10-11T21:52:10.413712+0000) 2023-10-11T21:52:15.052 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:52:15.050+0000 ea59640 -1 osd.2 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:48.437803+0000 front 2023-10-11T21:50:48.440634+0000 (oldest deadline 2023-10-11T21:52:11.222136+0000) 2023-10-11T21:52:15.155 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:52:15.151+0000 ea59640 -1 osd.1 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:44.380484+0000 front 2023-10-11T21:50:44.391064+0000 (oldest deadline 2023-10-11T21:52:10.266278+0000) 2023-10-11T21:52:15.250 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:52:15.249+0000 f25a640 -1 osd.5 295 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:46.925119+0000 front 2023-10-11T21:50:46.919460+0000 (oldest deadline 2023-10-11T21:52:12.815542+0000) 2023-10-11T21:52:15.276 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:52:15.237+0000 ea59640 -1 osd.3 292 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:50:48.909171+0000 front 2023-10-11T21:50:48.910046+0000 (oldest deadline 2023-10-11T21:52:14.205087+0000) 2023-10-11T21:52:15.323 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:52:15.314+0000 ea59640 -1 osd.3 292 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4768.0:1 65.6s0 65.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e292) 2023-10-11T21:52:16.346 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:52:16.343+0000 ea59640 -1 osd.3 296 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4768.0:1 65.6s0 65.7fc1f406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e292) 2023-10-11T21:52:19.399 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:14.726 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.401 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:14.728 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.426 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:14.752 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.450 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:14.726 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.451 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:14.727 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.459 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:14.785 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.460 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:14.787 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.466 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:14.743 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:19.478 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:14.805 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.288 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:19.615 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.292 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:19.619 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.312 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:19.638 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.341 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:19.617 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.342 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:19.618 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.344 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:19.671 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.347 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:19.674 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.353 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:19.630 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:24.360 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:19.687 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:26.030 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_put_snap_ec (44682 ms) 2023-10-11T21:52:26.031 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.test_explicit_ec 2023-10-11T21:52:33.909 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.test_explicit_ec (7879 ms) 2023-10-11T21:52:33.910 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.set_ec 2023-10-11T21:52:34.466 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:29.792 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.522 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:29.848 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.568 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:29.844 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.575 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:29.902 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.577 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:29.904 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.584 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:29.861 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.604 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:29.931 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.614 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:29.890 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:34.624 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:29.950 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:41.071 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.set_ec (7162 ms) 2023-10-11T21:52:41.071 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 10 tests from cls_rgw (133305 ms total) 2023-10-11T21:52:41.071 INFO:tasks.workunit.client.0.smithi022.stdout: 2023-10-11T21:52:41.072 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment tear-down 2023-10-11T21:52:41.072 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] 10 tests from 1 test suite ran. (133305 ms total) 2023-10-11T21:52:41.072 INFO:tasks.workunit.client.0.smithi022.stdout:[ PASSED ] 10 tests. 2023-10-11T21:52:41.073 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-10-11T21:52:41.074 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-11T21:52:41.144 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2023-10-11T21:52:41.144 DEBUG:teuthology.orchestra.run.smithi022:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2023-10-11T21:52:41.213 INFO:tasks.workunit.client.0.smithi022.stdout:Running main() from gmock_main.cc 2023-10-11T21:52:41.214 INFO:tasks.workunit.client.0.smithi022.stdout:[==========] Running 16 tests from 1 test suite. 2023-10-11T21:52:41.214 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] Global test environment set-up. 2023-10-11T21:52:41.214 INFO:tasks.workunit.client.0.smithi022.stdout:[----------] 16 tests from cls_rgw 2023-10-11T21:52:43.122 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_basic 2023-10-11T21:52:43.721 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T21:52:43.703+0000 f25a640 -1 osd.4 270 heartbeat_check: no reply from 172.21.15.183:6815 osd.7 since back 2023-10-11T21:50:25.494201+0000 front 2023-10-11T21:50:25.495523+0000 (oldest deadline 2023-10-11T21:51:50.780142+0000) 2023-10-11T21:52:44.100 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_basic (978 ms) 2023-10-11T21:52:44.100 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2023-10-11T21:52:44.463 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:39.790 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.466 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:39.793 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.492 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:39.819 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.525 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:39.851 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.528 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:39.855 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.529 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:39.805 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.530 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:39.807 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.553 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:39.830 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.556 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:39.883 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:44.768 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (668 ms) 2023-10-11T21:52:44.768 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_remove_object 2023-10-11T21:52:45.713 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_remove_object (945 ms) 2023-10-11T21:52:45.714 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_suggest 2023-10-11T21:52:46.758 INFO:tasks.ceph.osd.4.smithi183.stderr:2023-10-11T21:52:46.756+0000 10a5d640 -1 osd.4 324 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-11T21:52:49.532 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:44.858 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.536 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:44.863 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.549 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:44.876 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.582 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:44.909 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.584 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:44.911 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.596 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:44.872 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.598 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:44.874 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.602 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:44.929 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:49.614 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:44.890 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:52:58.953 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_suggest (13240 ms) 2023-10-11T21:52:58.953 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_suggest_complete 2023-10-11T21:52:59.083 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_suggest_complete (130 ms) 2023-10-11T21:52:59.084 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_list 2023-10-11T21:52:59.689 INFO:tasks.workunit.client.0.smithi022.stdout:[ OK ] cls_rgw.index_list (606 ms) 2023-10-11T21:52:59.689 INFO:tasks.workunit.client.0.smithi022.stdout:[ RUN ] cls_rgw.index_list_delimited 2023-10-11T21:53:04.402 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:59.728 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.453 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:59.780 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.474 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:55:59.801 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.503 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:59.779 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.506 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:59.782 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.511 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:59.838 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.514 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:59.841 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.523 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:55:59.799 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.528 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:55:59.854 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.993 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:00.269 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:04.994 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:00.270 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.002 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:00.278 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.029 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:00.356 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.033 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:00.357 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.037 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:00.364 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.038 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:00.365 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.039 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:00.366 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:05.048 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:00.375 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.503 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:19.830 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.505 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:19.832 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.521 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:19.847 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.552 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:19.828 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.555 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:19.831 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.557 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:19.884 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.559 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:19.886 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.571 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:19.847 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:24.575 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:19.901 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.010 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:20.286 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.011 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:20.287 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.021 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:20.298 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.040 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:20.367 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.041 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:20.368 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.051 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:20.378 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.053 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:20.380 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.054 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:20.381 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:25.066 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:20.393 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.565 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:39.891 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.569 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:39.895 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.586 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:39.913 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.620 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:39.897 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.622 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:39.948 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.623 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:39.950 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.626 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:39.902 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.642 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:39.918 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:44.644 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:39.971 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.087 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:40.363 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.088 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:40.364 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.095 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:40.422 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.096 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:40.373 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.097 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:40.423 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.108 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:40.435 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.149 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:40.436 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.149 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:40.437 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:53:45.149 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:56:40.446 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.577 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:59.903 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.627 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:59.953 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.652 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:56:59.979 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.678 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:59.954 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.679 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.005 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.680 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:59.956 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.680 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.007 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.695 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:56:59.971 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:04.698 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.025 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.123 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:00.399 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.124 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:00.400 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.133 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:00.410 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.168 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:00.495 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.169 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:00.496 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.178 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:00.505 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.211 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.537 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.212 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.538 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:05.220 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:00.547 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:09.077 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:09.074+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:09.826 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:09.824+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:10.033 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:10.032+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:10.839 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:10.833+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:11.061 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:11.060+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:11.438 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:11.433+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:11.889 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:11.887+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:12.105 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:12.104+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:12.139 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:54:12.137+0000 ea59640 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.323541+0000 front 2023-10-11T21:52:48.321856+0000 (oldest deadline 2023-10-11T21:54:11.216742+0000) 2023-10-11T21:54:12.409 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:12.386+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:12.574 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T21:54:12.570+0000 f25a640 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.234220+0000 (oldest deadline 2023-10-11T21:54:12.234220+0000) 2023-10-11T21:54:12.931 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:12.929+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:12.960 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:54:12.949+0000 ea59640 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.495115+0000 (oldest deadline 2023-10-11T21:54:12.495115+0000) 2023-10-11T21:54:13.107 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:54:13.106+0000 ea59640 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.323541+0000 front 2023-10-11T21:52:48.321856+0000 (oldest deadline 2023-10-11T21:54:11.216742+0000) 2023-10-11T21:54:13.156 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:13.155+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:13.481 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:13.477+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:13.570 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T21:54:13.568+0000 f25a640 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.234220+0000 (oldest deadline 2023-10-11T21:54:12.234220+0000) 2023-10-11T21:54:13.909 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:13.908+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:13.925 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:54:13.924+0000 ea59640 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.495115+0000 (oldest deadline 2023-10-11T21:54:12.495115+0000) 2023-10-11T21:54:14.072 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:54:14.070+0000 ea59640 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.323541+0000 front 2023-10-11T21:52:48.321856+0000 (oldest deadline 2023-10-11T21:54:11.216742+0000) 2023-10-11T21:54:14.178 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:14.177+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:14.437 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:54:14.433+0000 f25a640 -1 osd.5 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:53.616505+0000 (oldest deadline 2023-10-11T21:54:13.616505+0000) 2023-10-11T21:54:14.488 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:14.485+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:14.555 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T21:54:14.553+0000 f25a640 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.234220+0000 (oldest deadline 2023-10-11T21:54:12.234220+0000) 2023-10-11T21:54:14.890 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:14.888+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:14.894 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:54:14.893+0000 ea59640 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.495115+0000 (oldest deadline 2023-10-11T21:54:12.495115+0000) 2023-10-11T21:54:15.091 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:54:15.090+0000 ea59640 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.323541+0000 front 2023-10-11T21:52:48.321856+0000 (oldest deadline 2023-10-11T21:54:11.216742+0000) 2023-10-11T21:54:15.226 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:15.224+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:15.448 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:54:15.447+0000 f25a640 -1 osd.5 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:53.616505+0000 (oldest deadline 2023-10-11T21:54:13.616505+0000) 2023-10-11T21:54:15.472 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:15.471+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:15.516 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T21:54:15.515+0000 f25a640 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.234220+0000 (oldest deadline 2023-10-11T21:54:12.234220+0000) 2023-10-11T21:54:15.908 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:54:15.907+0000 ea59640 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.495115+0000 (oldest deadline 2023-10-11T21:54:12.495115+0000) 2023-10-11T21:54:15.912 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:15.911+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:16.111 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T21:54:16.108+0000 ea59640 -1 osd.0 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.323541+0000 front 2023-10-11T21:52:48.321856+0000 (oldest deadline 2023-10-11T21:54:11.216742+0000) 2023-10-11T21:54:16.219 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:16.218+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:16.498 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T21:54:16.496+0000 f25a640 -1 osd.5 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:53.616505+0000 (oldest deadline 2023-10-11T21:54:13.616505+0000) 2023-10-11T21:54:16.538 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T21:54:16.536+0000 ea59640 -1 osd.3 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.383492+0000 front 2023-10-11T21:52:48.389018+0000 (oldest deadline 2023-10-11T21:54:11.281036+0000) 2023-10-11T21:54:16.557 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T21:54:16.552+0000 f25a640 -1 osd.7 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.234220+0000 (oldest deadline 2023-10-11T21:54:12.234220+0000) 2023-10-11T21:54:16.910 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T21:54:16.909+0000 ea59640 -1 osd.2 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:52.495115+0000 (oldest deadline 2023-10-11T21:54:12.495115+0000) 2023-10-11T21:54:16.915 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T21:54:16.913+0000 f25a640 -1 osd.6 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 since back 2023-10-11T21:52:48.005458+0000 front 2023-10-11T21:52:48.007735+0000 (oldest deadline 2023-10-11T21:54:09.056415+0000) 2023-10-11T21:54:17.237 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T21:54:17.236+0000 ea59640 -1 osd.1 327 heartbeat_check: no reply from 172.21.15.183:6803 osd.4 ever on either front or back, first ping sent 2023-10-11T21:52:48.949214+0000 (oldest deadline 2023-10-11T21:54:08.949214+0000) 2023-10-11T21:54:24.399 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:19.726 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.450 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:19.777 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.472 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:19.799 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.504 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:19.830 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.505 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:19.832 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.514 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:19.790 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.515 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:19.791 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.529 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:19.855 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:24.536 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:19.813 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.014 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:20.340 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.014 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:20.341 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.023 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:20.350 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.034 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:20.309 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.034 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:20.360 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.035 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:20.311 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.035 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:20.362 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.043 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:20.319 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:25.048 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:20.374 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.780 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.107 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.783 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.110 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.804 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.131 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.842 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.169 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.843 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.170 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.852 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.128 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.853 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.129 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.859 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.186 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:44.866 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.142 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.311 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.587 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.313 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.589 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.322 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:57:40.599 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.362 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.689 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.363 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.690 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.365 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.692 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.366 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.693 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.373 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:57:40.700 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:54:45.376 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:57:40.703 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.833 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.159 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.834 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.161 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.848 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.175 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.879 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.205 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.882 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.208 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.893 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.169 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.896 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.172 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.902 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.229 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:04.911 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.187 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.296 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.572 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.296 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.573 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.305 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:00.582 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.327 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.653 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.327 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.654 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.337 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:00.664 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.380 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.707 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.382 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.709 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:05.396 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:00.723 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.880 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.206 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.883 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.209 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.902 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.229 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.931 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.207 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.932 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.259 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.933 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.209 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.937 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.264 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.950 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.226 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:24.953 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.279 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.418 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.745 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.419 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.694 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.419 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.695 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.420 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.746 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.430 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:20.757 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.430 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:20.706 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.471 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.798 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.472 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.799 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:25.482 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:20.809 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:34.328 INFO:tasks.ceph.osd.4.smithi183.stderr:*** Caught signal (Aborted) ** 2023-10-11T21:55:34.329 INFO:tasks.ceph.osd.4.smithi183.stderr: in thread 2ba99640 thread_name:tp_osd_tp 2023-10-11T21:55:34.384 INFO:tasks.ceph.osd.4.smithi183.stderr: ceph version 18.2.0-669-ge62d759a (e62d759a6de3042e046d7d9889d2209cbc674fbd) reef (stable) 2023-10-11T21:55:34.384 INFO:tasks.ceph.osd.4.smithi183.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x549fdb0] 2023-10-11T21:55:34.384 INFO:tasks.ceph.osd.4.smithi183.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x54ec54c] 2023-10-11T21:55:34.385 INFO:tasks.ceph.osd.4.smithi183.stderr: 3: (ceph::HeartbeatMap::_check(ceph::heartbeat_handle_d const*, char const*, std::chrono::time_point > >)+0x226) [0xb9abe6] 2023-10-11T21:55:34.385 INFO:tasks.ceph.osd.4.smithi183.stderr: 4: (ceph::HeartbeatMap::reset_timeout(ceph::heartbeat_handle_d*, std::chrono::duration >, std::chrono::duration >)+0x70) [0xb9ace0] 2023-10-11T21:55:34.385 INFO:tasks.ceph.osd.4.smithi183.stderr: 5: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x248) [0xbaac58] 2023-10-11T21:55:34.385 INFO:tasks.ceph.osd.4.smithi183.stderr: 6: ceph-osd(+0xaa31d4) [0xbab1d4] 2023-10-11T21:55:34.385 INFO:tasks.ceph.osd.4.smithi183.stderr: 7: /lib64/libc.so.6(+0x9f802) [0x54ea802] 2023-10-11T21:55:34.386 INFO:tasks.ceph.osd.4.smithi183.stderr: 8: clone() 2023-10-11T21:55:36.781 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:58:09.313 86089== 2023-10-11T21:55:36.781 INFO:tasks.ceph.osd.4.smithi183.stderr:==00:00:58:09.313 86089== Exit program on first error (--exit-on-first-error=yes) 2023-10-11T21:55:36.871 INFO:tasks.ceph.osd.4.smithi183.stderr:daemon-helper: command failed with exit status 42 2023-10-11T21:55:39.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-11T21:55:44.934 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.260 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.936 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.263 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.954 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.280 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.982 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.258 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.984 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.260 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.986 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.313 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:44.990 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.317 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.001 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.277 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.010 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.337 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~6s 2023-10-11T21:55:45.492 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.768 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.493 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.769 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.495 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.822 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.497 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.824 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.502 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:58:40.778 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.506 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:58:40.833 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.536 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.863 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.537 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.864 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:45.546 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:58:40.873 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:55:51.454 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~12s 2023-10-11T21:55:57.664 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~19s 2023-10-11T21:56:03.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~25s 2023-10-11T21:56:04.991 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.317 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:04.993 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.320 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.010 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.336 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.040 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.316 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.042 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.319 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.044 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.371 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.046 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.373 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.057 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.333 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.061 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.388 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.505 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.781 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.506 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.782 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.515 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:00.791 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.528 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.855 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.529 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.856 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.542 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:00.869 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.621 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.948 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.624 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.951 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:05.633 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:00.960 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:10.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~31s 2023-10-11T21:56:16.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~37s 2023-10-11T21:56:22.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~43s 2023-10-11T21:56:25.044 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.371 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.048 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.375 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.064 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.391 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.092 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.368 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.096 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.373 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.101 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:20.428 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.105 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:20.432 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.113 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.389 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.125 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:20.452 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.570 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.846 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.571 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.847 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.580 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:20.856 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.615 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.942 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.616 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.943 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.625 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:20.952 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.726 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:21.053 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.727 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:21.054 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:25.736 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:21.063 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:28.714 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~50s 2023-10-11T21:56:34.924 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~56s 2023-10-11T21:56:41.134 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~62s 2023-10-11T21:56:45.095 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.421 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.096 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.423 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.110 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.437 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.147 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.423 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.148 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:40.475 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.148 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.424 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.150 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:40.477 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.162 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.438 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.173 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:40.500 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.634 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.910 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.635 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.911 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.643 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:00:59:40.919 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.651 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.978 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.652 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.979 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.662 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:00:59:40.989 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.676 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:41.003 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.677 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:41.004 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:45.689 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:00:59:41.016 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:56:47.343 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~68s 2023-10-11T21:56:53.554 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~75s 2023-10-11T21:56:59.765 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~81s 2023-10-11T21:57:05.161 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:00.488 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.162 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:00.489 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.176 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:00.503 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.208 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.484 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.211 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.487 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.215 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:00.542 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.216 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:00.543 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.231 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:00.557 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.233 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.509 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.692 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.968 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.693 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.969 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.702 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:00.978 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.742 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:01.069 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.743 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:01.070 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.753 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:01.080 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.780 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:01.107 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.781 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:01.108 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.794 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:01.121 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:05.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~87s 2023-10-11T21:57:12.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~93s 2023-10-11T21:57:18.393 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~99s 2023-10-11T21:57:24.602 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~106s 2023-10-11T21:57:25.208 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:20.534 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.210 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:20.537 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.227 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:20.554 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.261 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.537 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.265 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:20.591 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.265 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.542 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.268 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:20.595 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.279 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.555 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.285 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:20.612 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.688 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.964 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.689 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.965 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.699 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:20.975 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.739 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:21.066 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.740 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:21.067 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.752 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:21.079 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.784 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:21.111 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.785 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:21.112 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:25.794 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:21.121 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:30.812 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~112s 2023-10-11T21:57:37.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~118s 2023-10-11T21:57:40.344 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:35.670 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.393 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:35.719 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.396 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:35.673 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.399 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:35.675 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.414 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:35.741 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.418 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:35.694 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.447 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:35.774 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.452 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:35.779 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:40.482 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:35.809 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:43.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~124s 2023-10-11T21:57:45.274 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:40.601 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.277 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:40.604 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.288 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:40.615 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.325 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:40.601 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.327 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:40.603 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.338 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:40.614 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.365 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:40.692 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.367 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:40.694 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:45.380 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:40.707 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:49.441 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~130s 2023-10-11T21:57:50.292 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:45.619 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.294 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:45.621 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.304 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:00:45.631 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.335 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:45.611 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.337 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:45.664 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.341 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:45.668 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.343 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:45.619 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.352 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:00:45.679 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:50.353 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:00:45.629 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:57:55.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~137s 2023-10-11T21:58:01.857 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~143s 2023-10-11T21:58:05.345 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:00.671 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.348 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:00.674 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.367 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:00.693 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.401 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:00.677 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.402 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:00.679 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.406 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:00.733 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.408 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:00.734 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.416 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:00.692 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:05.436 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:00.762 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:08.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~149s 2023-10-11T21:58:10.351 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:05.678 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.352 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:05.627 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.352 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:05.628 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.354 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:05.681 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.363 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:05.639 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.370 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:05.696 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.405 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:05.731 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.408 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:05.735 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:10.418 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:05.745 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:14.277 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~155s 2023-10-11T21:58:20.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~161s 2023-10-11T21:58:25.392 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:20.719 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.395 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:20.721 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.408 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:20.734 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.446 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:20.722 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.447 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:20.773 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.447 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:20.723 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.448 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:20.775 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.460 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:20.736 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:25.463 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:20.789 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:26.696 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~168s 2023-10-11T21:58:30.406 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:25.732 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.408 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:25.735 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.420 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:25.747 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.454 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:25.730 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.459 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:25.735 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.459 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:25.786 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.461 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:25.788 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.469 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:25.745 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:30.476 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:25.802 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:32.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~174s 2023-10-11T21:58:39.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~180s 2023-10-11T21:58:45.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~186s 2023-10-11T21:58:45.444 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:40.771 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.448 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:40.775 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.470 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:40.796 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.508 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:40.835 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.511 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:40.838 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.514 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:40.790 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.526 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:40.802 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.527 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:40.853 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:45.540 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:40.816 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.479 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:45.806 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.482 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:45.808 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.490 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:01:45.817 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.528 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:45.855 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.531 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:45.858 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.542 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:01:45.869 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.550 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:45.826 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.551 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:45.827 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:50.560 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:01:45.836 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:58:51.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~193s 2023-10-11T21:58:57.744 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~199s 2023-10-11T21:59:03.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~205s 2023-10-11T21:59:05.497 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:00.823 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.498 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:00.774 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.499 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:00.776 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.501 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:00.828 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.517 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:00.793 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.519 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:00.846 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.552 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:00.879 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.555 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:00.882 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:05.569 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:00.896 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.164 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~211s 2023-10-11T21:59:10.514 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:05.841 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.516 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:05.843 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.525 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:05.852 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.565 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:05.841 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.566 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:05.842 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.574 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:05.901 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.575 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:05.902 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.579 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:05.855 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:10.585 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:05.912 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:16.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~217s 2023-10-11T21:59:22.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~224s 2023-10-11T21:59:25.550 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:20.876 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.553 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:20.880 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.569 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:20.895 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.599 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:20.875 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.603 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:20.879 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.605 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:20.932 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.607 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:20.934 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.618 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:20.894 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:25.622 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:20.949 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:28.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~230s 2023-10-11T21:59:30.565 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:25.891 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.566 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:25.893 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.576 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:25.903 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.610 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:25.886 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.611 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:25.937 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.614 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:25.890 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.614 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:25.941 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.624 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:25.951 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:30.627 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:25.903 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:35.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~236s 2023-10-11T21:59:41.212 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~242s 2023-10-11T21:59:45.608 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:40.934 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.610 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:40.937 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.626 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:40.952 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.654 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:40.930 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.660 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:40.936 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.661 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:40.987 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.664 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:40.991 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.675 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:40.951 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:45.680 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:41.007 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:47.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~248s 2023-10-11T21:59:50.626 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:45.953 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.629 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:45.956 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.641 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:02:45.968 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.675 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:45.951 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.678 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:45.954 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.689 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:02:45.965 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.700 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:46.027 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.703 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:46.029 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:50.712 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:02:46.038 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T21:59:53.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~255s 2023-10-11T21:59:59.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~261s 2023-10-11T22:00:05.670 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:00.996 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.670 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:00.997 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.684 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:01.010 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.720 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:00.996 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.721 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:01.048 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.722 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:00.998 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.723 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:01.049 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.735 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:01.012 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:05.740 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:01.067 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:06.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~267s 2023-10-11T22:00:10.634 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:05.961 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.679 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:05.956 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.682 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:05.958 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.684 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:06.011 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.686 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:06.012 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.686 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:06.013 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.694 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:05.970 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.697 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:06.023 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:10.703 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:06.030 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:12.259 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~273s 2023-10-11T22:00:18.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~279s 2023-10-11T22:00:24.675 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~286s 2023-10-11T22:00:25.728 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:21.054 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.732 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:21.059 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.747 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:21.074 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.784 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:21.060 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.788 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:21.065 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.801 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:21.078 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.803 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:21.130 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.808 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:21.135 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:25.823 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:21.150 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.743 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:26.070 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.745 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:26.072 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.756 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:26.083 85831== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.795 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:26.071 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.796 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:26.123 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.798 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:26.075 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.799 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:26.126 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.809 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:26.085 85545== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.809 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:26.136 85833== Warning: unimplemented fcntl command: 1036 2023-10-11T22:00:30.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~292s 2023-10-11T22:00:37.091 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~298s 2023-10-11T22:00:43.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~304s 2023-10-11T22:00:43.299 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-10-11T22:00:44.506 INFO:tasks.ceph.osd.0:Sent signal 15 2023-10-11T22:00:44.507 INFO:tasks.ceph.osd.1:Sent signal 15 2023-10-11T22:00:44.507 INFO:tasks.ceph.osd.2:Sent signal 15 2023-10-11T22:00:44.507 INFO:tasks.ceph.osd.3:Sent signal 15 2023-10-11T22:00:44.508 INFO:tasks.ceph.osd.5:Sent signal 15 2023-10-11T22:00:44.508 INFO:tasks.ceph.osd.6:Sent signal 15 2023-10-11T22:00:44.509 INFO:tasks.ceph.osd.7:Sent signal 15 2023-10-11T22:00:44.509 INFO:tasks.ceph.mon.a:Sent signal 15 2023-10-11T22:00:44.509 INFO:tasks.ceph.mon.c:Sent signal 15 2023-10-11T22:00:44.510 INFO:tasks.ceph.mon.b:Sent signal 15 2023-10-11T22:00:44.510 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-10-11T22:00:44.510 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-10-11T22:00:44.511 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T22:00:44.510+0000 7ff7284d3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term ceph-mgr -f --cluster ceph -i x (PID: 85543) UID: 0 2023-10-11T22:00:44.511 INFO:tasks.ceph.mgr.x.smithi183.stderr:2023-10-11T22:00:44.510+0000 7ff7284d3640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-10-11T22:00:44.522 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T22:00:44.512+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 6 (PID: 86083) UID: 0 2023-10-11T22:00:44.522 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T22:00:44.510+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0 (PID: 86115) UID: 0 2023-10-11T22:00:44.522 INFO:tasks.ceph.osd.0.smithi022.stderr:2023-10-11T22:00:44.512+0000 b47e640 -1 osd.0 329 *** Got signal Terminated *** 2023-10-11T22:00:44.522 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T22:00:44.512+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 7 (PID: 86087) UID: 0 2023-10-11T22:00:44.523 INFO:tasks.ceph.osd.7.smithi183.stderr:2023-10-11T22:00:44.513+0000 b47e640 -1 osd.7 329 *** Got signal Terminated *** 2023-10-11T22:00:44.523 INFO:tasks.ceph.osd.6.smithi183.stderr:2023-10-11T22:00:44.513+0000 b47e640 -1 osd.6 329 *** Got signal Terminated *** 2023-10-11T22:00:44.524 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T22:00:44.512+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 5 (PID: 86084) UID: 0 2023-10-11T22:00:44.524 INFO:tasks.ceph.mon.b.smithi183.stderr:2023-10-11T22:00:44.513+0000 9f35640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 85540) UID: 0 2023-10-11T22:00:44.526 INFO:tasks.ceph.osd.5.smithi183.stderr:2023-10-11T22:00:44.514+0000 b47e640 -1 osd.5 329 *** Got signal Terminated *** 2023-10-11T22:00:44.527 INFO:tasks.ceph.mon.b.smithi183.stderr:2023-10-11T22:00:44.514+0000 9f35640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-10-11T22:00:44.538 INFO:tasks.ceph.mon.c.smithi022.stderr:2023-10-11T22:00:44.526+0000 9f35640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 85797) UID: 0 2023-10-11T22:00:44.538 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T22:00:44.526+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1 (PID: 86130) UID: 0 2023-10-11T22:00:44.539 INFO:tasks.ceph.osd.1.smithi022.stderr:2023-10-11T22:00:44.528+0000 b47e640 -1 osd.1 329 *** Got signal Terminated *** 2023-10-11T22:00:44.539 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T22:00:44.526+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2 (PID: 86125) UID: 0 2023-10-11T22:00:44.539 INFO:tasks.ceph.mon.c.smithi022.stderr:2023-10-11T22:00:44.527+0000 9f35640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-10-11T22:00:44.540 INFO:tasks.ceph.osd.2.smithi022.stderr:2023-10-11T22:00:44.528+0000 b47e640 -1 osd.2 329 *** Got signal Terminated *** 2023-10-11T22:00:44.555 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-11T22:00:44.548+0000 9f35640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 85795) UID: 0 2023-10-11T22:00:44.555 INFO:tasks.ceph.mon.a.smithi022.stderr:2023-10-11T22:00:44.549+0000 9f35640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-10-11T22:00:44.602 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T22:00:44.593+0000 b47e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 3 (PID: 86134) UID: 0 2023-10-11T22:00:44.603 INFO:tasks.ceph.osd.3.smithi022.stderr:2023-10-11T22:00:44.594+0000 b47e640 -1 osd.3 329 *** Got signal Terminated *** 2023-10-11T22:00:44.722 INFO:tasks.ceph.mgr.y.smithi022.stderr:daemon-helper: command crashed with signal 15 2023-10-11T22:00:45.200 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:40.526 85831== 2023-10-11T22:00:45.200 INFO:tasks.ceph.mon.a.smithi022.stderr:==00:01:03:40.526 85831== Exit program on first error (--exit-on-first-error=yes) 2023-10-11T22:00:45.323 INFO:tasks.ceph.mon.a.smithi022.stderr:daemon-helper: command failed with exit status 42 2023-10-11T22:00:45.323 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:40.599 85545== 2023-10-11T22:00:45.324 INFO:tasks.ceph.mon.b.smithi183.stderr:==00:01:03:40.599 85545== Exit program on first error (--exit-on-first-error=yes) 2023-10-11T22:00:45.512 INFO:tasks.ceph.mon.b.smithi183.stderr:daemon-helper: command failed with exit status 42 2023-10-11T22:00:50.465 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:45.792 85833== 2023-10-11T22:00:50.465 INFO:tasks.ceph.mon.c.smithi022.stderr:==00:01:03:45.792 85833== Exit program on first error (--exit-on-first-error=yes) 2023-10-11T22:00:50.529 INFO:tasks.ceph.mon.c.smithi022.stderr:daemon-helper: command failed with exit status 42 2023-10-12T00:52:41.203 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-12T00:52:41.234 INFO:tasks.workunit:Stopping ['cls'] on client.0... 2023-10-12T00:52:41.234 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-10-12T00:52:41.533 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cls/test_cls_rgw.sh) on smithi022 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' 2023-10-12T00:52:41.607 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e0947c14315b4f2499dea5742528192a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test cls/test_cls_rgw.sh) on smithi022 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' 2023-10-12T00:52:41.610 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-12T00:52:41.620 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-12T00:52:41.621 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-12T00:54:41.671 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-12T00:54:41.673 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2023-10-12T00:54:41.681 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-12T00:54:41.682 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-12T00:54:41.683 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-12T00:54:41.683 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.685 INFO:tasks.ceph.osd.0:Stopped 2023-10-12T00:54:41.686 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-12T00:54:41.686 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.687 INFO:tasks.ceph.osd.1:Stopped 2023-10-12T00:54:41.687 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-12T00:54:41.688 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.688 INFO:tasks.ceph.osd.2:Stopped 2023-10-12T00:54:41.689 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-12T00:54:41.689 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.690 INFO:tasks.ceph.osd.3:Stopped 2023-10-12T00:54:41.690 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-12T00:54:41.691 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.691 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-12T00:54:41.692 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi183 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 4" 2023-10-12T00:54:41.701 INFO:tasks.ceph.osd.4:Stopped 2023-10-12T00:54:41.702 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-12T00:54:41.702 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.703 INFO:tasks.ceph.osd.5:Stopped 2023-10-12T00:54:41.703 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-12T00:54:41.704 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.704 INFO:tasks.ceph.osd.6:Stopped 2023-10-12T00:54:41.705 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-12T00:54:41.705 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.706 INFO:tasks.ceph.osd.7:Stopped 2023-10-12T00:54:41.706 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-12T00:54:41.707 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-12T00:54:41.707 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:54:41.708 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y' 2023-10-12T00:54:41.718 INFO:tasks.ceph.mgr.y:Stopped 2023-10-12T00:54:41.718 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-12T00:54:41.719 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.719 INFO:tasks.ceph.mgr.x:Stopped 2023-10-12T00:54:41.720 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-12T00:54:41.720 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-12T00:54:41.721 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.721 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-12T00:54:41.722 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a" 2023-10-12T00:54:41.733 INFO:tasks.ceph.mon.a:Stopped 2023-10-12T00:54:41.734 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-12T00:54:41.734 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.735 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-12T00:54:41.735 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c" 2023-10-12T00:54:41.745 INFO:tasks.ceph.mon.c:Stopped 2023-10-12T00:54:41.745 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-12T00:54:41.746 INFO:teuthology.orchestra.run:waiting for 300 2023-10-12T00:54:41.747 DEBUG:teuthology.orchestra.run:got remote process result: 42 2023-10-12T00:54:41.747 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1463, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi183 with status 42: "cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b" 2023-10-12T00:54:41.758 INFO:tasks.ceph.mon.b:Stopped 2023-10-12T00:54:41.759 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-12T00:54:41.759 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | head -n 1 2023-10-12T00:54:41.801 INFO:teuthology.orchestra.run.smithi022.stdout:2023-10-11T21:52:15.355165+0000 mon.a (mon.0) 868 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2023-10-12T00:54:41.802 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-12T00:54:41.803 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-12T00:54:41.803 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-12T00:54:41.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-12T00:54:41.916 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-12T00:54:41.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-12T00:54:41.969 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-12T00:54:42.070 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi022.front.sepia.ceph.com 2023-10-12T00:54:42.071 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-12T00:54:42.159 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-12T00:54:42.160 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-12T00:54:42.290 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-12T00:54:42.290 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-12T00:54:42.345 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-12T00:54:42.346 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-12T00:54:42.399 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi183.front.sepia.ceph.com 2023-10-12T00:54:42.400 DEBUG:teuthology.orchestra.run.smithi183:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-12T00:54:42.451 INFO:tasks.ceph:Archiving mon data... 2023-10-12T00:54:42.453 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/data/mon.a.tgz 2023-10-12T00:54:42.454 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-10-12T00:54:42.470 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.xVdZgbSyx9 2023-10-12T00:54:42.470 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.xVdZgbSyx9 2023-10-12T00:54:42.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.xVdZgbSyx9 2023-10-12T00:54:42.705 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.xVdZgbSyx9 is 378KB 2023-10-12T00:54:42.802 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.xVdZgbSyx9 2023-10-12T00:54:42.817 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/data/mon.c.tgz 2023-10-12T00:54:42.818 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2023-10-12T00:54:42.872 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.0w6ZYRUk9D 2023-10-12T00:54:42.873 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0w6ZYRUk9D 2023-10-12T00:54:43.009 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.0w6ZYRUk9D 2023-10-12T00:54:43.098 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.0w6ZYRUk9D is 378KB 2023-10-12T00:54:43.165 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.0w6ZYRUk9D 2023-10-12T00:54:43.180 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/data/mon.b.tgz 2023-10-12T00:54:43.181 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2023-10-12T00:54:43.199 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.uQIbFqxuJr 2023-10-12T00:54:43.200 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.uQIbFqxuJr 2023-10-12T00:54:43.352 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.uQIbFqxuJr 2023-10-12T00:54:43.437 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.uQIbFqxuJr is 378KB 2023-10-12T00:54:43.533 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.uQIbFqxuJr 2023-10-12T00:54:43.548 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-12T00:54:43.548 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-12T00:54:43.551 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-12T00:54:43.614 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-12T00:54:43.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-12T00:54:43.623 DEBUG:teuthology.orchestra.run.smithi183:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-12T00:54:43.667 INFO:teuthology.orchestra.run.smithi022.stdout:/var/log/ceph/valgrind/mon.a.log: Leak_StillReachable 2023-10-12T00:54:43.668 INFO:teuthology.orchestra.run.smithi022.stdout:/var/log/ceph/valgrind/mon.c.log: Leak_StillReachable 2023-10-12T00:54:43.669 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.a.log kind Leak_StillReachable 2023-10-12T00:54:43.669 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.a.log 2023-10-12T00:54:43.673 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.c.log kind Leak_StillReachable 2023-10-12T00:54:43.673 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.c.log 2023-10-12T00:54:43.694 INFO:teuthology.orchestra.run.smithi183.stdout:/var/log/ceph/valgrind/mon.b.log: Leak_StillReachable 2023-10-12T00:54:43.694 INFO:teuthology.orchestra.run.smithi183.stdout:/var/log/ceph/valgrind/osd.4.log: Leak_PossiblyLost 2023-10-12T00:54:43.694 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/mon.b.log kind Leak_StillReachable 2023-10-12T00:54:43.695 ERROR:tasks.ceph:saw valgrind issue Leak_StillReachable in /var/log/ceph/valgrind/mon.b.log 2023-10-12T00:54:43.698 DEBUG:tasks.ceph:file /var/log/ceph/valgrind/osd.4.log kind Leak_PossiblyLost 2023-10-12T00:54:43.698 ERROR:tasks.ceph:saw valgrind issue Leak_PossiblyLost in /var/log/ceph/valgrind/osd.4.log 2023-10-12T00:54:43.702 INFO:tasks.ceph:Archiving crash dumps... 2023-10-12T00:54:43.704 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi022/crash 2023-10-12T00:54:43.706 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-12T00:54:43.737 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi183/crash 2023-10-12T00:54:43.738 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-12T00:54:43.767 INFO:tasks.ceph:Compressing logs... 2023-10-12T00:54:43.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-12T00:54:43.782 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-12T00:55:14.912 INFO:tasks.ceph:Archiving logs... 2023-10-12T00:55:14.913 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi022/log 2023-10-12T00:55:14.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-12T00:55:17.978 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi183/log 2023-10-12T00:55:17.980 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-12T00:55:19.268 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-12T00:55:19.286 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-12T00:55:19.295 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues 2023-10-12T00:55:19.302 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-12T00:55:19.303 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-12T00:55:19.310 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-12T00:55:19.394 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-12T00:55:19.403 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-12T00:55:19.403 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-12T00:55:19.406 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-12T00:55:19.420 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2023-10-12T00:55:19.422 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2023-10-12T00:55:19.425 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-12T00:55:19.425 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2023-10-12T00:55:19.425 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 5 -246us[ -246us] +/- 76ms 2023-10-12T00:55:19.426 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv02.front.sepia.ceph.com 3 8 377 183 +956us[ +966us] +/- 56ms 2023-10-12T00:55:19.426 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -1088us[-1088us] +/- 90ms 2023-10-12T00:55:19.426 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-12T00:55:19.428 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-12T00:55:19.428 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2023-10-12T00:55:19.429 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 120 -251us[ -251us] +/- 74ms 2023-10-12T00:55:19.429 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv02.front.sepia.ceph.com 3 9 377 372 +982us[ +983us] +/- 54ms 2023-10-12T00:55:19.429 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 62 -1067us[-1067us] +/- 90ms 2023-10-12T00:55:19.429 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-12T00:55:19.430 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-12T00:55:19.439 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-12T00:55:19.439 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-12T00:55:19.448 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-12T00:55:19.577 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-12T00:55:19.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-12T00:55:19.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:55:19.715 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-12T00:55:19.747 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:55:19.748 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-12T00:55:19.757 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-12T00:55:19.791 INFO:teuthology.task.internal:Duration was 15200.699754 seconds 2023-10-12T00:55:19.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-12T00:55:19.801 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-12T00:55:19.802 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-12T00:55:19.805 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-12T00:55:19.849 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-12T00:55:19.854 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-12T00:55:20.190 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-12T00:55:20.191 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2023-10-12T00:55:20.192 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-12T00:55:20.213 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2023-10-12T00:55:20.214 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-12T00:55:20.235 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-12T00:55:20.236 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-12T00:55:20.256 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-12T00:55:20.303 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-12T00:55:20.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-12T00:55:20.328 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-12T00:55:20.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-12T00:55:20.461 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-12T00:55:20.461 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-12T00:55:20.492 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-12T00:55:20.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-12T00:55:20.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-12T00:55:20.535 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-12T00:55:20.562 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2023-10-12T00:55:20.584 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2023-10-12T00:55:20.606 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-12T00:55:20.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:55:20.641 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-12T00:55:20.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:55:20.660 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-12T00:55:20.671 INFO:teuthology.task.internal:Transferring archived files... 2023-10-12T00:55:20.672 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi022 2023-10-12T00:55:20.673 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-12T00:55:20.720 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575/remote/smithi183 2023-10-12T00:55:20.721 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-12T00:55:20.757 INFO:teuthology.task.internal:Removing archive directory... 2023-10-12T00:55:20.758 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-12T00:55:20.760 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-12T00:55:20.806 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-12T00:55:20.817 INFO:teuthology.task.internal:Not uploading archives. 2023-10-12T00:55:20.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-12T00:55:20.828 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-12T00:55:20.829 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-12T00:55:20.832 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-12T00:55:20.844 INFO:teuthology.orchestra.run.smithi022.stdout: 265877 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 12 00:55 /home/ubuntu/cephtest 2023-10-12T00:55:20.845 INFO:teuthology.orchestra.run.smithi022.stdout: 655691 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 11 20:58 /home/ubuntu/cephtest/mnt.0 2023-10-12T00:55:20.845 INFO:teuthology.orchestra.run.smithi022.stdout: 655692 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Oct 11 21:52 /home/ubuntu/cephtest/mnt.0/client.0 2023-10-12T00:55:20.845 INFO:teuthology.orchestra.run.smithi022.stdout: 669427 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 11 21:52 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-10-12T00:55:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-12T00:55:20.849 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-12T00:55:20.849 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 322, in valgrind_post yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1944, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2745, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2577, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 2343, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1597, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph_manager.py", line 1588, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 1951, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_e62d759a6de3042e046d7d9889d2209cbc674fbd/qa/tasks/ceph.py", line 362, in valgrind_post raise valgrind_exception Exception: saw valgrind issues During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi022 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-10-12T00:55:20.867 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-12T00:55:20.878 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-12T00:55:20.890 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: saw valgrind issues 2023-10-12T00:55:20.891 INFO:teuthology.nuke:Checking targets against current locks 2023-10-12T00:55:20.894 INFO:teuthology.orchestra.run.smithi183.stdout: 265982 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 12 00:55 /home/ubuntu/cephtest 2023-10-12T00:55:20.895 INFO:teuthology.orchestra.run.smithi183.stdout: 267042 761956 -rw------- 1 root root 780673024 Oct 11 21:55 /home/ubuntu/cephtest/vgcore.86089 2023-10-12T00:55:20.896 INFO:teuthology.orchestra.run.smithi183.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-10-12T00:55:20.920 DEBUG:teuthology.nuke:shortname: smithi022 2023-10-12T00:55:20.921 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T00:55:20.947 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 20:33:54.763149', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAp7mZpaoVc/wuaJlSHU0ll0diFnPGt20rhRfEYYWdVm5wW7TZ4LnHFD/MwjXgKIfuQwcR7CmEVYQ7ZJJf4EByA='} 2023-10-12T00:55:20.951 DEBUG:teuthology.nuke:shortname: smithi183 2023-10-12T00:55:20.952 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-12T00:55:20.972 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-11_14:08:36-rados-wip-yuri11-testing-2023-10-10-1226-reef-distro-default-smithi/7421575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-11 20:33:54.760857', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOu3Q7wkHByOetS2rapqah+piqG0kpJ/U/dBkCnPFXLG2lDN3jixV41sWEJ7UHaYSLW+RZK1k1kSVcV1fq/4s8='} 2023-10-12T00:55:21.002 INFO:teuthology.orchestra.console.smithi022:Power off 2023-10-12T00:55:21.003 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T00:55:21.028 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off 2023-10-12T00:55:21.029 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:21.044 INFO:teuthology.orchestra.console.smithi183:Power off 2023-10-12T00:55:21.045 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-12T00:55:21.055 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-10-12T00:55:21.068 DEBUG:teuthology.orchestra.console.smithi183:power off output: Chassis Power Control: Down/Off 2023-10-12T00:55:21.068 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:21.095 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-12T00:55:25.057 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:25.097 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:25.168 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on 2023-10-12T00:55:25.208 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is on 2023-10-12T00:55:29.170 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:29.209 DEBUG:teuthology.orchestra.console.smithi183:pexpect command: ipmitool -H smithi183.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-12T00:55:29.280 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off 2023-10-12T00:55:29.321 DEBUG:teuthology.orchestra.console.smithi183:check power output: Chassis Power is off 2023-10-12T00:55:29.382 INFO:teuthology.orchestra.console.smithi022:Power off completed 2023-10-12T00:55:29.422 INFO:teuthology.orchestra.console.smithi183:Power off completed 2023-10-12T00:55:29.527 INFO:teuthology.run:Summary data: description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} duration: 15200.699754238129 failure_reason: 'Command failed (workunit test cls/test_cls_rgw.sh) on smithi022 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e62d759a6de3042e046d7d9889d2209cbc674fbd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e0947c14315b4f2499dea5742528192a status: fail success: false 2023-10-12T00:55:29.528 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-12T00:55:29.605 INFO:teuthology.run:FAIL